Commit graph

1018 commits

Author SHA1 Message Date
Sirius DevOps
4f235b52f4 Archive cleanup and rewrite README as a lab write-up.
Drop duplicate app/Helm trees, planning notes, and the vwap-monitor
source tree so this repo is GitOps + Terraform only. Document the
GKE cluster as shut down, with file-level pointers for vLLM, KEDA
scale-to-zero, Flux, and SOPS.
2026-09-04 22:38:00 -04:00
Sirius DevOps
fe4fa1f34d
clean up 2026-08-28 20:02:01 -04:00
sirius0xdev
eb27a51523
clean up 2026-06-04 20:18:23 -04:00
sirius0xdev
88db49b8b5
Delete dummy0auth.yaml 2026-05-31 21:48:58 -04:00
sirius0xdev
87632b2247 clean up unused files 2026-05-29 22:55:22 +00:00
sirius0xdev
d7beb9f6ab Merge branch 'master' of github.com:sirius0xdev/gcloud-lab 2026-05-29 22:30:11 +00:00
sirius0xdev
2b54a18724
Update kustomization.yaml 2026-05-29 11:41:16 -04:00
Hermes DevOps
12766f293c fix(dashboard): add :8000 port to service URLs in ConfigMap
Next.js rewrites now use env vars (DATA_SERVICE_URL etc.) which point
to in-cluster services. Missing port caused rewrites to hit port 80
instead of 8000, breaking /api/data/* proxy (candles, orderbook).
2026-05-29 13:39:05 +00:00
Hermes DevOps
18764cf6b5 fix: allow port 80 in inter-service egress for ClusterIP traffic 2026-05-29 13:16:35 +00:00
sirius0xdev
79e0d98fbe
Update kustomization.yaml 2026-05-29 08:42:41 -04:00
sirius0xdev
2c00a5ab1c
Update kustomization.yaml 2026-05-29 00:38:15 -04:00
sirius0xdev
a04fdf5145
Merge pull request #196 from sirius0xdev/fix/news-bot-schedule
feat: JSON output prompts for trading + OSINT dashboard
2026-05-28 23:25:22 -04:00
Hermes DevOps
91e337a0df feat: JSON output prompts for trading platform + OSINT dashboard 2026-05-29 03:22:31 +00:00
sirius0xdev
2544a0fdd5
Update kustomization.yaml 2026-05-28 22:27:53 -04:00
sirius0xdev
14a3643d56
Update kustomization.yaml 2026-05-28 07:10:24 -04:00
sirius0xdev
09f622e191
Merge pull request #195 from sirius0xdev/fix/news-bot-schedule
fix(news-bot): drop telebot, fix scraper schedule
2026-05-28 02:32:15 -04:00
Hermes DevOps
2b7909d84f fix(news-bot): fix pipeline timing, consolidate to single analyst
- Move scraper from :50 to :00 (runs first)
- Remove analyst-gemma and deepseek-analyst-v1.1 (was race condition)
- Enable new_deepseek.yaml (deepseek-analyst v1.2, latest image)
- Pipeline: scraper :00 -> analyst :15 -> telebot :30
2026-05-28 06:30:48 +00:00
sirius0xdev
c75510cb09
Update new_deepseek.yaml 2026-05-28 01:50:33 -04:00
sirius0xdev
d59ea9e6f0
fix(news_bot): switch analyst to ghcr.io + activate CronJob
- new_deepseek.yaml: switch image to ghcr.io/sirius0xdev/news-analyst:latest
- kustomization.yaml: activate new_deepseek.yaml (uncomment)
- Replaces Docker Hub siriussec/summarizerlocal:3.8 with GHCR-built image

Co-authored-by: sirius0xdev <sirius0xdev@users.noreply.github.com>
2026-05-27 23:46:09 -04:00
sirius0xdev
f49e3c9037 Merge branch 'master' of github.com:sirius0xdev/gcloud-lab
fuck me#
2026-05-28 03:17:03 +00:00
sirius0xdev
8b5aa4f72d
Update kustomization.yaml 2026-05-27 23:12:01 -04:00
sirius0xdev
93ce67a108
fix(news_bot): clean URLs + switch scraper to GHCR registry
- De-duplicate URLs in scrapy-urls configmap
- Switch CronJob image from siriussec/newsscraper:0.5.4 to ghcr.io/sirius0xdev/newsscraper:latest
- imagePullPolicy already set to Always

Co-authored-by: Sirius Devops <sirius@siriusdevops.com>
2026-05-27 23:07:57 -04:00
sirius0xdev
75c2aa599e
fix(cnpg): add news_app managed role for news_bot scraper
CNPG cluster was missing the news_app role — scraper cronjob
was failing with 'connection to server at port 5432 failed'
because the role had no login/password configured in managed roles.

Adds news_app to managed roles, pointing to existing
news-app-password secret.

Co-authored-by: Hermes DevOps <hermes@devops.local>
2026-05-27 21:06:28 -04:00
sirius0xdev
007900e01b
fix(news-service): mount news-app-password secret for scraper DB
Adds NEWS_DB_PASSWORD env var from existing news-app-password secret
so the secondary DB connection to news_app_db can authenticate.

Co-authored-by: Hermes DevOps <hermes@devops.local>
2026-05-27 20:41:01 -04:00
sirius0xdev
ba7d6de7c8
feat(news-service): add scraper DB config to K8s configmap
Adds NEWS_DB_HOST, NEWS_DB_PORT, NEWS_DB_NAME, NEWS_DB_USER to news-service ConfigMap for secondary DB connection to news_app_db.
2026-05-27 20:27:07 -04:00
Hermes Agent
a20debf02e config(dashboard): remove explicit ports from service URLs
K8s Services all expose on port 80 (mapping to container ports internally).
URLs should be bare — K8s DNS resolves to port 80 by default.
2026-05-27 20:35:47 +00:00
Hermes Agent
77a5a99c5f config(dashboard): add ports to service URLs
Service-to-service calls need explicit ports. Without them, dashboard
proxy was hitting port 80 which doesn't exist on backend services.
2026-05-27 20:20:38 +00:00
Hermes Agent
89bd139ba9 fix(netpol): allow external egress (ports 80/443) for API websockets
Data service needs to reach Helius WSS, Solana RPC, Jupiter API,
Hyperliquid — all external. Network policy had no egress rule for
external traffic, so all API/websocket connections were blocked.
2026-05-27 19:34:04 +00:00
Hermes Agent
f9623b9ca2 config(execute-service): enable auto-create tables in production
Sets EXECUTE_DB_AUTO_CREATE_TABLES=true so the service creates
its own tables on startup instead of relying on non-existent
alembic migrations.
2026-05-27 19:20:31 +00:00
sirius0xdev
267356de97
Merge pull request #187 from sirius0xdev/fix/kafka-netpol-label
fix: network policy Kafka selector app → strimzi labels
2026-05-27 10:20:42 -04:00
Hermes Agent
bb170365cc fix: network policy Kafka selector app -> strimzi labels
Data-service pods use NetworkPolicy egress selector app: trading-kafka
but Strimzi Kafka pods are labeled strimzi.io/name=trading-kafka.
This silently blocked all Kafka traffic causing NoBrokersAvailable.
2026-05-27 14:19:26 +00:00
sirius0xdev
037ba16543
Merge pull request #186 from sirius0xdev/fix/redis-maxmemory-unit
fix: redis maxmemory unit 1gi -> 1gb for Redis 7.4.7 compat
2026-05-27 10:05:29 -04:00
Hermes Agent
6447f92157 fix: redis maxmemory unit 1gi -> 1gb for Redis 7.4.7 compat 2026-05-27 13:59:06 +00:00
sirius0xdev
87c0835e72
Merge pull request #185 from sirius0xdev/fix/redis-stack-image-tag
fix: redis-stack image tag 7.4.0-v8
2026-05-27 09:39:54 -04:00
Hermes Agent
18b728c95e fix: redis-stack image tag 7.4.0-v8 (7.4.2-v16 not found) 2026-05-27 13:37:47 +00:00
sirius0xdev
f8fa436b8b
Merge RediSearch PR
Redis Stack with RediSearch for HNSW vector search. Memory bumped to 1Gi.
2026-05-27 08:17:36 -04:00
sirius0xdev
bf37ebd3b3
Merge pull request #180 from sirius0xdev/feat/trading-api-keys-secret
feat: add trading-api-keys secret for Helius API key
2026-05-27 01:55:40 -04:00
Hermes DevOps
9eecad47bb fix: point data-service to solana-api-keys secret + set Helius key
- Fix deployment env refs: trading-platform-secrets -> solana-api-keys
- Replace placeholder helius-api-key with actual value
2026-05-27 05:52:43 +00:00
sirius0xdev
380325c981
Merge pull request #179 from sirius0xdev/feat/merge-solana-ingester-into-data-service
Merge solana-ingester into data-service
2026-05-27 01:34:26 -04:00
sirius0xdev
6b2472f376
Merge pull request #177 from sirius0xdev/migrate-news-bot-to-rtx6000-vllm
Migrate news bot to rtx6000-brain vLLM endpoint
2026-05-27 01:31:02 -04:00
Hermes Agent
26059b01e6 Merge solana-ingester into data-service, remove standalone deployment
- Remove solana-ingester deployment (was using a nonexistent CLI entrypoint)
- Merge all ingestion into data-service via env vars + shared image
- Add HELIUS_API_KEY, JUPITER_API_KEY, KAFKA_BROKER to data-service configmap
- Add solana secret refs to data-service deployment
- Remove solana-ingester-config configmap
2026-05-27 05:27:55 +00:00
sirius0xdev
39c2e1121a
Merge pull request #178 from sirius0xdev/fix/split-solana-secrets
fix(secrets): split Solana API keys into separate SOPS file
2026-05-27 00:36:43 -04:00
c7731aeec0 fix(secrets): split Solana API keys into separate SOPS file
- Remove helius/jupiter placeholders from trading-secrets.yaml
- Create new solana-api-keys.yaml with helius-api-key and jupiter-api-key
- Update kustomization.yaml to include solana-api-keys.yaml

Convention: each secret group gets its own SOPS-encrypted file
instead of adding new keys to an already encrypted file.
2026-05-27 04:35:47 +00:00
Hermes Agent
e8f33a7bd0 Migrate news bot to rtx6000-brain vLLM endpoint
- Replace Gemini API and A100 vLLM references with central rtx6000-brain vLLM
  endpoint (http://rtx6000-brain-service.customer1.svc.cluster.local:8000/v1)
- Update all ConfigMaps to use model edp1096/Huihui-Qwen3.6-27B-abliterated-FP8
- Add LLM_API_KEY: sk-dummy to all ConfigMaps
- Remove ollama sidecars, initContainers, PVC volumes from all analyst CronJobs
- Remove GPU nodeSelector, tolerations, and GPU resource requests from CronJobs
- Clean up kustomization.yaml: remove ollama-storage.yaml, deepseek-storage.yaml,
  gemini-apikey.yaml references
- Activate deepseek-summarizer.yaml in kustomization, keep others commented
2026-05-27 04:25:41 +00:00
sirius0xdev
0768af1a31
Merge pull request #176 from sirius0xdev/feat/solana-ingester-redis-pvc
feat: add Solana WebSocket ingester + Redis persistent volume
2026-05-27 00:07:57 -04:00
Hermes DevOps
e24e82107d feat: add solana-ingester deployment for real-time market data
- Create solana-ingester Deployment + Service in trading-platform/
  (uses same data-service image, runs WebSocket ingester mode)
- Add solana-ingester ConfigMap (HELIUS_RPC_ENDPOINT, JUPITER_API_URL,
  KAFKA_BROKER, KAFKA_TOPIC)
- Add helius-api-key and jupiter-api-key placeholders to trading-secrets.yaml
  (TODO: replace with real values and re-encrypt with SOPS)
- Update kustomization to include new resources
2026-05-27 04:05:41 +00:00
Hermes DevOps
c587a707a6 feat(redis): add persistent volume for trading-redis
Replace emptyDir with 10Gi PVC (ReadWriteOnce) so hot cache
survives pod restarts.
2026-05-27 04:05:41 +00:00
sirius0xdev
7e55874faf
Update kustomization.yaml 2026-05-26 22:38:39 -04:00
sirius0xdev
37cf8d1276 Merge branch 'master' of github.com:sirius0xdev/gcloud-lab
please wprl#
2026-05-27 02:19:52 +00:00
sirius0xdev
e78674a964 Fix data-service port mismatch: container runs on 8000, not 8001 2026-05-26 10:54:23 -09:00