6 commits

Author	SHA1	Message	Date
sirius0xdev	7e7b7d414d	fix: restrict KEDA scaling to /v1/(chat/)?completions paths only ... - Switch to HTTPScaledObject (matches a100 pattern) - Probes (/health, /v1/models) now ignored for scaling - Keeps fast polling (10s), quick cooldown (30s), 15min idle scale-to-0 Health/readiness/startup probes hit pod IP directly (bypass service), so never triggered scaling anyway — but paths ensure only inference traffic scales.	2026-04-29 04:14:46 +00:00
sirius0xdev	d08bf5844a	feat: optimize RTX6000 vLLM KEDA scaling ... - Rename deployment to rtx6000-brain-vllm to match scaler target ref - Set deployment replicas to 0 (KEDA controlled) - Add pollingInterval: 10s and cooldownPeriod: 30s for faster response This enables scale-to-zero when idle and quick scale-up on first request. See https://github.com/sirius0xdev/gcloud-lab/tree/master/infrastructure%2Fgpus%2Fbase	2026-04-29 04:12:36 +00:00
sirius0xdev	64eaeef931	Update keda-vllm.yaml	2026-04-29 00:05:09 -04:00
sirius0xdev	d3bea19f41	Update keda-vllm.yaml	2026-04-28 23:58:26 -04:00
sirius0xdev	dc285d26a8	fix kustomization	2026-04-28 03:38:08 +00:00
sirius0xdev	9f5d1fb723	clean up and add routes to paas site	2026-04-28 03:31:52 +00:00