7e7b7d414d
- Switch to HTTPScaledObject (matches a100 pattern) - Probes (/health, /v1/models) now ignored for scaling - Keeps fast polling (10s), quick cooldown (30s), 15min idle scale-to-0 Health/readiness/startup probes hit pod IP directly (bypass service), so never triggered scaling anyway — but paths ensure only inference traffic scales. |
||
|---|---|---|
| .. | ||
| controllers | ||
| gatewayapi | ||
| gpus | ||