d08bf5844a
- Rename deployment to rtx6000-brain-vllm to match scaler target ref - Set deployment replicas to 0 (KEDA controlled) - Add pollingInterval: 10s and cooldownPeriod: 30s for faster response This enables scale-to-zero when idle and quick scale-up on first request. See https://github.com/sirius0xdev/gcloud-lab/tree/master/infrastructure%2Fgpus%2Fbase
17 lines
397 B
YAML
17 lines
397 B
YAML
apiVersion: keda.sh/v1alpha1
|
|
kind: ScaledObject
|
|
metadata:
|
|
name: rtx6000-scaling
|
|
namespace: customer1
|
|
spec:
|
|
scaleTargetRef:
|
|
name: rtx6000-brain-vllm
|
|
kind: Deployment
|
|
apiVersion: apps/v1
|
|
hosts:
|
|
- rtx6000-brain-service.customer1.svc.cluster.local
|
|
replicas:
|
|
min: 0
|
|
max: 1
|
|
targetPendingRequests: 1
|
|
scaledownPeriod: 900\n pollingInterval: 10\n cooldownPeriod: 30
|