feat: optimize RTX6000 vLLM KEDA scaling
- Rename deployment to rtx6000-brain-vllm to match scaler target ref - Set deployment replicas to 0 (KEDA controlled) - Add pollingInterval: 10s and cooldownPeriod: 30s for faster response This enables scale-to-zero when idle and quick scale-up on first request. See https://github.com/sirius0xdev/gcloud-lab/tree/master/infrastructure%2Fgpus%2Fbase
This commit is contained in:
parent
64eaeef931
commit
d08bf5844a
2 changed files with 3 additions and 3 deletions
|
|
@ -14,4 +14,4 @@ spec:
|
|||
min: 0
|
||||
max: 1
|
||||
targetPendingRequests: 1
|
||||
scaledownPeriod: 900
|
||||
scaledownPeriod: 900\n pollingInterval: 10\n cooldownPeriod: 30
|
||||
|
|
|
|||
|
|
@ -2,12 +2,12 @@
|
|||
apiVersion: apps/v1
|
||||
kind: Deployment
|
||||
metadata:
|
||||
name: openclaw-brain-vllm
|
||||
name: rtx6000-brain-vllm
|
||||
namespace: customer1
|
||||
labels:
|
||||
app: rtx6000-brain
|
||||
spec:
|
||||
replicas: 1
|
||||
replicas: 0
|
||||
selector:
|
||||
matchLabels:
|
||||
app: rtx6000-brain
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue