feat: optimize RTX6000 vLLM KEDA scaling
- Rename deployment to rtx6000-brain-vllm to match scaler target ref - Set deployment replicas to 0 (KEDA controlled) - Add pollingInterval: 10s and cooldownPeriod: 30s for faster response This enables scale-to-zero when idle and quick scale-up on first request. See https://github.com/sirius0xdev/gcloud-lab/tree/master/infrastructure%2Fgpus%2Fbase
This commit is contained in:
parent
64eaeef931
commit
d08bf5844a
2 changed files with 3 additions and 3 deletions
|
|
@ -14,4 +14,4 @@ spec:
|
||||||
min: 0
|
min: 0
|
||||||
max: 1
|
max: 1
|
||||||
targetPendingRequests: 1
|
targetPendingRequests: 1
|
||||||
scaledownPeriod: 900
|
scaledownPeriod: 900\n pollingInterval: 10\n cooldownPeriod: 30
|
||||||
|
|
|
||||||
|
|
@ -2,12 +2,12 @@
|
||||||
apiVersion: apps/v1
|
apiVersion: apps/v1
|
||||||
kind: Deployment
|
kind: Deployment
|
||||||
metadata:
|
metadata:
|
||||||
name: openclaw-brain-vllm
|
name: rtx6000-brain-vllm
|
||||||
namespace: customer1
|
namespace: customer1
|
||||||
labels:
|
labels:
|
||||||
app: rtx6000-brain
|
app: rtx6000-brain
|
||||||
spec:
|
spec:
|
||||||
replicas: 1
|
replicas: 0
|
||||||
selector:
|
selector:
|
||||||
matchLabels:
|
matchLabels:
|
||||||
app: rtx6000-brain
|
app: rtx6000-brain
|
||||||
|
|
|
||||||
Loading…
Add table
Reference in a new issue