sirius/gcloud-lab
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

fix: adjust max-model-len and memory utilization for Venice

Browse source
This commit is contained in:
SiriusClaw 2026-04-18 19:35:20 +00:00
parent aa40f87885
commit 7826ff0398
1 changed files with 3 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

4
apps/base/customer1/openclaw/vllm-gemma.yaml
View file

@ -32,8 +32,10 @@ spec:
- "--dtype"
- "bfloat16"
- "--max-model-len"
- "32768"
- "8192"
- "--trust-remote-code"
- "--gpu-memory-utilization"
- "0.95"
ports:
- containerPort: 8000
resources: