sirius/gcloud-lab
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Merge pull request #22 from sirius0xdev/fix/vllm-gemma-crash

Browse source 
fix: enforce eager execution to stop gemma CUDA graph crash
This commit is contained in:
sirius0xdev 2026-04-18 17:33:29 -04:00 • committed by GitHub
commit 755bdb39ba
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
apps/base/customer1/openclaw/vllm-gemma.yaml
View file

@ -41,6 +41,7 @@ spec:
- "--trust-remote-code" - "--trust-remote-code"
- "--gpu-memory-utilization" - "--gpu-memory-utilization"
- "0.95" - "0.95"
- "--enforce-eager"
ports: ports:
- containerPort: 8000 - containerPort: 8000
resources: resources: