fix quantization error
This commit is contained in:
parent
956ae90794
commit
d78090b69c
1 changed files with 1 additions and 1 deletions
|
|
@ -33,7 +33,7 @@ spec:
|
|||
value: DEBUG
|
||||
args:
|
||||
- --model=tvall43/Qwen3.6-35B-A3B-heretic
|
||||
- --quantization=awq
|
||||
|
||||
- --host=0.0.0.0
|
||||
- --port=8000
|
||||
- --tensor-parallel-size=1
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue