feat: Switch L4 deployment to Qwen2.5-Coder-7B-Instruct-heretic
This commit is contained in:
parent
7a0d33f042
commit
8041f71063
1 changed files with 1 additions and 1 deletions
|
|
@ -29,7 +29,7 @@ spec:
|
|||
- name: HF_TOKEN
|
||||
value: ""
|
||||
args:
|
||||
- --model=Qwen/Qwen2.5-Coder-7B-Instruct
|
||||
- --model=trohrbaugh/Qwen2.5-Coder-7B-Instruct-heretic
|
||||
- --host=0.0.0.0
|
||||
- --port=8000
|
||||
- --tensor-parallel-size=1
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue