Merge pull request #18 from sirius0xdev/fix/vllm-trust-remote-code-tokenizer
fix: revert tokenizer mode to auto
This commit is contained in:
commit
73a4ee6408
1 changed files with 1 additions and 1 deletions
|
|
@ -32,7 +32,7 @@ spec:
|
|||
- name: HF_TOKEN
|
||||
value: ""
|
||||
- name: VLLM_TOKENIZER_MODE
|
||||
value: "mistral"
|
||||
value: "auto"
|
||||
args:
|
||||
- "--model"
|
||||
- "dphn/Dolphin-Mistral-24B-Venice-Edition" # Uncensored 24B (Native)
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue