feat(hermes-config): add clean 'vllm' provider for the existing rtx6000-brain-service
- Primary 'vllm' entry for easy /model vllm usage - Uses model from the rtx6000 deployment - Kept existing qwen-vllm, rtx6000-vllm, and rtx6000-brain for compatibility
This commit is contained in:
parent
58451ccca5
commit
6989b18f37
1 changed files with 6 additions and 0 deletions
|
|
@ -316,6 +316,12 @@ data:
|
|||
idle_minutes: 1440
|
||||
at_hour: 4
|
||||
models:
|
||||
vllm:
|
||||
provider: openai
|
||||
base_url: http://rtx6000-brain-service.customer1.svc.cluster.local:8000/v1
|
||||
model: Youssofal/Qwen3.6-27B-Abliterated-Heretic-Uncensored-BF16
|
||||
api_key: EMPTY
|
||||
context_length: 131072
|
||||
qwen-vllm:
|
||||
provider: openai
|
||||
base_url: http://openclaw-brain-service:8000/v1
|
||||
|
|
|
|||
Loading…
Add table
Reference in a new issue