feat(hermes-config): add clean 'vllm' provider for the existing rtx6000-brain-service
- Primary 'vllm' entry for easy /model vllm usage - Uses model from the rtx6000 deployment - Kept existing qwen-vllm, rtx6000-vllm, and rtx6000-brain for compatibility
This commit is contained in:
parent
58451ccca5
commit
6989b18f37
1 changed files with 6 additions and 0 deletions
|
|
@ -316,6 +316,12 @@ data:
|
||||||
idle_minutes: 1440
|
idle_minutes: 1440
|
||||||
at_hour: 4
|
at_hour: 4
|
||||||
models:
|
models:
|
||||||
|
vllm:
|
||||||
|
provider: openai
|
||||||
|
base_url: http://rtx6000-brain-service.customer1.svc.cluster.local:8000/v1
|
||||||
|
model: Youssofal/Qwen3.6-27B-Abliterated-Heretic-Uncensored-BF16
|
||||||
|
api_key: EMPTY
|
||||||
|
context_length: 131072
|
||||||
qwen-vllm:
|
qwen-vllm:
|
||||||
provider: openai
|
provider: openai
|
||||||
base_url: http://openclaw-brain-service:8000/v1
|
base_url: http://openclaw-brain-service:8000/v1
|
||||||
|
|
|
||||||
Loading…
Add table
Reference in a new issue