Commit graph

23 commits

Author SHA1 Message Date
sirius0xdev
9f5d1fb723 clean up and add routes to paas site 2026-04-28 03:31:52 +00:00
sirius0xdev
b8bf9dd242 fix deployment error 2026-04-25 23:38:36 +00:00
sirius0xdev
b4ffa0c238 add wellness probes to vllm and activate keda 2026-04-25 23:23:48 +00:00
sirius0xdev
ae5e4b5515
Update a100-vllm.yaml 2026-04-24 22:54:14 -04:00
sirius0xdev
5d108035db
Update a100-vllm.yaml 2026-04-22 23:56:27 -04:00
sirius0xdev
7041708969
Merge pull request #52 from sirius0xdev/optimize-prompt-context-2026-04-22
Optimize prompt context 2026 04 22
2026-04-22 09:58:47 -04:00
Sirius Claw
3133a3b32f fix(vllm): update to recommended qwen3_coder tool parser, auto max-model-len, and latest image
Addresses tokenizer backend / parser mismatch on heretic-style Qwen3.5 models per model card recommendations.
2026-04-22 06:32:35 +00:00
sirius0xdev
f435fdaf18 new image 2026-04-22 06:24:17 +00:00
sirius0xdev
c7f0fc7262 fix error 2026-04-22 06:12:32 +00:00
sirius0xdev
c420d2478c tokenizer mode 2026-04-22 06:09:45 +00:00
sirius0xdev
93caf2d086 image error 2026-04-22 06:01:11 +00:00
sirius0xdev
7864a7f84e vllm version error 2026-04-22 05:57:45 +00:00
sirius0xdev
34fe64c74b model switch again 2026-04-22 05:41:00 +00:00
sirius0xdev
01a82a74f3 fix typo 2026-04-22 03:40:16 +00:00
sirius0xdev
795e48b9d6 pvc name change 2026-04-22 03:36:55 +00:00
sirius0xdev
1d13cce3cf switch model 2026-04-22 03:15:29 +00:00
sirius0xdev
1466d38721 fix tokenizer mode 2026-04-22 03:12:58 +00:00
sirius0xdev
d6c50d72ee fix tokenizer mode 2026-04-22 03:06:16 +00:00
sirius0xdev
6c4bb798ff switch image 2026-04-22 03:00:46 +00:00
sirius0xdev
c236f3c89a try and get vllm to work new tags 2026-04-22 02:47:53 +00:00
sirius0xdev
a307e3ae37 fix cuda issue with new image 2026-04-22 02:27:38 +00:00
sirius0xdev
ed096b7cd8 fix vllm image error 2026-04-22 02:07:46 +00:00
sirius0xdev
73c89e361d reacticate a100 2026-04-22 01:53:36 +00:00
Renamed from a100-vllm.yaml (Browse further)