Hermes Agent
|
1df06eed96
|
feat: add Kong AI plugins and Cilium Local Redirect Policy
- CiliumLocalRedirectPolicy: Zero-latency Kong → vLLM on GPU nodes
- KongPlugin bundle: ai-rate-limiting (TPM), ai-prompt-guard, ai-semantic-cache, ai-failover
- Flux-integrated via kustomization.yaml
- Attach plugins to Kong routes post-deploy
Refs: LLM gateway.md optimizations.
|
2026-04-27 03:24:59 +00:00 |
|