Kfchow Llm Value Router
Per-turn LLM routing: on each matching turn a TypeSafe Jev classifier call (api.typesafe.ai) receives turn-shape features plus the first 1200 chars of the last user message (shadow mode included) and labels it free/paid; high-confidence routine turns are downgraded to the provider's configured free rung, strategic mid-rung turns on Nous are escalated to the configured premium rung after a 2-token billed credit probe (Nous only, fail-closed). Fail-open, shadow-by-default, per-provider rungs from the user's lane2_config.json (leaderboard resolver script optional). Probe model id is fixed in code (z-ai/glm-5.3-flash).
Good to know before installing
Once you list models in ~/.hermes/jev/lane2_config.json, the first call of each matching turn sends message/tool counts and the first 1,200 characters of the last user message (send_excerpt, on by default) to TypeSafe Jev at api.typesafe.ai with your JEVI_API_KEY, in shadow mode as well as live; in live mode Jev's answer switches the request (and every later call of that turn, via an llm_execution wrapper) to the free, flash or premium model you configured on the same provider; with escalation set up on Nous it sends a 2-token billed ping to the Nous inference API with NOUS_API_KEY at most every 5 minutes; every turn appends a decision row (with that excerpt on routed turns) to ~/.hermes/jev/lane2-live.jsonl, which is never rotated.
From the plugin's catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install kfchow-llm-value-router - Said no? Turn it on later:
hermes plugins enable kfchow-llm-value-router - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Cost, speed & monitoring · AI models & providers
- Maintained by
- KFChow (Community)
- Needs
- No API keys declared
- Works on
- linux, macos
- Needs Hermes
- 0.21.5 or newer
- Version
- 1.0.6
- In the catalog
- 2026-10-08
- GitHub stars
- 2
Full setup & settings ↗Source code ↗
More in cost, speed & monitoring
All cost, speed & monitoring plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher