Shadow

From its catalog listing
Find out which model is better at your work, from your real prompts. After a plain chat turn, the same conversation goes in the background to a second model you choose, through ctx.llm. /shadow vote shows both answers blind in random order; models are revealed after you vote, and your leaderboard shows wins with a 95% range. Off until you set compare_model and allow the override; tool turns are skipped and answers are deleted after each vote.
Good to know before installing
when enabled (compare_model set and llm.allow_model_override on), the last 12 plain-text messages of every eligible chat turn are also sent to the second model/provider you configured, costing one extra model call per compared turn; up to 100 unvoted prompt/answer pairs are kept in plugin-data/shadow until you vote, and each chat can only see the pairs it captured.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install shadow - Said no? Turn it on later:
hermes plugins enable shadow - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- AI models & providers
- Maintained by
- salch-cred (Community)
- Needs
- No API keys declared
- Adds hooks
post_llm_call- Needs Hermes
- 0.23.0 or newer
- Version
- 0.1.1
- In the catalog
- 2026-11-11
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in ai models & providers
All ai models & providers plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher