Shadow

From its catalog listing

Find out which model is better at your work, from your real prompts. After a plain chat turn, the same conversation goes in the background to a second model you choose, through ctx.llm. /shadow vote shows both answers blind in random order; models are revealed after you vote, and your leaderboard shows wins with a 95% range. Off until you set compare_model and allow the override; tool turns are skipped and answers are deleted after each vote.

Good to know before installing

when enabled (compare_model set and llm.allow_model_override on), the last 12 plain-text messages of every eligible chat turn are also sent to the second model/provider you configured, costing one extra model call per compared turn; up to 100 unvoted prompt/answer pairs are kept in plugin-data/shadow until you vote, and each chat can only see the pairs it captured.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install shadow
  2. Said no? Turn it on later:
    hermes plugins enable shadow
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
AI models & providers
Maintained by
salch-cred (Community)
Needs
No API keys declared
Adds hooks
post_llm_call
Needs Hermes
0.23.0 or newer
Version
0.1.1
In the catalog
2026-11-11
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in ai models & providers

All ai models & providers plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins