Understudy

From its catalog listing
Audition cheaper models on your real Hermes history before you switch. Understudy replays a sample of your past decisions (replies and tool calls) on candidate models through Hermes's own credentials, has a blind judge compare each step with what your current model actually did, and reports how often each candidate could have taken over (with a 95% confidence interval), its critical misses, a per-category breakdown and projected monthly cost. Two tools, /understudy, hermes understudy, and a Desktop page with an inline scorecard.
Good to know before installing
reads this profile's session history read-only; sends redacted excerpts of past conversations (plus, by default, an excerpt of the agent's system prompt; `include_persona: false` stops it) to the candidate models and the judge model you pick, through ctx.llm on your existing provider credentials; each audition is capped by budget_usd only when Hermes reports the call cost (unpriced models are bounded by the sample size, not the budget); the agent tool spends without its own confirmation prompt (the bundled skill tells the model to dry-run and ask first; /understudy asks unless --yes); reads Hermes's local models.dev cache (active profile, then the default root) for list prices; writes run records and reports under plugin-data/understudy; runs a background worker thread only while an audition runs; requests the llm.model_override and llm.provider_override capabilities; no telemetry, no other network calls.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install understudy - Said no? Turn it on later:
hermes plugins enable understudy - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Security & privacy · AI models & providers
- Maintained by
- stffinfcti (Community)
- Needs
- No API keys declared
- Adds tools
understudy_auditionunderstudy_report- Needs Hermes
- 0.22.6 or newer
- Version
- 1.0.0
- In the catalog
- 2026-11-05
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in security & privacy
All security & privacy plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher