Hermes Regress
From its catalog listing
Regression tests built from your own sessions. Capture is passive: every finished turn is written as a plain JSON case holding the prompt, the model, each tool call with its exact arguments and the output it returned. Replay a case through the real agent loop with every tool call vetoed at pre_tool_call and answered from the recording, so a model, provider or config change can be measured without side effects — /regress run --model X reports pass, drift, regressed and error per case, with markdown, JUnit XML and a hash-chained export bundle for CI. Fixtures match only on identical tool and arguments; a case whose tool plan cannot be reproduced is reported as a gap instead of being answered from the wrong recording, and a replay window that never reaches the hook is marked error and stops the run rather than executing live tools.
Good to know before installing
writes captured cases under HERMES_HOME/plugin-data/hermes-regress/ (mode 0600) with the prompt, answer, tool arguments and tool results all passed through redaction first (provider keys, GitHub/Slack/AWS tokens, JWTs and inline password/token values become [REDACTED], counts recorded per case); keeps replay state in the same directory (armed.json plus an audit line per armed tool call in hook.log), scopes the replay veto to the single session that claims the armed case (only a first turn whose message exactly matches the recorded prompt can claim it, recorded from pre_llm_call), keeps that scope through a mid-turn context compression by matching the claimed task id as well as the session id, and serialises claims with a file lock, so an unclaimed window serves and blocks nobody, a late claim cannot revive a disarmed window, and other chats and cron runs are never affected, and runs the local hermes CLI as a subprocess when you ask for a replay; no network calls of its own, no telemetry.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install hermes-regress - Said no? Turn it on later:
hermes plugins enable hermes-regress - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- AI models & providers · Automation & multi-agent
- Maintained by
- harishkotra (Community)
- Needs
- No API keys declared
- Adds hooks
pre_llm_callpre_tool_callpost_tool_callpost_llm_callon_session_end- Needs Hermes
- 0.22.0 or newer
- Version
- 0.1.0
- In the catalog
- 2026-11-17
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in ai models & providers
All ai models & providers plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher