Hermes Regress

From its catalog listing

Regression tests built from your own sessions. Capture is passive: every finished turn is written as a plain JSON case holding the prompt, the model, each tool call with its exact arguments and the output it returned. Replay a case through the real agent loop with every tool call vetoed at pre_tool_call and answered from the recording, so a model, provider or config change can be measured without side effects — /regress run --model X reports pass, drift, regressed and error per case, with markdown, JUnit XML and a hash-chained export bundle for CI. Fixtures match only on identical tool and arguments; a case whose tool plan cannot be reproduced is reported as a gap instead of being answered from the wrong recording, and a replay window that never reaches the hook is marked error and stops the run rather than executing live tools.

Good to know before installing

writes captured cases under HERMES_HOME/plugin-data/hermes-regress/ (mode 0600) with the prompt, answer, tool arguments and tool results all passed through redaction first (provider keys, GitHub/Slack/AWS tokens, JWTs and inline password/token values become [REDACTED], counts recorded per case); keeps replay state in the same directory (armed.json plus an audit line per armed tool call in hook.log), scopes the replay veto to the single session that claims the armed case (only a first turn whose message exactly matches the recorded prompt can claim it, recorded from pre_llm_call), keeps that scope through a mid-turn context compression by matching the claimed task id as well as the session id, and serialises claims with a file lock, so an unclaimed window serves and blocks nobody, a late claim cannot revive a disarmed window, and other chats and cron runs are never affected, and runs the local hermes CLI as a subprocess when you ask for a replay; no network calls of its own, no telemetry.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install hermes-regress
  2. Said no? Turn it on later:
    hermes plugins enable hermes-regress
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
AI models & providers · Automation & multi-agent
Maintained by
harishkotra (Community)
Needs
No API keys declared
Adds hooks
pre_llm_call pre_tool_call post_tool_call post_llm_call on_session_end
Needs Hermes
0.22.0 or newer
Version
0.1.0
In the catalog
2026-11-17
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in ai models & providers

All ai models & providers plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins