Crash Lab
From its catalog listing
Fault-injection and recovery testing for AI agents. Crash Lab manufactures the failure modes that break real agent workflows — a write that succeeds while the API reports a timeout, a malformed response, transient 503s — behind four registered tools (crash_start, crash_book, crash_inspect, crash_report), wrapping a deterministic, fictional booking service. An independent state oracle reads the persisted service state — verified by deterministic replay, so damaged or edited state is never certified — and returns PASS/FAIL/UNVERIFIED. PASS means the booking-state safety condition holds (exactly one booking, no duplicates); it does not prove the agent reasoned correctly or followed an optimal recovery procedure. Retry diagnostics (call_count, allowed_calls, reconciled, excessive_retries) are reported separately and never affect the verdict. Fully offline: the booking service is fictional — no network calls, no real bookings, payments or customer accounts; no telemetry, background services or stored credentials. Zero Python dependencies; writes JSON run files only in its own plugin-data directory. Concurrency: per-run exclusive write lock (kernel flock on POSIX; owner-release lock file elsewhere, no automatic stale-break). Integrity checking is replay-based consistency verification, not authenticated tamper-proof storage. Tested on Linux (WSL2); Windows/macOS unverified. Scenarios are fixed code constants, not a general fuzzer.
Good to know before installing
verdicts certify simulated service state only, not the agent's reasoning; integrity checking is replay-based consistency, not tamper-proof storage; scenarios are fixed code constants, not a general fuzzer.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install crash-lab - Said no? Turn it on later:
hermes plugins enable crash-lab - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Security & privacy
- Maintained by
- 8JBern (Community)
- Needs
- No API keys declared
- Adds tools
crash_startcrash_bookcrash_inspectcrash_report- Works on
- linux, macos, windows
- Needs Hermes
- 0.22.5 or newer
- Version
- 1.0.2
- In the catalog
- 2026-11-10
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in security & privacy
All security & privacy plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher