ProveIt Tests
From its catalog listing
Flags recognizable ways an agent weakens tests to reach green: removed or loosened asserts, skip/xfail/.only, deleted tests, expected literals rewritten to match failing output, assert True and tautologies, try/except pass wrappers, and test-runner escape hatches (pytest || true, -k "not ...", --deselect, --passWithNoTests, CI continue-on-error), and pytest config / conftest.py narrowing (addopts -k/-m/--deselect/--ignore, testpaths, collect_ignore, deselecting hooks). Net-new only: each edit is compared with the file as it was before, so pre-existing skips are not blamed on the edit. Deterministic AST + regex, no model calls. Modes: observe (default), escalate to the human-approval gate, or block on unattended/cron runs. SHA-256 receipts and a /proveit ledger. Python-strong; JS/TS coverage is heuristic and limited.
Good to know before installing
no network calls and no model calls. Reads edited test, CI, pytest-config and conftest.py files and tool arguments to compare before/after; appends warnings into tool results; may escalate or block tool calls when configured. Ledger is written only under the Hermes plugin data dir (in-memory if none); terminal findings keep a short, secret-redacted command excerpt locally. Not a sandbox and not unbypassable: an agent can still rewrite via shell, disable the plugin, or invent new weakenings. No findings is not proof that tests were preserved.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install proveit-tests - Said no? Turn it on later:
hermes plugins enable proveit-tests - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Coding & developer tools
- Maintained by
- KellerAI (Community)
- Needs
- No API keys declared
- Adds hooks
pre_tool_callpost_tool_calltransform_tool_resultpre_verifyon_session_starton_session_end- Needs Hermes
- 0.22.7 or newer
- Version
- 0.1.0
- In the catalog
- 2026-11-12
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in coding & developer tools
All coding & developer tools plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher