ProveIt Tests

From its catalog listing

Flags recognizable ways an agent weakens tests to reach green: removed or loosened asserts, skip/xfail/.only, deleted tests, expected literals rewritten to match failing output, assert True and tautologies, try/except pass wrappers, and test-runner escape hatches (pytest || true, -k "not ...", --deselect, --passWithNoTests, CI continue-on-error), and pytest config / conftest.py narrowing (addopts -k/-m/--deselect/--ignore, testpaths, collect_ignore, deselecting hooks). Net-new only: each edit is compared with the file as it was before, so pre-existing skips are not blamed on the edit. Deterministic AST + regex, no model calls. Modes: observe (default), escalate to the human-approval gate, or block on unattended/cron runs. SHA-256 receipts and a /proveit ledger. Python-strong; JS/TS coverage is heuristic and limited.

Good to know before installing

no network calls and no model calls. Reads edited test, CI, pytest-config and conftest.py files and tool arguments to compare before/after; appends warnings into tool results; may escalate or block tool calls when configured. Ledger is written only under the Hermes plugin data dir (in-memory if none); terminal findings keep a short, secret-redacted command excerpt locally. Not a sandbox and not unbypassable: an agent can still rewrite via shell, disable the plugin, or invent new weakenings. No findings is not proof that tests were preserved.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install proveit-tests
  2. Said no? Turn it on later:
    hermes plugins enable proveit-tests
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Coding & developer tools
Maintained by
KellerAI (Community)
Needs
No API keys declared
Adds hooks
pre_tool_call post_tool_call transform_tool_result pre_verify on_session_start on_session_end
Needs Hermes
0.22.7 or newer
Version
0.1.0
In the catalog
2026-11-12
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in coding & developer tools

All coding & developer tools plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins