Lemma — Audit What Agents Read

From its catalog listing

An AI-scientist plugin that audits what your agent reads. Paste or mention a paper link and the ambient pre-LLM hook offers an audit unprompted; six tools (quick_audit, audit, doctor, status, judge, improve) extract testable claims, generate and run honest audit scripts behind a mandatory positive control, and render verdicts — supported, falsified, inconclusive — over an append-only evidence trail. The Desktop Audit Room pane shows live runs (stage, attempts, trace tail) and self-distrust flags (verify_gain) when a post-feedback flip to supported needs eyeballing. Everything stays local under plugin_data_dir.

Good to know before installing

paper text and audit prompts go to your configured LLM provider (Anthropic, or any OpenAI-compatible endpoint you set via OPENAI_BASE_URL); papers are fetched from arxiv.org, export.arxiv.org and openreview.net; LLM-written audit scripts run inside a sandbox (bubblewrap on Linux, sandbox-exec on macOS: no network, workdir-only writes, minimal env) and are refused where no sandbox exists unless you turn on the plugin's `host_exec` setting, which runs them on the host without isolation; `lemma_audit` and `lemma_improve` run as detached background processes; a pre-LLM hook adds an "offer an audit" hint when a paper link appears in the conversation; all artifacts stay under the plugin data directory.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs (this one needs ANTHROPIC_API_KEY), then asks whether to turn it on.
    hermes plugins install lemma
  2. Said no? Turn it on later:
    hermes plugins enable lemma
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Coding & developer tools
Maintained by
udirobert (Community)
Needs
ANTHROPIC_API_KEY API key
Adds tools
lemma_quick_audit lemma_audit lemma_doctor lemma_status lemma_judge lemma_improve
Adds hooks
pre_llm_call
Version
0.3.0
In the catalog
2026-11-10
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in coding & developer tools

All coding & developer tools plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins