Lemma — Audit What Agents Read
From its catalog listing
An AI-scientist plugin that audits what your agent reads. Paste or mention a paper link and the ambient pre-LLM hook offers an audit unprompted; six tools (quick_audit, audit, doctor, status, judge, improve) extract testable claims, generate and run honest audit scripts behind a mandatory positive control, and render verdicts — supported, falsified, inconclusive — over an append-only evidence trail. The Desktop Audit Room pane shows live runs (stage, attempts, trace tail) and self-distrust flags (verify_gain) when a post-feedback flip to supported needs eyeballing. Everything stays local under plugin_data_dir.
Good to know before installing
paper text and audit prompts go to your configured LLM provider (Anthropic, or any OpenAI-compatible endpoint you set via OPENAI_BASE_URL); papers are fetched from arxiv.org, export.arxiv.org and openreview.net; LLM-written audit scripts run inside a sandbox (bubblewrap on Linux, sandbox-exec on macOS: no network, workdir-only writes, minimal env) and are refused where no sandbox exists unless you turn on the plugin's `host_exec` setting, which runs them on the host without isolation; `lemma_audit` and `lemma_improve` run as detached background processes; a pre-LLM hook adds an "offer an audit" hint when a paper link appears in the conversation; all artifacts stay under the plugin data directory.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs (this one needs
ANTHROPIC_API_KEY), then asks whether to turn it on.hermes plugins install lemma - Said no? Turn it on later:
hermes plugins enable lemma - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Coding & developer tools
- Maintained by
- udirobert (Community)
- Needs
ANTHROPIC_API_KEYAPI key- Adds tools
lemma_quick_auditlemma_auditlemma_doctorlemma_statuslemma_judgelemma_improve- Adds hooks
pre_llm_call- Version
- 0.3.0
- In the catalog
- 2026-11-10
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in coding & developer tools
All coding & developer tools plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher