VAIL Agent Assurance
From its catalog listing
Find, test and fix risky behaviors in your AI agents with the VAIL Agent Assurance Engine: upload an agent's source to scan it for behavior risks and generate probes, then run those probes against the agent locally, graded as VAIL grades them, fix what fails and rerun to prove the fix. Works on LangGraph, Hermes and OpenClaw agents, including your own Hermes profiles. Portable Agent Plugins v1 package (mcp.json + skills/): the hosted VAIL MCP server plus the agent-assurance and agent-improvement skills. Needs a VAIL account and a personal access token, set as VAIL_TOKEN (the plugin's secret setting, kept in the profile's .env).
Good to know before installing
every call goes to agents.projectvail.com with your VAIL token; scanning uploads the agent source you choose to VAIL, which stores it as that agent's source (replacing the previous upload); the agent-improvement skill downloads VAIL's grading package (a version VAIL's server chooses at run time, sha256-checked against that server's own value), installs it into a local virtual environment, runs it, and sends test messages to the agent you name. No telemetry.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install vail-agent-assurance - Said no? Turn it on later:
hermes plugins enable vail-agent-assurance - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Security & privacy
- Maintained by
- projectvail (Community)
- Needs
- No API keys declared
- Needs Hermes
- 0.23.0 or newer
- Version
- 0.4.0
- In the catalog
- 2026-11-10
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in security & privacy
All security & privacy plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher