Skilluminati

From its catalog listing
Your skills, judged blind: finds out whether each skill your Hermes agent loads makes its answers better. /skilluminati <skill> takes the latest 12 times you used the skill, each with the chat as it stood at that moment, and your model answers each one twice, once with the skill and once without. The Owl, a blind judge, sees both answers and the skill's one-line description of its job, never which answer had the skill, and sees every pair twice with the answers swapped; if it picks differently the second time, the pair counts as Same. Verdicts: Enlightened (answers are clearly better with it), Dead weight (the model does this anyway, it only costs tokens), Hindrance (answers are worse with it) or Unproven (too few uses to tell yet), each marked Probable or Plausible. Built-in question sets for frontend-design, systematic-debugging and hermes-agent let a fresh install run a test with no history, and /skilluminati selftest plants a helpful, a harmful and an empty skill to prove the Owl can tell them apart. Surfaces: the /skilluminati command, two read-only agent tools, a Desktop page with a sidebar entry (plugin SDK only) and a read-only dashboard backend.
Good to know before installing
opens HERMES_HOME/state.db read-only and reads installed skill files, skills/.usage.json and skills.disabled/model.default from config.yaml; for each test it sends up to 12 past tasks (the stored session system prompt, the chat up to the moment the skill loaded and any tool output in it, after best-effort regex blanking of emails, phone numbers, key-shaped strings, token-carrying URLs, money amounts and names in plugin-data/skilluminati/names.txt) plus the skill text to the active provider and model, or a per-role provider/model you configure, through ctx.llm, at up to 64 model calls per skill on your own allowance; runs start only from a local CLI/TUI/Desktop/ACP session (never cron or a messaging gateway) on a background thread; writes only under HERMES_HOME/plugin-data/skilluminati/; imports one private core helper (agent.skill_utils.get_all_skills_dirs) to list skill folders; no other network calls, no shell commands, no stored credentials.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install skilluminati - Said no? Turn it on later:
hermes plugins enable skilluminati - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Coding & developer tools
- Maintained by
- yxssxn (Community)
- Needs
- No API keys declared
- Adds tools
skilluminati_estimateskilluminati_result- Needs Hermes
- 0.23.0 or newer
- Version
- 0.1.0
- In the catalog
- 2026-11-12
Known issues (from its catalog listing)
- Each test is one fresh answer per task from the moment the skill loaded. Tools are not run again, so skills that mostly drive tools are judged on the answer text only.
- The replay puts the skill into the chat directly, so it does not test whether your agent would have chosen to load it.
- If the judge is the same model family as the one under test, it may favour answers like its own. The result names the model.
- Every test spends your own provider allowance: up to 64 model calls for one skill. The frontend-design built-in set takes about an hour because every answer is a whole web page.
- The Desktop page appears only after Capabilities -> Plugins -> Skilluminati is switched on in Hermes Desktop.
- Lists skill folders through agent.skill_utils.get_all_skills_dirs, a private core helper (validator rule 9 warning); a future Hermes release may move it.
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in coding & developer tools
All coding & developer tools plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher