Skilluminati

From its catalog listing

Your skills, judged blind: finds out whether each skill your Hermes agent loads makes its answers better. /skilluminati <skill> takes the latest 12 times you used the skill, each with the chat as it stood at that moment, and your model answers each one twice, once with the skill and once without. The Owl, a blind judge, sees both answers and the skill's one-line description of its job, never which answer had the skill, and sees every pair twice with the answers swapped; if it picks differently the second time, the pair counts as Same. Verdicts: Enlightened (answers are clearly better with it), Dead weight (the model does this anyway, it only costs tokens), Hindrance (answers are worse with it) or Unproven (too few uses to tell yet), each marked Probable or Plausible. Built-in question sets for frontend-design, systematic-debugging and hermes-agent let a fresh install run a test with no history, and /skilluminati selftest plants a helpful, a harmful and an empty skill to prove the Owl can tell them apart. Surfaces: the /skilluminati command, two read-only agent tools, a Desktop page with a sidebar entry (plugin SDK only) and a read-only dashboard backend.

Good to know before installing

opens HERMES_HOME/state.db read-only and reads installed skill files, skills/.usage.json and skills.disabled/model.default from config.yaml; for each test it sends up to 12 past tasks (the stored session system prompt, the chat up to the moment the skill loaded and any tool output in it, after best-effort regex blanking of emails, phone numbers, key-shaped strings, token-carrying URLs, money amounts and names in plugin-data/skilluminati/names.txt) plus the skill text to the active provider and model, or a per-role provider/model you configure, through ctx.llm, at up to 64 model calls per skill on your own allowance; runs start only from a local CLI/TUI/Desktop/ACP session (never cron or a messaging gateway) on a background thread; writes only under HERMES_HOME/plugin-data/skilluminati/; imports one private core helper (agent.skill_utils.get_all_skills_dirs) to list skill folders; no other network calls, no shell commands, no stored credentials.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install skilluminati
  2. Said no? Turn it on later:
    hermes plugins enable skilluminati
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Coding & developer tools
Maintained by
yxssxn (Community)
Needs
No API keys declared
Adds tools
skilluminati_estimate skilluminati_result
Needs Hermes
0.23.0 or newer
Version
0.1.0
In the catalog
2026-11-12

Known issues (from its catalog listing)

  • Each test is one fresh answer per task from the moment the skill loaded. Tools are not run again, so skills that mostly drive tools are judged on the answer text only.
  • The replay puts the skill into the chat directly, so it does not test whether your agent would have chosen to load it.
  • If the judge is the same model family as the one under test, it may favour answers like its own. The result names the model.
  • Every test spends your own provider allowance: up to 64 model calls for one skill. The frontend-design built-in set takes about an hour because every answer is a whole web page.
  • The Desktop page appears only after Capabilities -> Plugins -> Skilluminati is switched on in Hermes Desktop.
  • Lists skill folders through agent.skill_utils.get_all_skills_dirs, a private core helper (validator rule 9 warning); a future Hermes release may move it.
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in coding & developer tools

All coding & developer tools plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins