Model Kombat
From its catalog listing
Head-to-head model evaluation: scout a task or kanban card into lanes, build a deterministic fight card (Warm-up 1pt, Main Event 2pt, Championship 3pt, sudden death) at standard, hard or gauntlet intensity, fight two models on identical prompts, and score mechanically — executed code, exact counts, numeric tolerances, phrase groups, JSON leaf equality, SQLite rows — with a per-lane Elo ladder, live arcade pane, kanban badges, and a measured best-value call when strong models tie ('equal quality — X is 18x cheaper'); a local task_stats.json remembers which tasks split the two models and demotes saturated ones.
Good to know before installing
model calls: all fights go through Hermes' own LLM facade with a per-call model override you must enable (`plugins.entries.model-kombat.llm.allow_model_override`); pure fights make two model calls per task, capped by `max_fight_cost_usd` / `max_fight_tokens` and `max_fight_seconds`, which tool arguments can lower but never raise; agentic fights create kanban tasks assigned to your active profile with a per-task model override, which start worker agent sessions with that profile's tools and are not spend-capped; code execution: off by default and switchable only in plugin settings, and when enabled, model-written Python runs as your user in a resource-limited subprocess that is not a security sandbox; local files: reads optional project tasks from `.kombat/tasks.json` in the working directory and writes reports, history, ladder, exports and stats only under its plugin data dir; kanban: posts display cards on a dedicated `model-kombat` board and auto-closes its own stale cards there; no third-party network calls, no telemetry, no credential reads.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install model-kombat - Said no? Turn it on later:
hermes plugins enable model-kombat - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- AI models & providers
- Maintained by
- DarkeTech (Community)
- Needs
- No API keys declared
- Adds tools
kombat_list_taskskombat_run_fightkombat_scoutkombat_run_agentic_fightkombat_score_answerskombat_rematch_errorskombat_recommendkombat_historykombat_export- Needs Hermes
- 0.23.0 or newer
- Version
- 0.7.2
- In the catalog
- 2026-11-14
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in ai models & providers
All ai models & providers plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher