Model Leaderboard

Good to know before installing

Outbound HTTPS to OpenRouter's public model API (catalogue and pricing) on a 60 s poll and a forced refresh every 10 minutes while the page is visible, and to Hugging Face's public model API (safetensors metadata, for parameter counts) on demand and cached; reads the installed Hermes profiles' own config.yaml files once, to seed the tracked list from the models those profiles declare; keeps its state in <hermes home>/plugin-data/model-leaderboard/ (seeded from the JSON shipped with the plugin), which LLM_DASH_DATA / LLM_DASH_CACHE_TTL can move or tune; the optional "Auto-fill criteria" action runs on the host LLM facade (ctx.llm.complete_structured), so it spends the user's configured model tokens; ships one read-only skill (model-leaderboard:refresh-benchmarks) whose only write is a POST to its own /benchmarks route; no API keys of its own, no writes outside its data directory.

From the plugin's catalog listing.