Local Fleet

From its catalog listing
Your local inference fleet, operated from Hermes Desktop: routing across your own boxes (DGX Spark / GB10, Ollama, vLLM, LiteLLM, clusters behind one endpoint). Probes each box, makes the least busy healthy one the primary model, falls back to smaller models on smaller boxes, then to your cloud model, and switches back when a box recovers. Why-this-box inspector, flight recorder, outage rehearsal, drift detection, readiness, savings with its working, doctor. Optional: subagents across boxes (delegation backend fleet), side tasks on the fleet (auxiliary.<task>), keep the routed model loaded, private inference (primary, fallback chain, side tasks and subagents held to your boxes, failing rather than using cloud; not air-gapping). Writes model.*, fallback_providers, and on request delegation.backend and auxiliary.<task>; private on removes non-local fallback entries and puts them back on off; hermes fleet restore puts the primary back. Network: HTTP only to the boxes you register. Observer hooks record per-call endpoint, model, tokens and duration (never content) in its data dir. Never moves a primary that holds an inline API key and never copies a key into its data. Read-only tools plus a model pull from the Ollama library that Hermes asks you to approve; no remote command execution.
Good to know before installing
Once you opt in, Local Fleet rewrites `model.*` and `fallback_providers` in your config.yaml (and, on request, `delegation.backend` and `auxiliary.<task>`) to route Hermes to your own inference boxes; it sends HTTP only to the boxes you register, records per-call endpoint, model, tokens and duration (never content) in its data dir, and asks for approval before every model pull.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install local-fleet - Said no? Turn it on later:
hermes plugins enable local-fleet - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- AI models & providers
- Maintained by
- humedini (Community)
- Needs
- No API keys declared
- Adds tools
fleet_statusfleet_list_nodesfleet_pull_model- Adds hooks
on_session_startpre_tool_callpost_api_requestapi_request_errorpost_auxiliary_call- Needs Hermes
- 0.22 or newer
- Version
- 0.3.2
- In the catalog
- 2026-11-11
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in ai models & providers
All ai models & providers plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher