Local Fleet

From its catalog listing

Your local inference fleet, operated from Hermes Desktop: routing across your own boxes (DGX Spark / GB10, Ollama, vLLM, LiteLLM, clusters behind one endpoint). Probes each box, makes the least busy healthy one the primary model, falls back to smaller models on smaller boxes, then to your cloud model, and switches back when a box recovers. Why-this-box inspector, flight recorder, outage rehearsal, drift detection, readiness, savings with its working, doctor. Optional: subagents across boxes (delegation backend fleet), side tasks on the fleet (auxiliary.<task>), keep the routed model loaded, private inference (primary, fallback chain, side tasks and subagents held to your boxes, failing rather than using cloud; not air-gapping). Writes model.*, fallback_providers, and on request delegation.backend and auxiliary.<task>; private on removes non-local fallback entries and puts them back on off; hermes fleet restore puts the primary back. Network: HTTP only to the boxes you register. Observer hooks record per-call endpoint, model, tokens and duration (never content) in its data dir. Never moves a primary that holds an inline API key and never copies a key into its data. Read-only tools plus a model pull from the Ollama library that Hermes asks you to approve; no remote command execution.

Good to know before installing

Once you opt in, Local Fleet rewrites `model.*` and `fallback_providers` in your config.yaml (and, on request, `delegation.backend` and `auxiliary.<task>`) to route Hermes to your own inference boxes; it sends HTTP only to the boxes you register, records per-call endpoint, model, tokens and duration (never content) in its data dir, and asks for approval before every model pull.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install local-fleet
  2. Said no? Turn it on later:
    hermes plugins enable local-fleet
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
AI models & providers
Maintained by
humedini (Community)
Needs
No API keys declared
Adds tools
fleet_status fleet_list_nodes fleet_pull_model
Adds hooks
on_session_start pre_tool_call post_api_request api_request_error post_auxiliary_call
Needs Hermes
0.22 or newer
Version
0.3.2
In the catalog
2026-11-11
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in ai models & providers

All ai models & providers plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins