Token Rate Monitor

Live output/input tokens-per-second chip in the Hermes Desktop status bar for a local llama.cpp server. Hermes itself reads the server's log ($HERMES_HOME/logs/llama-server.log, last 200 lines: `tg = X t/s` for output and `prompt eval time ... X tokens per second` for input) and serves it at /api/plugins/token-rate/; the chip polls that route once a second. The counter starts off — click the chip, or run the palette entry "Token Rate: start/stop the tok/s counter" (Ctrl/Cmd+K), to start it; the on/off flag is a file ($HERMES_HOME/cache/token-rate-state.json). It also registers the get_token_rate agent tool, so the model can read its own speed.

Good to know before installing

It reads one local file (the llama.cpp log) and nothing else: no network calls, no external process, no extra port, no API key, no credentials, no telemetry. UI is English by default, Italian when the app locale is Italian.

From the plugin's catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install token-rate
  2. Said no? Turn it on later:
    hermes plugins enable token-rate
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Hermes Desktop add-ons · Cost, speed & monitoring
Maintained by
Lazzdaycod (Community)
Needs
No API keys declared
Needs Hermes
0.21.6 or newer
Version
2.0.0
In the catalog
2026-10-30

Full setup & settings ↗Source code ↗

More in hermes desktop add-ons

All hermes desktop add-ons plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins