Hermes Voice Gateway

From its catalog listing

Answers Twilio phone calls with Hermes: caller speech is transcribed and Hermes' replies are spoken with ElevenLabs over a Pipecat pipeline. Callers get only two restricted tools (inventory search, enquiry save). Operator-approved callbacks are proposed by the agent and dialed only after a human runs /voice-callback approve.

Good to know before installing

runs a call server on 127.0.0.1:8081 (VOICE_WEBHOOK_HOST / VOICE_WEBHOOK_PORT) that a tunnel or reverse proxy must expose to Twilio; Twilio webhooks are signature-checked and callers must be on VOICE_ALLOWED_USERS, but caller ID can be spoofed, so treat the allowlist as a filter, not authentication. Install it in a dedicated voice profile: callers talk to a normal Hermes agent that can see that profile's persona, project context and voice instructions, and calls are refused unless that profile's memory and user profile are off and no memory provider is set. Call audio goes to ElevenLabs (speech-to-text and text-to-speech) and call metadata and callbacks go to the Twilio REST API; the optional local dev pipeline also uses OpenAI. Caller enquiries are stored as plaintext in the plugin's own SQLite file under HERMES_HOME.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs (this one needs TWILIO_ACCOUNT_SID, TWILIO_AUTH_TOKEN, ELEVENLABS_API_KEY, VOICE_WEBHOOK_URL), then asks whether to turn it on.
    hermes plugins install hermes-voice-gateway
  2. Said no? Turn it on later:
    hermes plugins enable hermes-voice-gateway
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Chat apps & voice · Web, research & browsing
Maintained by
SRai22 (Community)
Needs
TWILIO_ACCOUNT_SID TWILIO_AUTH_TOKEN ELEVENLABS_API_KEY VOICE_WEBHOOK_URL API keys
Adds tools
voice_propose_callback voice_check_call_status voice_start_local_pipeline voice_search_inventory voice_save_enquiry
Adds hooks
pre_tool_call
Needs Hermes
0.23.2 or newer
Version
0.2.0
In the catalog
2026-11-17

Known issues (from its catalog listing)

  • Requires pipecat-ai 1.7.0 exactly (pinned) and uvicorn; the Hermes runtime must be able to install them.
  • Twilio WebSocket calls have basic call control only: no transfers or reconnects. Voicemail is not detected, and full barge-in is unverified.
  • Twilio call-status callbacks are not wired in, so a stored callback status stays answered after the call ends; use voice_check_call_status for live state.
  • Caller ID is unverified. Anyone Hermes lets run slash commands can approve callbacks, so restrict command access to your operators.
  • In-process gateway platform only; the caller-tool policy uses some non-public Hermes internals and must be re-verified on Hermes upgrades. The Hermes profile's Voice tool selection must be set to voice_caller only (see the README), otherwise calls fail closed.
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in chat apps & voice

All chat apps & voice plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins