Hermes Glasses

From its catalog listing
Your own Hermes agent on your smart glasses and other devices: it sees what you see, answers by voice, and taps you on the lens when something is due. A gateway platform that adds glasses as a channel, with short spoken-style replies to the device that asked, camera photos (requested when you ask what you are looking at, or taken by the agent with its glasses_capture_photo tool), voice in and out through Hermes's own speech settings, streamed replies for heads-up displays, approval and clarify prompts on every device (approval cards with buttons, or a spoken yes or no), and cron and heartbeat pushes to all of a user's devices, kept for offline devices across gateway restarts. Also connects Even Realities G2 glasses (an Even Hub app you pack yourself), ESP32 voice boxes running the open-source xiaozhi firmware, the Omi pendant (real-time transcript webhook) and Pebble watches (the open-source Bobby app); devices that cannot keep a socket open (an Apple Watch through a Siri Shortcut, scripts) use an HTTP route. Pair a device with `hermes glasses pair` (QR code) or try it from the terminal with `hermes glasses try`. Speaks the bridge protocol of the community hermes-glasses iOS app (v0) and a richer v1; a simulator, JavaScript and Python clients and a conformance kit are included.
Good to know before installing
opens an unencrypted listener on all interfaces (port 8765: WebSocket /voice, /xiaozhi and /bobby/<token>/query; HTTP /turn, /pending, /approval, /xiaozhi/ota/<token>, /omi/<token>/transcript and /bobby/<token>/quota) that refuses to start without a device token (use Tailscale or a TLS proxy off your home network; Omi's servers must reach the webhook over the internet); each device token, sent in a header, query or URL path, gets full agent chat as its user, bypassing the gateway allowlist, including answering approval prompts and clarify questions; `hermes glasses pair` writes device tokens to the profile .env, and the xiaozhi OTA reply gives the box its WebSocket address with its own token; with Omi, transcripts come from Omi's servers and answers go back through them; the agent can take a glasses camera photo at any time during a glasses conversation and photos are also captured automatically on visual keywords (auto_capture: off disables that), saved in Hermes's image cache; recordings and spoken replies use Hermes's own stt/tts settings, so a cloud speech provider receives the audio or text; pushes for offline devices are kept in $HERMES_HOME/glasses/outbox.json (owner-only); Omi transcript segments are held in memory for up to ten minutes per session; the device's new-session button answers Hermes's /new confirmation for that user; it runs a local ffmpeg (no shell) only to convert audio; no outbound network calls of its own and no telemetry.
From its catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
hermes plugins install glasses-platform - Said no? Turn it on later:
hermes plugins enable glasses-platform - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- Everyday life & fun · Chat apps & voice
- Maintained by
- 100yenadmin (Community)
- Needs
- No API keys declared
- Adds tools
glasses_capture_photoglasses_show_textglasses_buzz- Needs Hermes
- 0.22.2 or newer
- Version
- 0.6.2
- In the catalog
- 2026-11-09, updated 2026-11-10
- GitHub stars
- 1
Known issues (from its catalog listing)
- Preview: proven against the bundled simulators and a real Hermes gateway with real models (the G2 app in the official Even Hub simulator, Pebble with a Bobby-protocol client); not yet tested on real glasses, watches, voice boxes or an Omi pendant, or with the iOS app on a device.
- Each device needs a companion app or firmware that speaks one of its protocols: the community hermes-glasses iOS app in bridge mode, the bundled G2 app, xiaozhi firmware, an Omi app webhook or the Bobby app.
- Without a terminal, install with --yes-deps (it needs aiohttp and qrcode); otherwise the plugin installs but stays disabled.
Using the Hermes desktop app? See where plugins live

Full setup & settings ↗Source code ↗
More in everyday life & fun
All everyday life & fun plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher