Sentinel Vision

From its catalog listing

Tell Hermes what to watch on a camera, screen or video, and Sentinel detects events, stores snapshots and injects alerts into your chat. A local change detector and configurable call caps reduce vision-model usage; rules, event history and feedback make the watcher useful over time. Frames and rule text are sent to your configured model; see the README for setup, privacy and limitations.

Good to know before installing

Captures from local cameras, the screen (mss), image folders, video files and stream/snapshot URLs you configure. A background watcher (capture threads, judge workers, scheduler) starts about 25 s after load when rules exist and sends camera/screen frames and rule text to your configured vision model. Snapshots, events, teaching images and chat routes are stored under HERMES_HOME/plugin-data/sentinel-vision/. Fired rules inject alerts as user messages and can replay a rule's stored action prompt as unattended agent turns; outside the classic CLI this needs plugins.entries.sentinel-vision.allow_gateway_injection: true. The model can name local image/video paths to read and send to the vision model.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.
    hermes plugins install sentinel-vision
  2. Said no? Turn it on later:
    hermes plugins enable sentinel-vision
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Everyday life & fun · Automation & multi-agent
Maintained by
StarAtNyte (Community)
Needs
No API keys declared
Adds tools
sentinel_sources sentinel_watch sentinel_rules sentinel_update sentinel_look sentinel_events sentinel_feedback sentinel_teach sentinel_setup_check
Needs Hermes
0.22.5 or newer
Version
0.1.0
In the catalog
2026-11-12

Known issues (from its catalog listing)

  • Registers a /sentinel slash command, which another listed plugin (SENTINEL OS) also uses; the two conflict only if both are installed.
  • Outside the classic CLI, alerts are only delivered after you add plugins.entries.sentinel-vision.allow_gateway_injection: true to config.yaml; /sentinel status shows the exact snippet when delivery is refused.
  • Needs a vision-capable model routed to the sentinel_vision auxiliary task, otherwise judging fails (the gate keeps running).
  • On Telegram/Discord send /sentinel here once so alerts return to that chat.
  • Screen capture needs a display; it is not available on a headless server.
  • Vision only (no audio, no video-site streams such as YouTube). Movement is judged from up to 3 recent frames, not video; the slow-drift check misses very small or very large gradual changes. Expect misses and false alarms. Not a safety device.
  • Plugins cannot read allow_gateway_injection; run /sentinel setup --test-delivery to test delivery. On a multiplexing gateway, cameras that need a ${SECRET} wait until the first /sentinel command or sentinel_* tool call after start-up.
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in everyday life & fun

All everyday life & fun plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins