SceneMux

From its catalog listing

Turn an MP3 into a beat-aligned, lip-synced music video from any Hermes agent. Eight tools: scenemux_doctor (health/keys), scenemux_setup (start the studio server via Docker, provisions keys from the agent secret scope), scenemux_project (upload audio + references, beat-grid analysis, Whisper lyrics), scenemux_plan (LLM storyboard with beat-locked scenes, shown for review before anything is generated), scenemux_render (spend-gated: cost estimate first, confirm=true is escalated to a Hermes human-approval gate), scenemux_status, scenemux_export (final MP4, optional 9:16 vertical cut), scenemux_cancel. The storyboard director can run on a cloud LLM, a local Ollama model, or the agent itself (director_backend=hermes) via the local Hermes API server. A bundled skill (scenemux:studio) carries the operator workflow.

Good to know before installing

the plugin talks only to the user's own SceneMux studio server (default http://127.0.0.1:8000) and reads the audio/reference paths the agent passes it; scenemux_setup starts one local server process (Docker container, port-published on 127.0.0.1 only) that runs until the session ends; planning and stills call the LLM/image/video backends configured on that server; the default cloud preset spends Comfy Cloud credits on renders, which is why renders are estimate-first and a confirm=true call is escalated to the user's approval gate; the server is reachable on loopback only (compose publishes 127.0.0.1 ports, no wildcard CORS), and tool calls to non-loopback hosts are refused; secrets are read only through the agent secret scope, are sent only to loopback / host.docker.internal hosts, and the server .env is written (chmod 600) only for a 127.0.0.1-bound server; no telemetry. Disclosure — SceneMux talks to your own SceneMux studio server (default http://127.0.0.1:8000), which scenemux_setup can start as a local Docker container published on 127.0.0.1 only; it uploads the audio and reference images the agent passes it, and the studio sends prompts and images to the LLM, image and video backends configured there (the default cloud preset spends Comfy Cloud credits, so renders show a cost estimate first and confirmed renders go through Hermes' approval prompt); API keys are read through the agent secret scope and sent only to a local studio, the Home Agent address comes only from the plugin's home_agent_url setting, and a ComfyUI address the agent passes for local rendering receives your reference images; no telemetry.

From its catalog listing.

How to install

  1. Install it. Hermes asks for any API keys it needs (this one needs COMFY_CLOUD_API_KEY, OLLAMA_API_KEY, OPENCODE_API_KEY, FAL_KEY, HOME_AGENT_PASSWORD, API_SERVER_KEY), then asks whether to turn it on.
    hermes plugins install scenemux
  2. Said no? Turn it on later:
    hermes plugins enable scenemux
  3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).

Category
Images, video, music & 3D · Security & privacy
Maintained by
ep150de (Community)
Needs
COMFY_CLOUD_API_KEY OLLAMA_API_KEY OPENCODE_API_KEY FAL_KEY HOME_AGENT_PASSWORD API_SERVER_KEY API keys
Adds tools
scenemux_doctor scenemux_setup scenemux_project scenemux_plan scenemux_render scenemux_status scenemux_export scenemux_cancel
Adds hooks
pre_tool_call
Needs Hermes
0.23.0 or newer
Version
0.5.1
In the catalog
2026-11-17

Known issues (from its catalog listing)

  • A running SceneMux studio server is required. scenemux_setup starts one via Docker (needs the repo_path setting pointed at a full repo clone, or the server already running). ffmpeg on PATH is needed for export/assembly.
  • The cloud pipeline preset spends Comfy Cloud credits on stills and video; the estimate tool reports the rough cost before render.
  • LLM planning quality depends on the configured model; a local Ollama model works for free and keeps the director lane private. director_backend=hermes needs the Hermes API server (API_SERVER_ENABLED=true + API_SERVER_KEY in ~/.hermes/.env, then `hermes gateway`).
  • First Docker run builds the image (a few minutes).
Using the Hermes desktop app? See where plugins live
Hermes desktop Capabilities page, Plugins tab filtered to Official plugins built by Nous Research, each with an add button.
The official plugin catalog built into the app.Hermes desktop v0.22.5 · Capabilities > Plugins · Windows · captured Nov 1, 2026

Full setup & settings ↗Source code ↗

More in images, video, music & 3d

All images, video, music & 3d plugins

New Hermes Agent updates every day on X. Follow @HermesWatcher

← All plugins