# Music Listener: Hermes Agent plugin

> Listen to an MP3/FLAC/WAV by reconstructing every instrumental track, the vocal melody, pitch contour and time-aligned lyrics into a multi-track MIDI, MusicXML score and a compact structural JSON.

Canonical: https://hermeswatcher.com/plugins/music-listener  
Tier: Community  
Official page (Nous Research): https://hermes-agent.nousresearch.com/docs/plugins/music-listener  
Last updated in catalog: 2026-11-17

Listen to an MP3/FLAC/WAV by reconstructing every instrumental track, the vocal melody, pitch contour and time-aligned lyrics into a multi-track MIDI, MusicXML score and a compact structural JSON. Runs a heavy audio/ML stack (Demucs htdemucs_6s 6-stem separation, Spotify Basic Pitch polyphonic transcription, librosa pyin f0, faster-whisper lyric alignment) inside its own isolated Python 3.11 venv so Hermes' core runtime is never touched. The listen_to_music tool accepts an audio path and returns artifact paths (full_score.mid, full_score.musicxml, score_summary.json) plus tempo, key, per-track note counts, 8-bar section descriptors and synced lyric words — a compact structural summary so the agent reasons over the song without loading thousands of raw MIDI events. A /listen slash command and the music-listener:music-listener skill (pretty_midi/music21 recipes for bar queries, motifs, transposition and re-harmonization) round out the working surface. The worker prints progress to stderr and only compact JSON to stdout. Security: no shell=True (argv-list subprocesses), sanitized output paths, no credential reads, no network ports, a 60-minute worker cap; its only outbound traffic is official Demucs/faster-whisper model-weight downloads. Proven end-to-end on a real 2:46 commercial track (Imael Angel - "Bad Times"): 7 named MIDI tracks, valid MusicXML, 100 time-aligned lyric words. See https://github.com/JPeetz/music-listener#readme.

## Good to know before installing

After install you run the plugin's install.sh, which builds a Python 3.11 venv inside the plugin folder and downloads about 1-2 GB of packages (torch, Demucs, faster-whisper); the first transcription downloads Demucs and faster-whisper model weights from their upstream hosts; listen_to_music reads whatever audio path the agent passes and writes stems and scores under transcriptions/ in the agent's working directory (or the configured output_dir), running a CPU/GPU-heavy worker for up to 60 minutes per call.

From the plugin's catalog listing.

## How to install

1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.

```bash
hermes plugins install music-listener
```

2. Said no? Turn it on later:

```bash
hermes plugins enable music-listener
```

3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see the official page. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide: https://hermes-agent.nousresearch.com/docs/user-guide/features/plugins

## Facts

- Category: Memory & notes, Images, video, music & 3D
- Maintained by: JPeetz (Community)
- Needs: No API keys declared
- Adds tools: `listen_to_music`
- Works on: macos, linux
- Requires Hermes: `>=0.21.5`
- Version: 0.1.0
- In the catalog since: 2026-11-17

## Links

- [Full setup and settings (official page)](https://hermes-agent.nousresearch.com/docs/plugins/music-listener)
- [Source code](https://github.com/JPeetz/music-listener#readme)
- [All plugins](https://hermeswatcher.com/plugins.md)

---

HermesWatcher is an independent guide. It is not affiliated with or endorsed by Nous Research. The [official Hermes Agent documentation](https://hermes-agent.nousresearch.com/docs) and [repository](https://github.com/NousResearch/hermes-agent) from Nous Research are the authority; each page here lists the official sources it was written from. If this site and the official docs disagree, trust the official docs. Index for agents: https://hermeswatcher.com/llms.txt
