Groq Provider
Groq as a Hermes model provider (`--provider groq`, or Groq in `hermes model`): reasoning effort is sent in the form each Groq model accepts, so gpt-oss-120b and gpt-oss-20b work (through a custom endpoint, Hermes 0.21.5 sends them a value Groq rejects with HTTP 400), and the model list leaves out Groq's speech-to-text, text-to-speech, prompt-guard and 4K-context models that Hermes cannot run. Not affiliated with Groq.
Good to know before installing
Registers one model provider at import and nothing else (no tools, hooks, commands or threads); chat requests and the model list go to https://api.groq.com/openai/v1 (or the configured model.base_url) through Hermes' own client with GROQ_API_KEY, which Hermes reads; the plugin itself opens no connections, reads and writes no files and starts no processes.
From the plugin's catalog listing.
How to install
- Install it. Hermes asks for any API keys it needs (this one needs
GROQ_API_KEY), then asks whether to turn it on.hermes plugins install groq-provider - Said no? Turn it on later:
hermes plugins enable groq-provider - Restart Hermes so it loads the plugin.
Some plugins also need a sign-in or settings: see Full setup & settings. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide (opens in a new tab).
- Category
- AI models & providers
- Maintained by
- AhmetArif0 (Community)
- Needs
GROQ_API_KEYAPI key- Needs Hermes
- 0.21.5 or newer
- Version
- 1.0.0
- In the catalog
- 2026-10-02
Full setup & settings ↗Source code ↗
More in ai models & providers
All ai models & providers plugins
New Hermes Agent updates every day on X. Follow @HermesWatcher