# Quick Eval: Hermes Agent plugin

> Get a second opinion on any answer. /quick-eval sends your last question to other models, shows the answers side by side, and records which ones you mark good.

Canonical: https://hermeswatcher.com/plugins/quick-eval  
Tier: Community  
Official page (Nous Research): https://hermes-agent.nousresearch.com/docs/plugins/quick-eval  
Last updated in catalog: 2026-11-14

Get a second opinion on any answer. /quick-eval sends your last question to other models, shows the answers side by side, and records which ones you mark good. Runs and picks go to an append-only JSONL file, and a review page (/quick-eval open: the Quick Eval page in Hermes Desktop on Hermes 0.22.3 or newer, or a browser page elsewhere; also a tab in hermes dashboard) shows each comparison and a model leaderboard.

## Good to know before installing

Sends your last question (only that message) to the models you name through Hermes' configured providers; probes localhost ports 11434, 1234, 8000 and 8080 for local model servers and, the first time you name a model one of them serves, adds that server as a `providers:` entry in config.yaml; asks for the model/provider-override permission on Hermes' consent screen (`/quick-eval allow` writes it into config.yaml on older Hermes); writes ~/.hermes/evals/evals.jsonl; reads ~/.hermes/state.db read-only to show your sessions; `/quick-eval open` outside Hermes Desktop serves the review page, which includes full session transcripts, on 127.0.0.1:8765 (or a free port) until Hermes exits, locked to a random per-launch token in the opened URL.

From the plugin's catalog listing.

## How to install

1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.

```bash
hermes plugins install quick-eval
```

2. Said no? Turn it on later:

```bash
hermes plugins enable quick-eval
```

3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see the official page. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide: https://hermes-agent.nousresearch.com/docs/user-guide/features/plugins

## Facts

- Category: AI models & providers, Web, research & browsing
- Maintained by: tikiverse (Community)
- Needs: No API keys declared
- Requires Hermes: `>=0.19`
- Version: 0.1.0
- In the catalog since: 2026-11-14

## Links

- [Full setup and settings (official page)](https://hermes-agent.nousresearch.com/docs/plugins/quick-eval)
- [Source code](https://github.com/tikiverse/quick-eval/tree/main/plugins/quick-eval#readme)
- [All plugins](https://hermeswatcher.com/plugins.md)

---

HermesWatcher is an independent guide. It is not affiliated with or endorsed by Nous Research. The [official Hermes Agent documentation](https://hermes-agent.nousresearch.com/docs) and [repository](https://github.com/NousResearch/hermes-agent) from Nous Research are the authority; each page here lists the official sources it was written from. If this site and the official docs disagree, trust the official docs. Index for agents: https://hermeswatcher.com/llms.txt
