# Model Drift Watch: Hermes Agent plugin

> Scheduled check that the model you use in Hermes has not quietly got worse: 34 fixed, exactly graded questions (reasoning, instruction following, Japanese, plus your own) run through Hermes cron, each run tested…

Canonical: https://hermeswatcher.com/plugins/model-drift-watch  
Tier: Community  
Official page (Nous Research): https://hermes-agent.nousresearch.com/docs/plugins/model-drift-watch  
Last updated in catalog: 2026-10-04

Scheduled check that the model you use in Hermes has not quietly got worse: 34 fixed, exactly graded questions (reasoning, instruction following, Japanese, plus your own) run through Hermes cron, each run tested against the same model's own baseline with an exact per-question test and a same-day confirmation run, and a message only for a confirmed drop, a changed served model or a failed measurement. Not yet tried against a real LLM API (checked with a local mock model and real Hermes cron).

## Good to know before installing

Each check calls your own model through ctx.llm on your bill, capped per check by the plugin (default 120,000 tokens / $0.50, no daily cap; the agent can start checks itself via the model_drift tool, and the scheduled agent turn is extra); price lookup goes through Hermes's pricing code (may fetch OpenRouter/models.dev prices); 10 optional code questions, off by default, run model-written Python in a limited child process (not a hostile-code sandbox) including in unattended cron runs when enabled; `schedule` creates one Hermes cron job that survives plugin removal (run `unschedule` first); writes run history to plugin-data/model-drift-watch; no telemetry.

From the plugin's catalog listing.

## How to install

1. Install it. Hermes asks for any API keys it needs, then asks whether to turn it on.

```bash
hermes plugins install model-drift-watch
```

2. Said no? Turn it on later:

```bash
hermes plugins enable model-drift-watch
```

3. Restart Hermes so it loads the plugin.

Some plugins also need a sign-in or settings: see the official page. Memory plugins ask whether to become your memory provider instead. Steps follow the official plugins guide: https://hermes-agent.nousresearch.com/docs/user-guide/features/plugins

## Facts

- Category: Languages & regions, Web, research & browsing, Automation & multi-agent
- Maintained by: TakeshiTGAL (Community)
- Needs: No API keys declared
- Adds tools: `model_drift`
- Requires Hermes: `>=0.21.5`
- Version: 0.1.0
- In the catalog since: 2026-10-04

## Links

- [Full setup and settings (official page)](https://hermes-agent.nousresearch.com/docs/plugins/model-drift-watch)
- [Source code](https://github.com/TakeshiTGAL/hermes-plugin-model-drift#readme)
- [All plugins](https://hermeswatcher.com/plugins.md)

---

HermesWatcher is an independent guide. It is not affiliated with or endorsed by Nous Research. The [official Hermes Agent documentation](https://hermes-agent.nousresearch.com/docs) and [repository](https://github.com/NousResearch/hermes-agent) from Nous Research are the authority; each page here lists the official sources it was written from. If this site and the official docs disagree, trust the official docs. Index for agents: https://hermeswatcher.com/llms.txt