witcheer's Wingtips #74: provider_routing, pick which host serves your model on OpenRouter

Republished in his own words, with credit.

Back to wingtips

#74 · provider_routing, pick which host serves your model on OpenRouter

· Models, providers & cost · CLI / Desktop / Gateway

on OpenRouter, one model name is served by several hosts, and OpenRouter picks the host for each request.

but what if one of those hosts is rate-limiting you today?

provider_routing in config.yaml lets you choose.

list a host under ignore and your requests for that model stop going there, even when it is the cheapest one. the other hosts keep serving as before.

on Nous Portal you can skip this step: the Portal picks the host for every model on your behalf, so there is nothing to set.

# in ~/.hermes/config.yaml (OpenRouter setups)
provider_routing:
  ignore:
    - "<provider slug>"   # the lowercase slug OpenRouter shows for that host

same key, other lists: only: (allow these hosts) and order: (try these first). read at startup, so restart hermes or the gateway after the edit. list values: edit config.yaml directly, not hermes config set. one model only? put the same lists under models: for that model id.

docs: provider routing

All tips are written by witcheer and collected here with credit. Card images stay on his X posts.

witcheer says each tip ran on a real Hermes box before it shipped. Hermes changes fast, so check your version and the linked doc.