witcheer's Wingtips #14: switching models resets your prompt cache

Republished in his own words, with credit.

Back to wingtips

#14 · switching models resets your prompt cache

· Models, providers & cost · CLI / Desktop / Gateway

Hermes Wingtips #14: switching models resets your prompt cache

switch models mid-conversation and the next turn re-reads the whole thing at full input price. the cache key includes the model, so a new model means a cold cache. occasional switches are fine, frequent ones in a long session multiply your cost.

  • batch your switches instead of ping-ponging mid-thread
  • on a long session, start a fresh one or delegate (subagents get their own context) rather than switching back and forth

All tips are written by witcheer and collected here with credit. Card images stay on his X posts.

witcheer says each tip ran on a real Hermes box before it shipped. Hermes changes fast, so check your version and the linked doc.