When AI Caching Pays Off
An AI API cache hit is not a response cache that hands back a stored answer. It reuses the KV computed for the start of the input. This post works out which requests hit and how high the hit rate must be to break even once write costs are counted, then compares an agent and a chatbot using Claude Code measurements and a Slack chatbot's production logs. In the agent's sessions, 97.6% of input tokens were cache reads.
