Extending the conversation history just to reach Anthropic’s minimum prompt caching threshold can cost more than keeping a shorter context window without caching. That’s what we found when optimizing a voice assistant whose responses rarely required more…