Prompt Caching Doesn't Save Money on Turn One
I went looking for a clean way to show what prompt caching actually saves an agent, and the first thing I found was a fact that's easy to miss if you only read the "up to 90% savings" headline.
Useful takeaways from this story.
I went looking for a clean way to show what prompt caching actually saves an agent, and the first thing I found was a fact that's easy to miss if you only read the "up to 90% savings" headline.
Caching a fresh conversation's first turn costs more than not caching it.
The savings arrive starting on turn two, once there's something to read.
Building the complete brief
The page is ready to read now. The fuller skim-friendly version will appear here automatically.
The useful part
I went looking for a clean way to show what prompt caching actually saves an agent, and the first thing I found was a fact that's easy to miss if you only read the "up to 90% savings" headline. Caching a fresh conversation's first turn costs more than not caching it. The savings arrive starting on turn two, once there's something to read.
Details worth keeping
Caching a fresh conversation's first turn costs more than not caching it. The savings arrive starting on turn two, once there's something to read.
Keep reading in the app
Open the app view to save this story, compare related coverage, and continue from the same source.