Also called: caching
Reusing the processed form of a repeated chunk of prompt instead of paying to process it again.
Why it mattersLong system prompts and big documents get much cheaper and faster on repeat calls.
See also Token, Context Window
Prompt Caching
Reusing the processed form of a repeated chunk of prompt instead of paying to process it again.
Explore more AI terms
Browse the full glossary for plain-English definitions across models, agents, data, and safety.
Back to all terms