What is Prompt caching?

Prompt caching lets an API reuse the processed form of a repeated prompt prefix across requests, reducing latency and the cost of the cached portion.

2 tools that work with Prompt caching

Files never leave your browser.

AI & LLM Tools2

AI API Cost CalculatorWork out what a prompt costs per call, per day and per month, and compare the same workload across every major model.Prompt Token OptimizerStrip the padding out of a prompt — dead whitespace, boilerplate politeness, redundant framing — and see the tokens and money saved.

Related terms

Terms that appear alongside Prompt caching on the same tools.

← All glossary terms Browse every tool →