Glossary · Infrastructure

Prompt Caching

A provider feature that reuses previously-processed context across API calls, reducing both cost and latency for requests that repeat a large unchanged portion of the prompt.