Glossary · Infrastructure

Semantic Cache

A caching layer that returns a stored response for a semantically similar (not just identical) query, reducing redundant model calls for common variations of the same question.