Glossary · Infrastructure

Context Compression

Techniques for reducing the token footprint of context sent to a model — summarizing history, trimming irrelevant retrieved content — without losing the information needed to complete the task.