Glossary · Architecture

Model Cascading

Routing a request to a cheaper, smaller model first and escalating to a larger model only when the smaller one's response fails a confidence check, balancing cost against quality.