Glossary · Model Training

Model Distillation

A technique for training a smaller 'student' model to mimic the outputs of a larger 'teacher' model, producing a more efficient model that retains much of the teacher's capability.