Glossary · Model Training

Self-Supervised Learning

A training approach where a model generates its own labels from the structure of unlabeled data (like predicting the next word in a sentence), the technique underlying most language model pretraining.