Glossary · Model Training

Pretraining

The initial, large-scale training phase where a model learns general language patterns from broad text data, before any task-specific fine-tuning or alignment stages.