Glossary · Model Training

Continual Pretraining

Continuing a model's pretraining process on new data (such as a specific domain or language) after its initial training run, distinct from fine-tuning which typically targets instruction-following behavior.