Glossary · Model Training

Catastrophic Forgetting

A failure mode where fine-tuning a model on new data causes it to lose previously learned capabilities, because the training process overwrites weights that encoded the earlier knowledge.