Glossary · Model Training
Scaling Laws
Empirically observed relationships describing how a language model's performance improves as a function of model size, training data volume, and compute, used to guide training investment decisions.
Glossary · Model Training
Empirically observed relationships describing how a language model's performance improves as a function of model size, training data volume, and compute, used to guide training investment decisions.