Glossary · Model Training

PEFT (Parameter-Efficient Fine-Tuning)

An umbrella term for fine-tuning methods (including LoRA) that update only a small subset of a model's parameters, reducing the compute and memory needed to adapt a large model to a specific task compared to full fine-tuning.