AI engineering glossary · LLM training alignment
What is PEFT library?
PEFT library: Hugging Face's open-source library implementing parameter-efficient fine-tuning methods such as LoRA, prefix tuning and prompt tuning. It attaches small trainable adapters to models loaded from the Transformers library and saves them separately.
PEFT library: an example
Wrapping a model with a LoRA config in PEFT makes only the adapter weights trainable.
Related terms
More LLM training alignment terms
- Pipeline parallelism
- Policy (reinforcement learning)
- Policy gradient
- Post-training
- Preference data
- Prefix tuning
- Pretraining
- Process reward model
Where you learn it
PEFT library is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.