AI engineering glossary · LLM training alignment
What is QLoRA?
QLoRA: A method that fine-tunes LoRA adapters on top of a base model whose weights are frozen and stored in 4-bit precision. Gradients flow through the quantised weights into the adapters, allowing large models to be fine-tuned on a single GPU with little quality loss.
QLoRA: an example
A 65B-scale model that would need hundreds of gigabytes in 16-bit can be fine-tuned with QLoRA on one 48 GB GPU.
Related terms
More LLM training alignment terms
- Rank (LoRA)
- Reasoning model
- Reinforcement learning from AI feedback
- Reinforcement learning from human feedback
- Reinforcement learning with verifiable rewards
- Rejection sampling fine-tuning
- Reward hacking
- Reward model
Where you learn it
QLoRA is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.