AI engineering glossary · Generative media multimodal
What is controlNet?
ControlNet: A neural network add-on that lets a pretrained diffusion model follow extra spatial guidance such as edge maps, depth maps or human pose skeletons. It copies the model's encoder blocks, trains the copy on the new condition, and adds its output back, leaving the original weights frozen.
ControlNet: an example
Feeding a pose skeleton to ControlNet makes the generated person hold exactly that pose while the prompt sets clothing and setting.
Related terms
More Generative media multimodal terms
- Cross-attention conditioning
- Cross-modal retrieval
- CycleGAN
- Deepfake
- Denoising diffusion implicit model
- Denoising diffusion probabilistic model
- Denoising strength
- Diffusion model
Where you learn it
ControlNet is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.