AI engineering glossary · AI ethics law product

What is DP-SGD?

DP-SGD (also called differentially private stochastic gradient descent): A training algorithm that makes a neural network differentially private by clipping each example's gradient to a maximum size and adding random noise before every update. It limits how much any single training record can influence the model, at some cost in accuracy.

Level: advancedTopic: AI ethics law product

DP-SGD: an example

A hospital trains a diagnosis model with clipped, noised gradients so that the model cannot memorise any one patient's record.

Related terms

More AI ethics law product terms

Where you learn it

DP-SGD is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.