AI engineering glossary · Calculus optimisation
What is partial derivative?
Partial derivative: The derivative of a function of several variables taken with respect to one variable while every other variable is treated as a constant. It measures sensitivity of the output to that single input. Collecting all of them gives the gradient.
Partial derivative: an example
For f(x, y) = x^2 * y, the partial with respect to x is 2xy and with respect to y is x^2. At (3, 2) they are 12 and 9.
Related terms
More Calculus optimisation terms
- Power rule
- Preconditioning
- Product rule
- Projected gradient descent
- Proximal gradient method
- Quasi-Newton method
- Quotient rule
- Rate of change
Where you learn it
Partial derivative is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.