AI engineering glossary · Linear algebra
What is singular value?
Singular value: A non-negative number in the decomposition of a matrix that measures how strongly the matrix stretches along one of its principal directions. It equals the square root of an eigenvalue of the matrix times its transpose, and small ones mark near-redundant directions.
Singular value: an example
A matrix with singular values 10, 3 and 0.01 does almost all its stretching along the first two directions.
Related terms
More Linear algebra terms
- Singular value decomposition
- Span
- Sparse matrix
- Sparse vector
- Spectral norm
- Spectral radius
- Spectral theorem
- Standard basis
Where you learn it
Singular value is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.