AI engineering glossary · Linear algebra
What is ill-conditioned matrix?
Ill-conditioned matrix (also called Poorly conditioned matrix): A matrix that is nearly singular, having a very large condition number, so that solving equations with it is unstable and rounding errors get amplified. Highly correlated features are a common cause in regression.
Ill-conditioned matrix: an example
Two features that are 99.99 percent correlated give a design matrix whose near-dependent columns make coefficients swing wildly.
Related terms
More Linear algebra terms
- Infinity norm
- Inner product
- Inverse matrix
- Kronecker product
- L1 norm
- L2 norm
- Least squares
- Linear combination
Where you learn it
Ill-conditioned matrix is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.