AI engineering glossary · Linear algebra
What is dense matrix?
Dense matrix: A matrix stored as a full grid, where every entry is kept explicitly whether or not it is zero. It suits data with mostly non-zero values, such as neural network weights, and works well with GPU hardware.
Dense matrix: an example
A 1024 x 1024 weight matrix is stored as 1,048,576 numbers regardless of their values.
Related terms
More Linear algebra terms
- Design matrix
- Determinant
- Diagonal matrix
- Diagonalisation
- Dimension
- Dot product
- Eigendecomposition
- Eigenspace
Where you learn it
Dense matrix is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.