AI engineering glossary · Computing foundations
What is memory hierarchy?
Memory hierarchy: The layered arrangement of memory types from tiny, fast and costly (registers, cache) to large, slow and cheap (RAM, disk). Systems are designed so frequently used data lives near the top, giving the illusion of a memory that is both big and fast.
Memory hierarchy: an example
A CPU checks its cache first, then RAM, then the disk, each step being much slower than the last.
Related terms
More Computing foundations terms
Where you learn it
Memory hierarchy is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.