AI engineering glossary · Computing foundations

What is cache memory?

Cache memory (also called CPU cache): A small, very fast memory inside or next to the CPU that keeps copies of recently used data so the processor need not wait for slower RAM. Programs that reuse nearby data repeatedly run faster because most reads become cache hits.

Level: intermediateTopic: Computing foundations

Cache memory: an example

Looping through an array in order is fast because neighbouring elements are already loaded into cache.

Related terms

More Computing foundations terms

Where you learn it

Cache memory is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.