AI engineering glossary · Data engineering

What is mapReduce?

MapReduce: A programming model for processing big data in two phases: a map step turns input into key-value pairs in parallel, and a reduce step combines all values sharing a key. The framework handles distribution and failures.

Level: intermediateTopic: Data engineering

MapReduce: an example

Counting words: mappers emit (word, 1) for every word, and reducers sum the counts per word.

Related terms

More Data engineering terms

Where you learn it

MapReduce is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.