AI engineering glossary · Data engineering

What is consumer group?

Consumer group: A set of consumer instances that share the work of reading a topic, with each partition assigned to only one member of the group at a time. Different groups each receive the full stream independently.

Level: intermediateTopic: Data engineering

Consumer group: an example

Three instances in one group split 12 partitions, four each, while a separate analytics group reads all messages again.

Related terms

More Data engineering terms

Where you learn it

Consumer group is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.

Before you go

Take the cheat sheet with you

One free PDF: the key AI-engineering terms, formulas and Python idioms. No spam; unsubscribe any time.