AI engineering glossary · Data engineering
What is message queue?
Message queue: A buffer in which messages wait in order until a consumer takes and processes them, usually each message being handled by one consumer. It smooths bursts of traffic and lets producers and consumers work at different speeds.
Message queue: an example
Image-resize tasks wait in a queue while a pool of workers picks them up one by one.
Related terms
More Data engineering terms
Where you learn it
Message queue is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.