AI engineering glossary · Data engineering
What is bucketing?
Bucketing: Distributing rows into a fixed number of groups by hashing a column value, so rows with the same key land together. It can reduce shuffling for joins and aggregations on that key.
Bucketing: an example
A table bucketed into 64 groups by customer_id lets a join with another table bucketed the same way avoid a full redistribution.
Related terms
More Data engineering terms
Where you learn it
Bucketing is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.