AI engineering glossary · Transformers LLM architecture
What is diverse beam search?
Diverse beam search: A variant of beam search that splits the beam into groups and penalises later groups for choosing tokens already chosen by earlier ones, giving a set of outputs that differ from one another instead of near-copies.
Diverse beam search: an example
Asking for 4 image captions returns four distinct phrasings rather than four small variations of the same sentence.
Related terms
More Transformers LLM architecture terms
- ELECTRA
- Encoder
- Encoder-decoder model
- Encoder-only model
- Expert
- Expert parallelism
- Fill-in-the-middle
- FlashAttention
Where you learn it
Diverse beam search is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.