AI engineering glossary · Inference serving optimisation
What is EAGLE?
EAGLE: A speculative decoding method that drafts using the large model's own hidden features through a lightweight extra module, rather than a separate small language model. Working at feature level gives higher acceptance rates than many token-level drafters.
EAGLE: an example
A small head takes the target's last hidden state and proposes the next few tokens.
Related terms
More Inference serving optimisation terms
Where you learn it
EAGLE is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.