AI engineering glossary · Transformers LLM architecture
What is t5?
T5 (also called Text-to-Text Transfer Transformer): Text-to-Text Transfer Transformer: an encoder-decoder model that casts every task as text in, text out, using a prefix to say what to do. The same model, loss and decoding process handle translation, summarisation and classification.
T5: an example
Input 'summarize: <article>' produces a short summary, while 'translate English to German: Hello' produces 'Hallo'.
Related terms
More Transformers LLM architecture terms
- Temperature
- Test-time compute
- Top-k expert routing
- Top-k sampling
- Top-p sampling
- Transformer
- Transformer block
- Transformer MLP block
Where you learn it
T5 is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.