AI engineering glossary · Transformers LLM architecture
What is LLM (large language model)?
Large language model (also called LLM): A Transformer-based language model with billions of parameters, trained on very large text collections. Its scale lets it follow instructions, write code, summarise and reason about text, often with no task-specific training, and it is usually adapted for chat with further tuning.
Large language model: an example
A chat assistant that drafts a job application in Hindi and English is powered by an LLM.
Related terms
More Transformers LLM architecture terms
- Learned positional embedding
- Length penalty
- Linear attention
- Llama
- LM head
- Load-balancing loss
- Log probabilities
- Logit lens
Where you learn it
Large language model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.