AI engineering glossary · Transformers LLM architecture
What is open-weight model?
Open-weight model (also called Open weights): A model whose trained parameters are published so anyone can download, run and often fine-tune it on their own hardware. It is not always open source, since training data, code or licence terms may be restricted. Llama and Mistral models are examples.
Open-weight model: an example
A Bengaluru startup runs an open-weight model on its own GPUs so customer data never leaves its servers.
Related terms
More Transformers LLM architecture terms
- Padding mask
- Parameter count
- Position interpolation
- Positional encoding
- Post-norm
- Pre-norm
- Prefill and decode
- Prefix language model
Where you learn it
Open-weight model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.