AI engineering glossary · Generative media multimodal
What is multimodal model?
Multimodal model: A model that processes or produces more than one type of data, such as text, images, audio and video, within a single system. It can answer questions about a photo or transcribe and reason about speech.
Multimodal model: an example
A user uploads a photo of a handwritten Hindi note and asks the model to translate it into English.
Related terms
More Generative media multimodal terms
- Negative prompt
- Neural audio codec
- Neural radiance field
- Neural vocoder
- Noise schedule
- Normalizing flow
- Object hallucination
- Omni model
Where you learn it
Multimodal model is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.