AI engineering glossary · Generative media multimodal
What is LLaVA?
LLaVA: An open vision-language model that connects a pretrained vision encoder to a large language model through a projector and is fine-tuned on image-based instruction data. It popularised a simple recipe for chat about images.
LLaVA: an example
A researcher fine-tunes LLaVA on a few thousand annotated X-ray images to answer questions in a specific domain.
Related terms
More Generative media multimodal terms
- LoRA fine-tuning for diffusion
- Mean opinion score
- Mel spectrogram
- MFCC
- Mode collapse
- Multimodal embedding
- Multimodal model
- Negative prompt
Where you learn it
LLaVA is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.