AI engineering glossary · Generative media multimodal
What is text-to-video generation?
Text-to-video generation: Creating a short video clip from a text prompt, usually with diffusion models that extend image generation with a time dimension. The hard part is keeping objects, lighting and motion consistent across frames.
Text-to-video generation: an example
The prompt 'auto-rickshaw driving through Bengaluru rain' yields a 5-second clip at 24 frames per second.
Related terms
More Generative media multimodal terms
- Textual inversion
- Variational autoencoder
- Video generation
- Vision encoder
- Vision-language model
- Visual grounding
- Visual instruction tuning
- Visual question answering
Where you learn it
Text-to-video generation is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.