AI engineering glossary · Generative media multimodal
What is cross-modal retrieval?
Cross-modal retrieval: Finding items in one modality using a query in another, such as retrieving images from a text description or captions from a picture. Models embed both modalities in a shared space where matching pairs lie close.
Cross-modal retrieval: an example
Typing 'red silk saree with gold border' returns matching catalogue photos from an e-commerce store.
Related terms
- Multimodal embedding
- Contrastive language-image pretraining
- Image-text retrieval
More Generative media multimodal terms
- CycleGAN
- Deepfake
- Denoising diffusion implicit model
- Denoising diffusion probabilistic model
- Denoising strength
- Diffusion model
- Diffusion sampler
- Diffusion transformer
Where you learn it
Cross-modal retrieval is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.