AI engineering glossary · Generative media multimodal
What is whisper?
Whisper: An open-source speech recognition model from OpenAI trained on a large multilingual collection of audio with transcripts. It transcribes many languages, translates speech to English, and is widely used as a strong general-purpose baseline.
Whisper: an example
A developer runs Whisper on a recorded interview in Hindi and gets a timestamped transcript.
Related terms
- Automatic speech recognition
- Word error rate
- Mel spectrogram
More Generative media multimodal terms
- Zero-shot TTS
- 3D Gaussian splatting
- Acoustic model
- Audio language model
- Beta-VAE
- BLIP
- Classifier-free guidance
- CLIP score
Where you learn it
Whisper is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.