AI engineering glossary · Computer vision
What is vision transformer?
Vision transformer (also called ViT): A model that splits an image into fixed-size patches, treats each patch as a token and processes them with a transformer encoder using self-attention. With enough data it matches or beats CNNs on classification.
Vision transformer: an example
A 224 x 224 image cut into 16 x 16 patches becomes a sequence of 196 tokens.
Related terms
More Computer vision terms
- YOLO
- Zero-shot learning
- 1x1 convolution
- Affine transformation of images
- AlexNet
- Anchor box
- Aspect ratio
- Average pooling
Where you learn it
Vision transformer is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.