AI engineering glossary · NLP embeddings
What is gloVe?
GloVe (also called Global Vectors): A word-embedding method that trains vectors so that the dot product of two word vectors approximates the logarithm of how often the words co-occur across the whole corpus. It combines global count statistics with the vector-learning style of Word2Vec.
GloVe: an example
GloVe vectors trained on a web corpus are downloaded and used to initialise the embedding layer of a sentiment classifier.
Related terms
More NLP embeddings terms
- Hard negative mining
- Hidden Markov model
- Hierarchical softmax
- In-batch negatives
- InfoNCE loss
- Intent classification
- Inverse document frequency
- Kneser-Ney smoothing
Where you learn it
GloVe is part of the AI Engineering Program, which teaches it with notes, a hands-on lab and an exam. The first lesson is free.