Neural Foundations · 2014
GloVe: Global Vectors for Word Representation
GloVe introduced a word-embedding method that learns vectors by factorizing a corpus-wide word co-occurrence matrix, solving the problem of combining global corpus statistics with the useful linear structure of local-context methods.
Editorial record
Plain-language summary
GloVe builds a matrix counting how often each word appears near each other word across the whole corpus, then trains word vectors so that the dot product of two vectors approximates the logarithm of their co-occurrence count, weighting frequent pairs so common words do not dominate. This uses aggregate statistics directly rather than scanning context windows one at a time like word2vec. The resulting vectors placed related words near each other and encoded analogies as vector offsets, and became a widely used pretrained input for later NLP models.
Source record
Provenance
- Record ID
- A-005
- Record created
- 2026-07-13
- Last reviewed
- 2026-07-14
- Record version
- 2
Citation caveat: Citation metadata is approximate and marked unverified in the source dataset.