Natural Language Processing

Fit the log of a co-occurrence count

A journey through glove with Botie.

Natural Language Processing · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could the Pattern of Co-Occurrence Counts Become a Compact Vector?

Part 1 of 3

A corpus tells us which words appear near one another, but a full table of those counts can be enormous. We want compact vectors that preserve informative relationships in that table without merely giving the most frequent words the largest influence.

Sources for this history