Pick the nearest stored prototype

A journey through codebook quantisation with Botie.

Natural Language Processing · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could We Store the Nearest Representative Instead of Every Number?

Part 1 of 3

A signal represented by many precise numbers can be expensive to store or transmit. If nearby vectors are similar enough for our purpose, perhaps we can replace them with one shared representative and store only its address.

Sources for this history

Linde, Buzo and Gray (1980), An Algorithm for Vector Quantizer Design

← Previous lesson: Patching Without a Vocabulary Read the full lesson and derivations