Natural Language Processing

Retrieve and combine the word vectors

A journey through the embedding layer with Botie.

Natural Language Processing · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could Related Words Share What the Model Learns?

Part 1 of 3

A token ID tells us which item we have, but its numerical size says nothing about the item's meaning. If every word is treated as wholly separate, learning something from one sentence offers little help with a similar sentence containing a different word.

Sources for this history