Natural Language Processing
Retrieve and combine the word vectors
A journey through the embedding layer with Botie.
Natural Language Processing · A journey with Botie
First visit? Learn the workshop controlsBotie's notebook
Could Related Words Share What the Model Learns?
Part 1 of 3
A token ID tells us which item we have, but its numerical size says nothing about the item's meaning. If every word is treated as wholly separate, learning something from one sentence offers little help with a similar sentence containing a different word.