Natural Language Processing
Let Botie see adjacent pairs
A journey through n-grams with Botie.
Natural Language Processing · A journey with Botie
First visit? Learn the workshop controlsBotie's notebook
Could a Short Memory Capture Some of a Language's Structure?
Part 1 of 3
Counting single words tells us that they are common, but not which ones tend to occur together. A short phrase can carry information that disappears when its words are considered separately. We need some memory of neighbouring items without storing every possible sentence.