Natural Language Processing

Let Botie see adjacent pairs

A journey through n-grams with Botie.

Natural Language Processing · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could a Short Memory Capture Some of a Language's Structure?

Part 1 of 3

Counting single words tells us that they are common, but not which ones tend to occur together. A short phrase can carry information that disappears when its words are considered separately. We need some memory of neighbouring items without storing every possible sentence.

Sources for this history