Large Language Models
Do not let tomorrow give away the answer
A journey through next-token prediction with Botie.
Large Language Models · A journey with Botie
First visit? Learn the workshop controlsBotie's notebook
Could Predicting the Next Symbol Teach Us About Language?
Part 1 of 3
After reading the beginning of a sentence, some continuations seem much more plausible than others. A model that predicts the next piece of text must learn something about spelling, recurring expressions, and longer relationships if it is to keep making useful predictions.