Bring the answer its evidence

A journey through retrieval-augmented generation with Botie.

Adapting and Evaluating Modern Models · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could the Model Consult a Reference Before Answering?

Part 1 of 3

A language model's weights are an awkward place to keep every fact we might later need. Updating a document does not automatically update the model, and an answer drawn only from its parameters may provide no clear reference for checking where the information came from.

Sources for this history

Lewis and colleagues (2020), Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks

← Previous lesson: Reinforcement Learning Read the full lesson and derivations