Pass a pattern through hidden units

A journey through restricted boltzmann machines with Botie.

Neural Networks · A journey with Botie

First visit? Learn the workshop controls

Botie's notebook

Could Hidden Variables Explain Which Inputs Occur Together?

Part 1 of 3

Some observations occur together more often than others. A model of those patterns needs more than a separate frequency for each input. It needs a way to represent combinations, including influences that we do not observe directly.

Sources for this history

Hinton (2002), Training Products of Experts by Minimizing Contrastive Divergence

← Previous lesson: Hopfield Networks Read the full lesson and derivations