Carry something into the next step

A sound or word often means something different depending on what preceded it. If we process each observation independently, we throw away that context before making the next prediction. We need a representation that can carry something forward.