Let the layer make a correction

If a network already gives a useful representation, adding layers seems as though it should at least preserve that result. The new layers could simply pass the representation through. In practice, learning that apparently simple behaviour was not always easy, and deeper networks could have worse training error.