Structured Learning with Manifold Representations of Natural Data Variations