Context-aware Learning from Partial Observations