Emergent Representations In Reinforcement Learning And Their Properties