Modeling Structured Dynamics With Deep Neural Networks