Embodied Vision Members Publications

Learning a Robot- and Terrain-Aware Context-Conditional Dynamics Models for Navigation

Model architecture of TRADYN. © IEEE. Reprinted, with permission, from [File Icon].

Members

Embodied Vision
Max Planck Research Group Leader
Embodied Vision
no image
Embodied Vision
Embodied Vision
Embodied Vision

Publications

Embodied Vision Conference Paper Context-Conditional Navigation with a Learning-Based Terrain- and Robot-Aware Dynamics Model Guttikonda, S., Achterhold, J., Li, H., Boedecker, J., Stueckler, J. In Proceedings of the European Conference on Mobile Robots (ECMR), 2023 (Published)
In autonomous navigation settings, several quantities can be subject to variations. Terrain properties such as friction coefficients may vary over time depending on the location of the robot. Also, the dynamics of the robot may change due to, e.g., different payloads, changing the system's mass, or wear and tear, changing actuator gains or joint friction. An autonomous agent should thus be able to adapt to such variations. In this paper, we develop a novel probabilistic, terrain- and robot-aware forward dynamics model, termed TRADYN, which is able to adapt to the above-mentioned variations. It builds on recent advances in meta-learning forward dynamics models based on Neural Processes. We evaluate our method in a simulated 2D navigation setting with a unicycle-like robot and different terrain layouts with spatially varying friction coefficients. In our experiments, the proposed model exhibits lower prediction error for the task of long-horizon trajectory prediction, compared to non-adaptive ablation models. We also evaluate our model on the downstream task of navigation planning, which demonstrates improved performance in planning control-efficient paths by taking robot and terrain properties into account.
preprint code DOI URL BibTeX

Embodied Vision Conference Paper Explore the Context: Optimal Data Collection for Context-Conditional Dynamics Models Achterhold, J., Stueckler, J. In Proceedings of The 24th International Conference on Artificial Intelligence and Statistics (AISTATS 2021) , 130, JMLR, Cambridge, MA, Titel The 24th International Conference on Artificial Intelligence and Statistics (AISTATS 2021) , April 2021, preprint CoRR abs/2102.11394 (Published)
In this paper, we learn dynamics models for parametrized families of dynamical systems with varying properties. The dynamics models are formulated as stochastic processes conditioned on a latent context variable which is inferred from observed transitions of the respective system. The probabilistic formulation allows us to compute an action sequence which, for a limited number of environment interactions, optimally explores the given system within the parametrized family. This is achieved by steering the system through transitions being most informative for the context variable. We demonstrate the effectiveness of our method for exploration on a non-linear toy-problem and two well-known reinforcement learning environments.
Preprint Project page Poster URL BibTeX