Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Embodied Vision Conference Paper Where Does It End? - Reasoning About Hidden Surfaces by Object Intersection Constraints Strecke, M., Stückler, J. In 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2020), 9589 - 9597, IEEE, Piscataway, NJ, IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR 2020), June 2020, preprint Corr abs/2004.04630 (Published) preprint project page Code DOI BibTeX

Embodied Vision Conference Paper DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation Wang, R., Yang, N., Stückler, J., Cremers, D. In Proceedings of the IEEE international Conference on Robotics and Automation (ICRA), 11067 - 11073, IEEE, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA 2020), May 2020, arXiv:1904.10097 (Published) DOI BibTeX

Embodied Vision Conference Paper Learning to Adapt Multi-View Stereo by Self-Supervision Mallick, A., Stückler, J., Lensch, H. In Proceedings of the British Machine Vision Conference (BMVC), 2020, preprint https://arxiv.org/abs/2009.13278 (Published) URL BibTeX

Embodied Vision Conference Paper Learning to Identify Physical Parameters from Video Using Differentiable Physics Kandukuri, R., Achterhold, J., Moeller, M., Stueckler, J. Proc. of the 42th German Conference on Pattern Recognition (GCPR), 2020, GCPR 2020 Honorable Mention, preprint https://arxiv.org/abs/2009.08292 (Published) URL BibTeX

Embodied Vision Empirical Inference Article Numerical Quadrature for Probabilistic Policy Search Vinogradska, J., Bischoff, B., Achterhold, J., Koller, T., Peters, J. IEEE Transactions on Pattern Analysis and Machine Intelligence, 42(1):164-175, 2020 (Published) DOI BibTeX

Embodied Vision Conference Paper Planning from Images with Deep Latent Gaussian Process Dynamics Bosch, N., Achterhold, J., Leal-Taixe, L., Stückler, J. Proceedings of the 2nd Conference on Learning for Dynamics and Control (L4DC), 120:640-650, Proceedings of Machine Learning Research (PMLR), (Editors: Alexandre M. Bayen and Ali Jadbabaie and George Pappas and Pablo A. Parrilo and Benjamin Recht and Claire Tomlin and Melanie Zeilinger), 2020, preprint arXiv:2005.03770 (Published) Ppreprint Project page Code poster URL BibTeX

Autonomous Learning Embodied Vision Conference Paper Sample-efficient Cross-Entropy Method for Real-time Planning Pinneri, C., Sawant, S., Blaes, S., Achterhold, J., Stueckler, J., Rolinek, M., Martius, G. In Conference on Robot Learning 2020, 2020 (Published)
Trajectory optimizers for model-based reinforcement learning, such as the Cross-Entropy Method (CEM), can yield compelling results even in high-dimensional control tasks and sparse-reward environments. However, their sampling inefficiency prevents them from being used for real-time planning and control. We propose an improved version of the CEM algorithm for fast planning, with novel additions including temporally-correlated actions and memory, requiring 2.7-22x less samples and yielding a performance increase of 1.2-10x in high-dimensional control problems.
Paper Code Spotlight-Video URL BibTeX

Embodied Vision Book Chapter TUM Flyers: Vision-Based MAV Navigation for Systematic Inspection of Structures Usenko, V., Stumberg, L. V., Stückler, J., Cremers, D. In Bringing Innovative Robotic Technologies from Research Labs to Industrial End-users: The Experience of the European Robotics Challenges, 136:189-209, Springer Tracts in Advanced Robotics, Springer International Publishing, 2020 (Published) DOI URL BibTeX

Embodied Vision Article Visual-Inertial Mapping with Non-Linear Factor Recovery Usenko, V., Demmel, N., Schubert, D., Stückler, J., Cremers, D. IEEE Robotics and Automation Letters (RA-L), 5(2):422-429, 2020, presented at IEEE International Conference on Robotics and Automation (ICRA) 2020, preprint arXiv:1904.06504 (Published)
Cameras and inertial measurement units are complementary sensors for ego-motion estimation and environment mapping. Their combination makes visual-inertial odometry (VIO) systems more accurate and robust. For globally consistent mapping, however, combining visual and inertial information is not straightforward. To estimate the motion and geometry with a set of images large baselines are required. Because of that, most systems operate on keyframes that have large time intervals between each other. Inertial data on the other hand quickly degrades with the duration of the intervals and after several seconds of integration, it typically contains only little useful information. In this paper, we propose to extract relevant information for visual-inertial mapping from visual-inertial odometry using non-linear factor recovery. We reconstruct a set of non-linear factors that make an optimal approximation of the information on the trajectory accumulated by VIO. To obtain a globally consistent map we combine these factors with loop-closing constraints using bundle adjustment. The VIO factors make the roll and pitch angles of the global map observable, and improve the robustness and the accuracy of the mapping. In experiments on a public benchmark, we demonstrate superior performance of our method over the state-of-the-art approaches.
Code Preprint URL BibTeX