DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Perceiving Systems Conference Paper Instant Multi-View Head Capture through Learnable Registration Bolkart, T., Li, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 768-779, CVPR, June 2023 (Published) project video paper sup. mat. poster BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Instant Volumetric Head Avatars Zielonka, W., Bolkart, T., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 4574-4584, CVPR, June 2023 (Published) pdf project video code face tracker code dataset DOI URL BibTeX

Empirical Inference Conference Paper Learning Locomotion Skills from MPC in Sensor Space Khadiv, M., Meduri, A., Zhu, H., Righetti, L., Schölkopf, B. Proceedings of The 5th Annual Learning for Dynamics and Control Conference (L4DC), 211:1218-1230, (Editors: Matni, Nikolai and Morari, Manfred and Pappas, George J.), PMLR, June 2023 (Published) URL BibTeX

Perceiving Systems Conference Paper Learning from Synthetic Data Generated with GRADE Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Pretraining for Robotics (PT4R) Workshop , ICRA 2023 Pretraining for Robotics (PT4R) Workshop, June 2023 (Published) Code Data and network models pdf URL BibTeX

Physical Intelligence Article Liquid Metal Actuators: A Comparative Analysis of Surface Tension Controlled Actuation Liao, J., Majidi, C., Sitti, M. Advanced Materials (Deerfield Beach, Fla.), e2300560-e2300560, June 2023 DOI BibTeX

Dynamic Locomotion Conference Paper Multi-segmented Adaptive Feet for Versatile Legged Locomotion in Natural Terrain Chatterjee, A., Mo, A., Kiss, B., Goenen, E. C., Badri-Spröwitz, A. 2023 IEEE International Conference on Robotics and Automation (ICRA 2023), 1162-1169 , IEEE, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA), June 2023 (Published) Youtube Edmond CAD DOI URL BibTeX

Haptic Intelligence Miscellaneous Naturalistic Vibrotactile Feedback Could Facilitate Telerobotic Assembly on Construction Sites Gong, Y., Javot, B., Lauer, A. P. R., Sawodny, O., Kuchenbecker, K. J. Poster presented at the ICRA Workshop on Future of Construction: Robot Perception, Mapping, Navigation, Control in Unstructured and Cluttered Environments, London, UK, June 2023 (Published) BibTeX

Physical Intelligence Article Pangolin-inspired untethered magnetic robot for on-demand biomedical heating applications Soon, R. H., Yin, Z., Dogan, M. A., Dogan, N. O., Tiryaki, M. E., Karacakol, A. C., Aydin, A., Esmaeili-Dokht, P., Sitti, M. Nature Communications, 14(1):3320, June 2023 DOI BibTeX

Physical Intelligence Article Programmable self-organization of heterogeneous microrobot collectives Ceron, S., Gardi, G., Petersen, K., Sitti, M. Proceedings of the National Academy of Sciences, 120(24):e2221913120, June 2023 DOI BibTeX

Empirical Inference Article Quantification of intratumoural heterogeneity in mice and patients via machine-learning models trained on PET–MRI data Katiyar, P., Schwenck, J., Frauenfeld, L., Divine, M. R., Agrawal, V., Kohlhofer, U., Gatidis, S., Kontermann, R., Königsrainer, A., Quintanilla-Martinez, L., et al. Nature Biomedical Engineering, 7(8):1014-1027, June 2023 (Published) DOI BibTeX

Haptic Intelligence Perceiving Systems Conference Paper Reconstructing Signing Avatars from Video Using Linguistic Priors Forte, M., Kulits, P., Huang, C. P., Choutas, V., Tzionas, D., Kuchenbecker, K. J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 12791-12801, CVPR, June 2023 (Published) pdf arXiv project code DOI URL BibTeX

Empirical Inference Conference Paper Robustness Implies Fairness in Causal Algorithmic Recourse Ehyaei, A., Karimi, A., Schölkopf, B., Maghsudi, S. Proceedings of the 2023 ACM Conference on Fairness, Accountability, and Transparency (FAccT), 984-1001, ACM, June 2023 (Published) DOI BibTeX

Perceiving Systems Conference Paper Simulation of Dynamic Environments for SLAM Bonetto, E., Xu, C., Ahmad, A. In ICRA 2023 Workshop on the Active Methods in Autonomous Navigation, ICRA, June 2023 (Published) Code Evaluation code Data pdf URL BibTeX

Perceiving Systems Article Virtual Reality Exposure to a Healthy Weight Body Is a Promising Adjunct Treatment for Anorexia Nervosa Behrens, S. C., Tesch, J., Sun, P. J., Starke, S., Black, M. J., Schneider, H., Pruccoli, J., Zipfel, S., Giel, K. E. Psychotherapy Psychosomatics, 92(3):170-179, June 2023 (Published) DOI URL BibTeX

Empirical Inference Conference Paper Workshop: Machine Learning for Science: Mathematics at the Interface of Data-driven and Mechanistic Modelling Lawrence, N., Montgomery, J., Schölkopf, B. Oberwolfach Reports, 20(2):1453-1484, June 2023 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper 3D Human Pose Estimation via Intuitive Physics Tripathi, S., Müller, L., Huang, C. P., Taheri, O., Black, M. J., Tzionas, D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , 4713-4725, CVPR, June 2023 (Published) Project Page Moyo Dataset DOI URL BibTeX

Empirical Inference Conference Paper AIMY: An Open-source Table Tennis Ball Launcher for Versatile and High-fidelity Trajectory Generation Dittrich, A., Schneider, J., Guist, S., Gürtler, N., Ott, H., Steinbrenner, T., Schölkopf, B., Büchler, D. IEEE International Conference on Robotics and Automation (ICRA), 3058-3064, IEEE, June 2023 (Published) arXiv DOI BibTeX

Perceiving Systems Conference Paper ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation Fan, Z., Taheri, O., Tzionas, D., Kocabas, M., Kaufmann, M., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 12943-12954, CVPR, June 2023 (Published) Project Page Code Paper arXiv Video DOI URL BibTeX

Perceiving Systems Conference Paper BEDLAM: A Synthetic Dataset of Bodies Exhibiting Detailed Lifelike Animated Motion Black, M. J., Patel, P., Tesch, J., Yang, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 8726-8737, CVPR, June 2023 (Published) pdf project CVF code DOI URL BibTeX

Perceiving Systems Conference Paper BITE: Beyond Priors for Improved Three-D Dog Pose Estimation Rüegg, N., Tripathi, S., Schindler, K., Black, M. J., Zuffi, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 8867-8876, CVPR, June 2023 (Published) pdf supp project DOI URL BibTeX

Perceiving Systems Conference Paper ECON: Explicit Clothed humans Optimized via Normal integration Xiu, Y., Yang, J., Cao, X., Tzionas, D., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 512-523, CVPR, June 2023 (Published) Page Paper Demo Code Video Colab DOI URL BibTeX

Perceiving Systems Conference Paper HOOD: Hierarchical Graphs for Generalized Modelling of Clothing Dynamics Grigorev, A., Thomaszewski, B., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 16965-16974, CVPR, June 2023 (Published) arXiv project pdf supp URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX

Perceiving Systems Conference Paper PointAvatar: Deformable Point-Based Head Avatars From Videos Zheng, Y., Yifan, W., Wetzstein, G., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 21057-21067, CVPR, June 2023 (Published) pdf project code video DOI URL BibTeX

Perceiving Systems Conference Paper SLOPER4D: A Scene-Aware Dataset for Global 4D Human Pose Estimation in Urban Environments Dai, Y., Lin, Y., Lin, X., Wen, C., Xu, L., Yi, H., Shen, S., Ma, Y., Wang, C. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 682-692, CVF, CVPR, June 2023 (Published) project dataset codebase paper arXiv BibTeX

Perceiving Systems Conference Paper TRACE: 5D Temporal Regression of Avatars With Dynamic Cameras in 3D Environments Sun, Y., Bao, Q., Liu, W., Mei, T., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 8856-8866, CVPR, June 2023 (Published) pdf supp code video URL BibTeX

Autonomous Learning Conference Paper Backpropagation through Combinatorial Algorithms: Identity with Projection Works Sahoo, S., Paulus, A., Vlastelica, M., Musil, V., Kuleshov, V., Martius, G. In Proceedings of the Eleventh International Conference on Learning Representations, May 2023 (Accepted) OpenReview Arxiv Pdf URL BibTeX

Autonomous Learning Empirical Inference Conference Paper Benchmarking Offline Reinforcement Learning on Real-Robot Hardware Gürtler, N., Blaes, S., Kolev, P., Widmaier, F., Wüthrich, M., Bauer, S., Schölkopf, B., Martius, G. In Proceedings of the Eleventh International Conference on Learning Representations, The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) Website arXiv Code URL BibTeX

Autonomous Learning Empirical Inference Conference Paper DEP-RL: Embodied Exploration for Reinforcement Learning in Overactuated and Musculoskeletal Systems Schumacher, P., Haeufle, D. F., Büchler, D., Schmitt, S., Martius, G. In The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) Arxiv pdf Website URL BibTeX

Empirical Inference Article ResMiCo: Increasing the quality of metagenome-assembled genomes with deep learning Mineeva*, O., Danciu*, D., Schölkopf, B., Ley, R. E., Rätsch, G., Youngblut, N. D. PLOS Computational Biology, 19(5), Public Library of Science, San Francisco, CA, May 2023, *equal contribution (Published) DOI BibTeX

Haptic Intelligence Miscellaneous 3D Reconstruction for Minimally Invasive Surgery: Lidar Versus Learning-Based Stereo Matching Caccianiga, G., Nubert, J., Hutter, M., Kuchenbecker., K. J. Workshop paper (2 pages) presented at the ICRA Workshop on Robot-Assisted Medical Imaging, London, UK, May 2023 (Published) BibTeX

Empirical Inference Article A Kernel Stein Test for Comparing Latent Variable Models Kanagawa, H., Jitkrittum, W., Mackey, L., Fukumizu, K., Gretton, A. Journal of the Royal Statistical Society Series B: Statistical Methodology, 85(3):986-1011, May 2023 (Published) arXiv DOI BibTeX

Social Foundations of Computation Conference Paper A Theory of Dynamic Benchmarks Shirali, A., Abebe, R., Hardt, M. In The Eleventh International Conference on Learning Representations (ICLR 2023) , May 2023 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper A law of adversarial risk, interpolation, and label noise Paleka, D., Sanyal, A. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Haptic Intelligence Miscellaneous AiroTouch: Naturalistic Vibrotactile Feedback for Telerobotic Construction-Related Tasks Gong, Y., Tashiro, N., Javot, B., Lauer, A. P. R., Sawodny, O., Kuchenbecker, K. J. Extended abstract (1 page) presented at the ICRA Workshop on Communicating Robot Learning across Human-Robot Interaction, London, UK, May 2023 (Published) BibTeX

Empirical Inference Article Better Together: Data Harmonization and Cross-StudAnalysis of Abdominal MRI Data From UK Biobank and the German National Cohort Gatidis, S., Kart, T., Fischer, M., Winzeck, S., Glocker, B., Bai, W., Bülow, R., Emmel, C., Friedrich, L., Kauczor, H., et al. Investigative Radiology, 58(5):346-354, May 2023 (Published) DOI BibTeX

Autonomous Learning Empirical Inference Conference Paper Bridging the Gap to Real-World Object-Centric Learning Seitzer, M., Horn, M., Zadaianchuk, A., Zietlow, D., Xiao, T., Simon-Gabriel, C., He, T., Zhang, Z., Schölkopf, B., Brox, T., et al. In Proceedings of the Eleventh International Conference on Learning Representations, The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) Code Website URL BibTeX

Empirical Inference Conference Paper Disentanglement of Correlated Factors via Hausdorff Factorized Support Roth, K., Ibrahim, M., Akata, Z., Vincent, P., Bouchacourt, D. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Autonomous Learning Conference Paper Efficient Learning of High Level Plans from Play Armengol Urpi, N., Bagatella, M., Hilliges, O., Martius, G., Coros, S. In International Conference on Robotics and Automation, 2023 (Accepted) Arxiv Website Poster BibTeX

Empirical Inference Article Estimating uncertainty in read-out patterns: Application to controls-based denoising and voxel-based morphometry patterns in neurodegenerative and neuropsychiatric diseases Blum, D., Hepp, T., Belov, V., Goya-Maldonado, R., la Fougère, C., Reimold, M. Human Brain Mapping, 44(7):2802-2814, May 2023 (Published) DOI BibTeX

Empirical Inference Conference Paper Flow Annealed Importance Sampling Bootstrap Midgley*, L. I., Stimper*, V., Simm, G. N. C., Schölkopf, B., Hernádez-Lobato, J. M. The Eleventh International Conference on Learning Representations (ICLR), May 2023, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Generalizing and Decoupling Neural Collapse via Hyperspherical Uniformity Gap Liu, W., Yu, L., Weller, A., Schölkopf, B. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Empirical Inference Conference Paper How robust is unsupervised representation learning to distribution shift? Shi, Y., Daunhawer, I., Vogt, J. E., Torr, P., Sanyal, A. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Physics for Inference and Optimization Article Hypergraphx: a library for higher-order network analysis Lotito, Q. F., Contisciani, M., De Bacco, C., Di Gaetano, L., Gallo, L., Montresor, A., Musciotto, F., Ruggeri, N., Battiston, F. Journal of Complex Networks, 11, May 2023 (Published) Preprint Code DOI BibTeX

Empirical Inference Conference Paper Identifiability Results for Multimodal Contrastive Learning Daunhawer, I., Bizeul, A., Palumbo, E., Marx, A., Vogt, J. E. The Eleventh International Conference on Learning Representations (ICLR), May 2023 (Published) URL BibTeX

Empirical Inference Conference Paper Investigating the Impact of Action Representations in Policy Gradient Algorithms Schneider, J., Schumacher, P., Häufle, D., Schölkopf, B., Büchler, D. Workshop on effective Representations, Abstractions, and Priors for Robot Learning (RAP4Robots) @ ICRA 2023, May 2023 (Published) arXiv Poster BibTeX

Empirical Inference Ph.D. Thesis Learning with and for discrete optimization Paulus, M. ETH Zurich, Switzerland, May 2023, CLS PhD Program (Published) BibTeX