Institute Homepage
Institute Homepage DE Sign In

Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation

Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group

Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award

Haptic Intelligence Ph.D. Thesis Creating a Haptic Empathetic Robot Animal That Feels Touch and Emotion Burns, R. B. University of Tübingen, Tübingen, Germany, February 2024, Department of Computer Science (Published) BibTeX
Empirical Inference Ph.D. Thesis Identifiable Causal Representation Learning: Unsupervised, Multi-View, and Multi-Environment von Kügelgen, J. University of Cambridge, UK, Cambridge, February 2024, (Cambridge-Tübingen-Fellowship) (Published) URL BibTeX
Empirical Inference Conference Paper Inferring Atmospheric Properties of Exoplanets with Flow Matching and Neural Importance Sampling Gebhard, T. D., Wildberger, J., Dax, M., Angerhausen, D., Quanz, S. P., Schölkopf, B. 3rd Annual AAAI Workshop on AI to Accelerate Science and Engineering (AI2ASE), February 2024 (Published) arXiv URL BibTeX
Empirical Inference Ph.D. Thesis Methods for Generative Modeling and Interpretable Classification with Strong Differential Privacy Harder, F. University of Tübingen, Germany, February 2024, IMPRS-PhD-Program (Published) URL BibTeX
Empirical Inference Article Network propagation for GWAS analysis: a practical guide to leveraging molecular networks for disease gene discovery Visonà, G., Bouzigon, E., Demenais, F., Schweikert, G. Briefings in Bioinformatics, 25(2), January 2024 (Published) DOI BibTeX
Empirical Inference Article Trained recurrent neural networks develop phase-locked limit cycles in a working memory task Pals, M., Macke, J. H., Barak, O. PLOS Computational Biology, 20(2), February 2024 (Published) DOI BibTeX
Haptic Intelligence Robotics Article IMU-Based Kinematics Estimation Accuracy Affects Gait Retraining Using Vibrotactile Cues Rokhmanova, N., Pearl, O., Kuchenbecker, K. J., Halilaj, E. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 32:1005-1012, February 2024 (Published) DOI BibTeX
Perceiving Systems Conference Paper Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion Chhatre, K., Daněček, R., Athanasiou, N., Becherini, G., Peters, C., Black, M. J., Bolkart, T. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 1942-1953, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition, January 2024 (Published) Project Paper Code DOI URL BibTeX
Physical Intelligence Article Hierarchical Nanostructures as Acoustically Manipulatable Multifunctional Agents in Dynamic Fluid Flow Kim, D. W., Wrede, P., Estrada, H., Yildiz, E., Lazovic, J., Bhargava, A., Razansky, D., Sitti, M. Advanced Materials, 36(50), January 2024 (Published) DOI URL BibTeX
Haptic Intelligence Miscellaneous Adapting a High-Fidelity Simulation of Human Skin for Comparative Touch Sensing in the Elephant Trunk Schulz, A., Serhat, G., Kuchenbecker, K. J. 64(Supplement_1):S458-S459, Abstract presented at the Society for Integrative and Comparative Biology Annual Meeting (SICB), Seattle, USA, January 2024 (Published) DOI BibTeX
Perceiving Systems Conference Paper Adversarial Likelihood Estimation With One-Way Flows Ben-Dov, O., Gupta, P. S., Abrevaya, V., Black, M. J., Ghosh, P. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 3779-3788, January 2024 (Published) pdf arXiv BibTeX
Social Foundations of Computation Algorithms and Society Conference Paper Causal Inference out of Control: Estimating Performativity without Treatment Randomization Cheng, G., Hardt, M., Mendler-Dünner, C. In Proceedings of the 41st International Conference on Machine Learning (ICML 2024), PMLR, The Forty-First International Conference on Machine Learning (ICML), January 2024 (Published) ArXiv URL BibTeX
Haptic Intelligence Article How Should Robots Exercise with People? Robot-Mediated Exergames Win with Music, Social Analogues, and Gameplay Clarity Fitter, N. T., Mohan, M., Preston, R. C., Johnson, M. J., Kuchenbecker, K. J. Frontiers in Robotics and AI, 10(1155837):1-18, January 2024 (Published) DOI BibTeX
Perceiving Systems Conference Paper Human Hair Reconstruction with Strand-Aligned 3D Gaussians Zakharov, E., Sklyarova, V., Black, M. J., Nam, G., Thies, J., Hilliges, O. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, January 2024 (Published) pdf project code video arXiv DOI URL BibTeX
Empirical Inference Conference Paper Multi-channel free space optical convolutions with incoherent light Song, A., Kottapalli, S. N. M., Schölkopf, B., Fischer, P. AI and Optical Data Sciences V, PC12903:PC129030I, (Editors: Ken-ichi Kitayama and Volker J. Sorger), SPIE, January 2024 (Published) DOI BibTeX
Empirical Inference Optics and Sensing Laboratory Conference Paper Polarization-based non-linear deep diffractive neural networks Kottapalli, S. N. M., Schlieder, L., Song, A., Volchkov, V., Schölkopf, B., Fischer, P. AI and Optical Data Sciences V, PC12903:PC129030B, (Editors: Ken-ichi Kitayama and Volker J. Sorger), SPIE, January 2024 (Published) DOI BibTeX
Empirical Inference Article Pre-treatment 18F-FDG-PET/CT parameters as biomarkers for progression free survival, best overall response and overall survival in metastatic melanoma patients undergoing first-line immunotherapy Peisen, F., Gerken, A., Dahm, I., Nikolaou, K., Eigentler, T., Amaral, T., Moltz, J. H., Othman, A. E., Gatidis, S. PLOS ONE, 19(1), January 2024 (Published) DOI BibTeX
Haptic Intelligence Article Robust Surface Recognition With the Maximum Mean Discrepancy: Degrading Haptic-Auditory Signals Through Bandwidth and Noise Khojasteh, B., Shao, Y., Kuchenbecker, K. J. IEEE Transactions on Haptics, 17(1):58-65, January 2024, Presented at the IEEE Haptics Symposium (Published) DOI BibTeX
Empirical Inference Article Towards fully covariant machine learning Villar, S., Hogg, D. W., Yao, W., Kevrekidis, G. A., Schölkopf, B. Transactions on Machine Learning Research, January 2024 (Published) URL BibTeX
Haptic Intelligence Materials Miscellaneous Whiskers That Don’t Whisk: Unique Structure From the Absence of Actuation in Elephant Whiskers Schulz, A., Kaufmann, L., Brecht, M., Richter, G., Kuchenbecker, K. J. 64(Supplement_1):S459, Abstract presented at the Society for Integrative and Comparative Biology Annual Meeting (SICB), Seattle, USA, January 2024 (Published) DOI BibTeX
Haptic Intelligence Miscellaneous MPI-10: Haptic-Auditory Measurements from Tool-Surface Interactions Khojasteh, B., Shao, Y., Kuchenbecker, K. J. Dataset published as a companion to the journal article "Robust Surface Recognition with the Maximum Mean Discrepancy: Degrading Haptic-Auditory Signals through Bandwidth and Noise" in IEEE Transactions on Haptics, January 2024 (Published) DOI BibTeX
Perceiving Systems Conference Paper A Unified Approach for Text- and Image-guided 4D Scene Generation Zheng, Y., Li, X., Nagano, K., Liu, S., Hilliges, O., Mello, S. D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 7300-7309, Piscataway, NJ, CVPR, 9 2024 (Published) paper project code DOI URL BibTeX
Perceiving Systems Conference Paper Generative Proxemics: A Prior for 3D Social Interaction from Images Müller, L., Ye, V., Pavlakos, G., Black, M., Kanazawa, A. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 9687-9697, Piscataway, NJ, CVPR, 9 2024 (Published) arXiv project code data DOI URL BibTeX
Empirical Inference Conference Paper GraphDreamer: Compositional 3D Scene Synthesis from Scene Graphs Gao, G., Liu, W., Chen, A., Geiger, A., Schölkopf, B. IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 21295-21304, IEEE, Piscataway, NJ, CVPR, 9 2024 (Published) DOI URL BibTeX
Perceiving Systems Conference Paper Real-time Monocular Full-body Capture in World Space via Sequential Proxy-to-Motion Learning Zhang, H., Zhang, Y., Hu, L., Zhang, J., Yi, H., Zhang, S., Liu, Y. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 1954 - 1964, Piscataway, NJ , CVPR, 9 2024 (Published) arxiv project DOI URL BibTeX
Perceiving Systems Neural Capture and Synthesis Human-centric Vision & Learning Conference Paper Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 4703-4712, Piscataway, NJ, CVPR, 9 2024 (Published) ArXiv Code DOI URL BibTeX
Perceiving Systems Conference Paper ChatPose: Chatting about 3D Human Pose Feng, Y., Lin, J., Dwivedi, S. K., Sun, Y., Patel, P., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2093-2103, Piscataway, NJ, CVPR, 9 2024 (Published) Arxiv Project DOI URL BibTeX
Perceiving Systems Conference Paper EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling Liu, H., Zhu, Z., Becherini, G., Peng, Y., Su, M., Zhou, Y., Zhe, X., Iwamoto, N., Zheng, B., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 1144-1154, Piscataway, NJ, CVPR, 9 2024 (Published) arXiv project dataset code gradio colab video DOI URL BibTeX
Perceiving Systems Conference Paper HIT: Estimating Internal Human Implicit Tissues from the Body Surface Keller, M., Arora, V., Dakri, A., Chandhok, S., Machann, J., Fritsche, A., Black, M. J., Pujades, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 3480-3490, Piscataway, NJ, CVPR, 9 2024 (Published) Project page Paper DOI URL BibTeX
Perceiving Systems Conference Paper HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video Fan, Z., Parelli, M., Kadoglou, M. E., Kocabas, M., Chen, X., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 494-504, Piscataway, NJ, CVPR, 9 2024 (Published) Paper Project Code DOI URL BibTeX
Perceiving Systems Conference Paper HUGS: Human Gaussian Splats Kocabas, M., Chang, R., Gabriel, J., Tuzel, O., Ranjan, A. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 505-515, Piscataway, NJ, CVPR, 9 2024 (Published) arXiv Github Project Page YouTube Poster DOI URL BibTeX
Perceiving Systems Conference Paper SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes Sanyal, S., Ghosh, P., Yang, J., Black, M. J., Thies, J., Bolkart, T. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2362-2371, Piscataway, NJ, CVPR, 9 2024 (Published) Project page Data Code Video Arxiv DOI URL BibTeX
Perceiving Systems Conference Paper SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis Retsinas, G., Filntisis, P. P., Danecek, R., Abrevaya, V. F., Roussos, A., Bolkart, T., Maragos, P. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2490-2501, Piscataway, NJ, CVPR, 9 2024 (Published) arxiv project code DOI URL BibTeX
Perceiving Systems Conference Paper VAREN: Very Accurate and Realistic Equine Network Zuffi, S., Mellbin, Y., Li, C., Hoeschle, M., Kjellstrom, H., Polikovsky, S., Hernlund, E., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 5374-5383, Piscataway, NJ, CVPR, 9 2024 (Published) project page paper DOI URL BibTeX
Perceiving Systems Conference Paper WANDR: Intention-guided Human Motion Generation Diomataris, M., Athanasiou, N., Taheri, O., Wang, X., Hilliges, O., Black, M. J. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 927-936, IEEE Computer Society, Piscataway, NJ, CVPR, 9 2024 (Published) project website arXiv YouTube Video Code CVF DOI URL BibTeX
Perceiving Systems Conference Paper WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion Shin, S., Kim, J., Halilaj, E., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), 2070-2080, Piscataway, NJ, CVPR, 9 2024 (Published) arXiv project code DOI URL BibTeX
Perceiving Systems Ph.D. Thesis Self- and Interpersonal Contact in 3D Human Mesh Reconstruction Müller, L. University of Tübingen, Tübingen, March 2024 (Published) download Thesis DOI BibTeX
Embodied Vision Conference Paper Online Calibration of a Single-Track Ground Vehicle Dynamics Model by Tight Fusion with Visual-Inertial Odometry Li, H., Stueckler, J. In 2024 IEEE International Conference on Robotics and Automation (ICRA 2024) , 1631-1637, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA 2024), 8 2024 (Published) preprint supplemental video code datasets DOI URL BibTeX
Learning and Dynamical Systems Conference Paper Subgroup-Specific Risk-Controlled Dose Estimation in Radiotherapy Fischer, P., Willms, H., Muehlebach, M., Thorwarth, D., Schneider, M., Baumgartner, C. Medical Image Computing and Computer Assisted Intervention - MICCAI 2024 , 696-706, Springer, Cham, 27th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI 2024), 10 2024 (Published) DOI URL BibTeX
Perceiving Systems Conference Paper On predicting 3D bone locations inside the human body Dakri, A., Arora, V., Challier, L., Keller, M., Black, M. J., Pujades, S. In Medical Image Computing and Computer Assisted Intervention - MICCAI 2024, 336-346, Springer, Cham, 27th International Conference on Medical Image Computing and Computer assisted Intervention (MICCAI 2024) , 10 2024 (Published) Project page DOI URL BibTeX
Learning and Dynamical Systems Article A Pontryagin Perspective on Reinforcement Learning Eberhard, O., Vernade, C., Muehlebach, M. Learning for Dynamics and Control Conference, 2024 (Submitted) URL BibTeX
Physical Intelligence Article A simple quantitative model of neuromodulation, Part I: Ion flow through neural ion channels Werneck, L., Han, M., Yildiz, E., Keip, M., Sitti, M., Ortiz, M. Journal of the Mechanics and Physics of Solids, 182:105457, 2024 (Published) DOI BibTeX
Learning and Dynamical Systems Article Accelerated First-Order Optimization under Nonlinear Constraints Muehlebach, M., Jordan, M. I. Mathematical Programming, 2024 (Submitted) URL BibTeX
Materials Article Adsorption on Inkjet-Printable Polyelectrolyte Hydrogels Allows Refractive Index Sensing of Diclofenac and Metoprolol in Aqueous Solution Southan, A., Tan, J., Schuster, F., Rotenberger, J., Tovar, G. E. M. ACS Applied Polymer Materials, 6(10):6010-6021, 2024 (Published) pdf DOI URL BibTeX
Embodied Vision Conference Paper Analytical Uncertainty-Based Loss Weighting in Multi-Task Learning Kirchdorfer, L., Elich, C., Kutsche, S., Stuckenschmidt, H., Schott, L., Köhler, J. M. In Proceedings of the German Conference on Pattern Recognition (GCPR), 2024, to appear (To be published) BibTeX
Physical Intelligence Article Artificial-goosebump-driven microactuation Zhang, M., Pal, A., Lyu, X., Wu, Y., Sitti, M. Nature Materials, 23(23):560-569, 2024 (Published) DOI URL BibTeX
Embodied Vision Article Attention Normalization Impacts Cardinality Generalization in Slot Attention Krimmel, M., Achterhold, J., Stueckler, J. In Transactions on Machine Learning Research (TMLR), 2024 (Published) preprint video source code URL BibTeX
Learning and Dynamical Systems Article Balancing a 3D Inverted Pendulum using Remote Magnetic Manipulation Zughaibi, J., Nelson, B. J., Muehlebach, M. Robotics and Automation Letters, 2024 (In revision) URL BibTeX
Physical Intelligence Article Capillary trapping of various nanomaterials on additively manufactured scaffolds for 3D micro-/nanofabrication Lyu, X., Zheng, Z., Shiva, A., Han, M., Dayan, C. B., Zhang, M., Sitti, M. Nature Communications, 15(15):6693, 2024 (Published) DOI BibTeX
Physical Intelligence Article Clinical translation of wireless soft robotic medical devices Wang, T., Wu, Y., Yildiz, E., Kanyas, S., Sitti, M. Nature Reviews Bioengineering, 2024 (Published) DOI BibTeX