Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Empirical Inference Conference Paper Interventions, Where and How? Experimental Design for Causal Models at Scale Tigas, P., Annadani, Y., Jesson, A., Schölkopf, B., Gal, Y., Bauer, S. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:24130-24143, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Invariance Learning in Deep Neural Networks with Differentiable Laplace Approximations Immer, A., van der Ouderaa, T. F. A., Rätsch, G., Fortuin, V., van der Wilk, M. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:12449-12463, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Learning Random Feature Dynamics for Uncertainty Quantification Agudelo-España, D., Nemmour, Y., Schölkopf, B., Zhu, J. 2022 IEEE 61st IEEE Conference on Decision and Control (CDC), 4937-4944, IEEE, 61st IEEE Conference on Decision and Control (CDC 2022), December 2022 (Published) PDF DOI URL BibTeX

Empirical Inference Autonomous Learning Conference Paper Learning with Muscles: Benefits for Data-Efficiency and Robustness in Anthropomorphic Tasks Wochner, I., Schumacher, P., Martius, G., Büchler, D., Schmitt, S., Haeufle, D. Proceedings of the 6th Conference on Robot Learning (CoRL), 205:1178-1188, Proceedings of Machine Learning Research, (Editors: Liu, Karen and Kulic, Dana and Ichnowski, Jeff), PMLR, December 2022 (Published) URL BibTeX

Empirical Inference Conference Paper Logical Fallacy Detection Jin, Z., Lalwani, A., Vaidhya, T., Shen, X., Ding, Y., Lyu, Z., Sachan, M., Mihalcea, R., Schölkopf, B. Findings of the Association for Computational Linguistics: EMNLP 2022, 7180-7198, (Editors: Goldberg, Yoav and Kozareva, Zornitsa and Zhang, Yue), Association for Computational Linguistics, The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP 2022) , December 2022 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Neural Attentive Circuits Weiss*, M., Rahaman*, N., Locatello, F., Pal, C., Bengio, Y., Schölkopf, B., Li, E. L., Ballas, N. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:7741-7754, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Optimal Binary Classification Beyond Accuracy Singh, S., Khim, J. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 18226-18240, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Posterior Refinement Improves Sample Efficiency in Bayesian Neural Networks Kristiadi, A., Eschenhagen, R., Hennig, P. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 30333-30346, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Posterior and Computational Uncertainty in Gaussian Processes Wenger, J., Pleiss, G., Pförtner, M., Hennig, P., Cunningham, J. P. Advances in Neural Information Processing Systems 35 , 10876-10890, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Probable Domain Generalization via Quantile Risk Minimization Eastwood, C., Robey, A., Singh, S., von Kügelgen, J., Hassani, H., Pappas, G. J., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:17340-17358, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022 (Published) arXiv URL BibTeX

Empirical Inference Proceedings Proceedings of the Second Workshop on NLP for Positive Impact (NLP4PI) Biester, L., Demszky, D., Jin, Z., Sachan, M., Tetreault, J., Wilson, S., Xiao, L., Zhao, J. Association for Computational Linguistics, December 2022 (Published) URL BibTeX

Empirical Inference Autonomous Learning Conference Paper Real Robot Challenge 2022: Learning Dexterous Manipulation from Offline Data in the Real World Gürtler, N., Widmaier, F., Sancaktar, C., Blaes, S., Kolev, P., Bauer, S., Wüthrich, M., Wulfmeier, M., Riedmiller, M., Allshire, A., Wang, Q., McCarthy, R., Kim, H., Baek, J., Kwon, W., Qian, S., Toshimitsu, Y., Michelis, M. Y., Kazemipour, A., Raayatsanati, A., et al. Proceedings of the NeurIPS 2022 Competitions Track, 220:133-150, Proceedings of Machine Learning Research, (Editors: Ciccone, Marco and Stolovitzky, Gustavo and Albrecht, Jacob), PMLR, December 2022 (Published) URL BibTeX

Empirical Inference Conference Paper Relational Proxies: Emergent Relationships as Fine-Grained Discriminators Chaudhuri, A., Mancini, M., Akata, Z., Dutta, A. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 31145-31157, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022 (Published) URL BibTeX

Empirical Inference Learning and Dynamical Systems Conference Paper Sampling without Replacement Leads to Faster Rates in Finite-Sum Minimax Optimization Das, A., Schölkopf, B., Muehlebach, M. Advances in Neural Information Processing Systems 35, 6749-6762, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), 36th Conference on Neural Information Processing Systems (NeurIPS 2022) , December 2022 (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Signal Propagation in Transformers: Theoretical Perspectives and the Role of Rank Collapse Noci*, L., Sotiris*, A., Biggio*, L., Orvieto*, A., Singh*, S. P., Lucchi, A. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:27198-27211, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Truncated Proposals for scalable and hassle-free simulation-based inference Deistler, M., Gonçalves*, P. J., Macke*, J. H. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 35:23135-23149, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems, December 2022, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper When to Make Exceptions: Exploring Language Models as Accounts of Human Moral Judgment Jin*, Z., Levine*, S., Gonzalez*, F., Kamal, O., Sap, M., Sachan, M., Mihalcea, R., Tenenbaum, J., Schölkopf, B. Advances in Neural Information Processing Systems 35 (NeurIPS 2022), 28458-28473, (Editors: S. Koyejo and S. Mohamed and A. Agarwal and D. Belgrave and K. Cho and A. Oh), Curran Associates, Inc., 36th Annual Conference on Neural Information Processing Systems (NeurIPS 2022), December 2022, *equal contribution (Published) arXiv URL BibTeX

Empirical Inference Conference Paper Cross-Modal Fusion Distillation for Fine-Grained Sketch-Based Image Retrieval Chaudhuri, A., Mancini, M., Chen, Y., Akata, Z., Dutta, A. 33rd British Machine Vision Conference (BMVC), BMVA Press, November 2022 (Published) PDF BibTeX

Empirical Inference Article Automated imaging-based abdominal organ segmentation and quality control in 20,000 participants of the UK Biobank and German National Cohort Studies Kart, T., Fischer, M., Winzeck, S., Glocker, B., Bai, W., Bülow, R., Emmel, C., Friedrich, L., Kauczor, H. U. K. T., Kröncke, T., Mayer, P., Niendorf, T., Peters, A., Pischon, T., Schaarschmidt, B. M., Schmidt, B., Schulze, M. B., Umutle, L., Völzke, H., Küstner, T., et al. Scientific Reports, 12(1):article no. 18733, November 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Distilling Knowledge from Self-Supervised Teacher by Embedding Graph Alignment Ma, Y., Chen, Y., Akata, Z. The 33rd British Machine Vision Conference Proceedings , BMVA Press, The 33rd British Machine Vision Conference (BMVC 2022) , November 2022 (Published) URL BibTeX

Empirical Inference Article Estimation of skeletal kinematics in freely moving rodents Monsees, A., Voit, K., Wallace, D. J., Sawinski, J., Charyasz, E., Scheffler, K., Macke, J. H., Kerr, J. N. D. Nature Methods, 19(11):1500-1509, November 2022 (Published) DOI BibTeX

Empirical Inference Article Quantifying the effects of contact tracing, testing, and containment measures in the presence of infection hotspots Lorch, L., Kremer, H., Trouleau, W., Tsirtsis, S., Szanto, A., Schölkopf, B., Gomez-Rodriguez, M. ACM Transactions on Spatial Algorithms and Systems, 8(4), November 2022 (Published) arXiv DOI URL BibTeX

Empirical Inference Conference Paper Temporal and cross-modal attention for audio-visual zero-shot learning Mercea, O., Hummel, T., Koepke, A. S., Akata, Z. Computer Vision - ECCV 2022 - 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XX, 13680:488-505, Lecture Notes in Computer Science, (Editors: Shai Avidan and Gabriel J. Brostow and Moustapha Cissé and Giovanni Maria Farinella and Tal Hassner), Springer, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) DOI BibTeX

Empirical Inference Article A Generative Model for Quasar Spectra Eilers, A., Hogg, D. W., Schölkopf, B., Foreman-Mackey, D., Davies, F. B., Schindler, J. The Astrophysical Journal, 938(1), The American Astronomical Society, October 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper A Non-isotropic Probabilistic Take on Proxy-based Deep Metric Learning Kirchhof, M., Roth, K., Akata, Z., Kasneci, E. Computer Vision - ECCV 2022 - 17th European Conference, Proceedings, Part XXVI, 13686:435-454, Lecture Notes in Computer Science, (Editors: Shai Avidan and Gabriel J. Brostow and Moustapha Cissé and Giovanni Maria Farinella and Tal Hassner), Springer, October 2022 (Published) DOI BibTeX

Haptic Intelligence Autonomous Learning Empirical Inference Miscellaneous A Soft Vision-Based Tactile Sensor for Robotic Fingertip Manipulation Andrussow, I., Sun, H., Kuchenbecker, K. J., Martius, G. Workshop paper (1 page) presented at the IROS Workshop on Large-Scale Robotic Skin: Perception, Interaction and Control, Kyoto, Japan, October 2022 (Published)
For robots to become fully dexterous, their hardware needs to provide rich sensory feedback. High-resolution haptic sensing similar to the human fingertip can enable robots to execute delicate manipulation tasks like picking up small objects, inserting a key into a lock, or handing a cup of coffee to a human. Many tactile sensors have emerged in recent years; one especially promising direction is vision-based tactile sensors due to their low cost, low wiring complexity and high-resolution sensing capabilities. In this work, we build on previous findings to create a soft fingertip-sized tactile sensor. It can sense normal and shear contact forces all around its 3D surface with an average prediction error of 0.05 N, and it localizes contact on its shell with an average prediction error of 0.5 mm. The software of this sensor uses a data-efficient machine-learning pipeline to run in real time on hardware with low computational power like a Raspberry Pi. It provides a maximum data frame rate of 60 Hz via USB.
URL BibTeX

Empirical Inference Article A whole-body FDG-PET/CT Dataset with manually annotated Tumor Lesions Gatidis, S., Hebb, T., Frueh, M., La Fougère, C., Nikolaou, K., Pfannenberg, C., Schölkopf, B., Kuestner, T., Cyran, C., Rubin, D. Scientific Data, 9, October 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Abstracting Sketches through Simple Primitives Alaniz, S., Mancini, M., Dutta, A., Marcos, D., Akata, Z. Computer Vision - ECCV 2022 - 17th European Conference, Proceedings, Part XXIX, 13689:396-412, Lecture Notes in Computer Science, (Editors: Shai Avidan and Gabriel J. Brostow and Moustapha Cissé and Giovanni Maria Farinella and Tal Hassner), Springer, October 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper BayesCap: Bayesian Identity Cap for Calibrated Uncertainty in Frozen Neural Networks Upadhyay, U., Karthik, S., Chen, Y., Mancini, M., Akata, Z. Computer Vision - ECCV 2022 - 17th European Conference, Proceedings, Part XII, 13672:299-317, Lecture Notes in Computer Science, (Editors: Shai Avidan and Gabriel J. Brostow and Moustapha Cissé and Giovanni Maria Farinella and Tal Hassner), Springer, October 2022 (Published) DOI BibTeX

Empirical Inference Article Sample-Efficient Policy Adaptation for Exoskeletons Under Variations in the Users and the Environment Shahrokhshahi, A., Khadiv, M., Taherifar, A., Mansouri, S., Park, E. J., Arzanpour, S. IEEE Robotics and Automation Letters, 7(4):9020-9027, October 2022 (Published) DOI BibTeX

Empirical Inference Article Self-supervised learning for automated anatomical tracking in medical image data with minimal human labeling effort Frueh, M., Kuestner, T., Nachbar, M., Thorwarth, D., Schilling, A., Gatidis, S. Computer Methods and Programs in Biomedicine, 225:107085, October 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Structural Causal 3D Reconstruction Liu, W., Liu, Z., Paull, L., Weller, A., Schölkopf, B. Computer Vision - ECCV 2022 - 17th European Conference, Proceedings, Part I, 13661:140-159, Lecture Notes in Computer Science, (Editors: Shai Avidan and Gabriel J. Brostow and Moustapha Cissé and Giovanni Maria Farinella and Tal Hassner), Springer, October 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Adversarial Robustness of MR Image Reconstruction Under Realistic Perturbations Morshuis, J. N., Gatidis, S. A. H. M., Baumgartner, C. F. Machine Learning for Medical Image Reconstruction (MLMIR 2022) , 13587:24-33, Lecture Notes in Computer Science, (Editors: Haq, Nandinee and Johnson, Patricia and Maier, Andreas and Qin, Chen and Würfl, Tobias and Yoo, Jaejun), Springer International Publishing, 5th International Workshop on Machine Learning for Medical Image Reconstruction (MLMIR 2022) , September 2022 (Published) DOI BibTeX

Empirical Inference Conference Paper Any-Shot GIN: Generalizing Implicit Networks for Reconstructing Novel Classes Xian, Y., Chibane, J., Bhatnagar, B. L., Schiele, B., Akata, Z., Pons-Moll, G. International Conference on 3D Vision (3DV), 526-535, September 2022 (Published) DOI URL BibTeX

Empirical Inference Article Causal Feature Selection via Orthogonal Search Soleymani*, A., Raj*, A., Bauer, S., Schölkopf, B., Besserve, M. Transactions on Machine Learning Research, September 2022, *equal contribution (Published) URL BibTeX

Empirical Inference Talk Causality, causal digital twins, and their applications Schölkopf, B. Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling (Dagstuhl Seminar 22382), (Editors: Berens, Philipp and Cranmer, Kyle and Lawrence, Neil D. and von Luxburg, Ulrike and Montgomery, Jessica), September 2022 (Published) DOI URL BibTeX

Empirical Inference Article Energy-efficient network activity from disparate circuit parameters Deistler, M., Macke, J. H., Gonçalves, P. J. Proceedings of the National Academy of Sciences, 119(44), September 2022 (Published) DOI BibTeX

Empirical Inference Master Thesis Independent Mechanism Analysis for High Dimensions Sliwa, J. University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (Published) BibTeX

Empirical Inference Conference Paper Can Large Language Models Distinguish Cause from Effect? Lyu, Z., Jin, Z., Mihalcea, R., Sachan, M., Schölkopf, B. UAI 2022 Workshop on Causal Representation Learning, August 2022 (Published) URL BibTeX

Empirical Inference Conference Paper Learning soft interventions in complex equilibrium systems Besserve, M., Schölkopf, B. Proceedings of the Thirty-Eighth Conference on Uncertainty in Artificial Intelligence, 180:170-180, Proceedings of Machine Learning Research, (Editors: Cussens, James and Zhang, Kun), PMLR, The 38th Conference on Uncertainty in Artificial Intelligence (UAI 2022) , August 2022 (Published) URL BibTeX