Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Haptic Intelligence Master Thesis Wrist-Worn Pressure Pulses for Phantom Directional Cues in VR Kadmani, A. Technical University of Munich, Munich, Germany, September 2025, M.Sc. in Electrical Engineering and Information Technology (Published)
Haptic feedback in today's VR systems is often limited to vibration delivered through handheld controllers, leaving a gap for compact devices that can convey spatial cues without occupying the hands. This thesis presents the design and evaluation of SuperCUTE, a wrist-worn pressure feedback device that uses four soft electrohydraulic actuators to elicit phantom tactile sensations around the wrist. The device was evaluated with n = 20 participants in a user study comprising two tasks. In Task 1 (circular GUI), single-actuator cues produced tightly clustered responses (median resultant length R = 0.92); about 70% of trials fell within ± 22.5° of the stimulated cardinal. Adjacent-actuator pairs yielded in-between percepts (about 70% of reports), and intensity imbalance shifted perceived location toward the stronger actuator; reported intensity was higher for strong than weak drives (mean 0.76 vs. 0.32). Across cues, Rayleigh tests indicated strong clustering of response angles (median R ≈ 0.82). In Task 2 (VR), hand trajectories during 5 s cues aligned with cue geometry; end-directions showed strong clustering (median R ≈ 0.78), and latency estimated from a 1 cm displacement threshold had a median of 1.25 s (IQR 0.61 s). Questionnaire responses indicated clear, comfortable, and usable cues. Overall, pressure pulses are a feasible approach for directional wrist cues in VR. We provide device documentation, datasets, and analysis code to support pressure-based wearable haptics.
BibTeX

Haptic Intelligence Master Thesis Diffusion Models for Fast and Accurate Approximate Model Predictive Control Marquez Julbe, P. Eindhoven University of Technology, Eindhoven, the Netherlands, December 2024, Master of Science in Systems and Control (Published)
Model predictive control (MPC) is a powerful control and planning framework for a large class of problems, yet its practical application remains limited by computational demands. While previous efforts have focused on approximating MPC with explicit representations for high-frequency real-time deployment, handling complex MPC formulations with multiple local optima or set-valued global optima remains an open challenge in practice. This thesis explores the use of diffusion models for approximate MPC, enabling their application in such scenarios with low computational time. We introduce a novel diffusion-based approximator capable of accurately modeling multi-modal out- put distributions, while achieving computation times under 2.5 ms, allowing users to efficiently sample multiple feasible and locally optimal solutions with no additional computational overhead. Our method is quantitatively compared with traditional least-squares regression models, demonstrating significant improvements. Experimental validation is performed on a 7-DOF KUKA LBR4+ robotic arm operating at 250 Hz, confirming the benefits of our approach and providing insights into high-frequency neural control. Additionally, we examine diffusion model sampling strategies, leveraging their unique properties to ensure feasible and smooth closed-loop operation. As part of this work, we release a general software framework for data collection using optimal control policies in the photo-realistic simulator Isaac Lab. The framework includes multi-processing tools for CPU-based controllers and supports training and evaluating neural controllers, including diffusion models such as DDPM and traditional least-squares regression.
BibTeX

Haptic Intelligence Master Thesis Estimating Contact Forces Across Soft Capacitive Tactile Sensors Using Machine Learning Tiwari, A. Saarland University, Saarbrücken, Germany, July 2024, M.Sc. in Embedded Systems (Published)
Robots have become an essential part of the modern world, playing a crucial role in applications from manufacturing to healthcare. Despite significant advancements, the operational range of robots remains relatively narrow, often limited to controlled environments and simple, predetermined tasks. Tactile sensors show promise in broadening this range by enhancing a robot's performance in fine manipulation tasks. These sensors enable robots to perceive contact, providing a more nuanced understanding of their environment in real time. The challenge, however, lies in deriving meaningful and interpretable insights from these sensors, such as contact location and force, which are crucial for dexterous manipulation tasks. To address this challenge, this thesis develops machine learning-based software that achieves precise real-time contact location and force sensing across the entire surface of a grid-based soft capacitive tactile sensor, enabling rapid and straightforward deployment and facilitating transferability to other sensor instances, all while retaining the advantageous attributes of capacitance technology. Machine learning models were trained using data captured by indenting the sensor surface and measuring the sensor responses and the applied normal forces. Convolutional neural networks (CNNs) were selected for their low prediction errors in contact force estimation with the collected dataset. Two distinct models were developed: one for estimating contact forces at a single point and another for estimating normal force distributions. The transferability of the trained models across different sensor instances was evaluated and improved. The single point contact force estimation model's practical utility was demonstrated through real-time closed-loop control of a Franka Emika Panda robot arm through two specific tasks: tactile servoing in 1D and active object centering in 2D. This research contributes to enhancing the accessibility of soft tactile sensors in robotic applications through machine learning and demonstrates that this approach can improve the capabilities of tactile sensors.
BibTeX

Empirical Inference Master Thesis Algorithmic Compositional Learning of Language Models Thomm, J. ETH Zurich, Switzerland, April 2024 (Published) BibTeX

Empirical Inference Master Thesis Denoising Representation Learning for Causal Discovery Sakenyte, U. Université de Genèva, Switzerland, December 2023, external supervision (Published) BibTeX

Empirical Inference Master Thesis Efficient Sampling from Differentiable Matrix Elements Kofler, A. Technical University of Munich, Germany, September 2023 (Published) BibTeX

Empirical Inference Master Thesis Towards Generative Machine Teaching Qui, Z. Technical University of Munich, Germany, February 2023 (Published) BibTeX

Empirical Inference Master Thesis ArchiSound: Audio Generation with Diffusion Schneider, F. ETH Zurich, Switzerland, January 2023, external supervision (Published) BibTeX

Empirical Inference Master Thesis Independent Mechanism Analysis for High Dimensions Sliwa, J. University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (Published) BibTeX

Haptic Intelligence Master Thesis Robotic Surgery Training in AR: Multimodal Record and Replay Krauthausen, F. University of Stuttgart, Stuttgart, Germany, May 2021, Study Program in Software Engineering (Published) BibTeX

Master Thesis Optimal allocation of attention in a signal detection task Chebolu, S. Indian Institute of Science Education and Research, Pune, 2021 BibTeX

Empirical Inference Master Thesis Learning Algorithms, Invariances, and the Real World Zecevic, M. Technical University of Darmstadt, Germany, April 2020 (Published) BibTeX