Publications | Max Planck Institute for Intelligent Systems

2023

Fairness in Machine Learning: Limitations and Opportunities

Barocas, S., Hardt, M., Narayanan, A.

MIT Press, December 2023 (book)

Abstract

An introduction to the intellectual foundations and practical utility of the recent work on fairness and machine learning. Fairness and Machine Learning introduces advanced undergraduate and graduate students to the intellectual foundations of this recently emergent field, drawing on a diverse range of disciplinary perspectives to identify the opportunities and hazards of automated decision-making. It surveys the risks in many applications of machine learning and provides a review of an emerging set of proposed solutions, showing how even well-intentioned applications may give rise to objectionable results. It covers the statistical and causal measures used to evaluate the fairness of machine learning models as well as the procedural and substantive aspects of decision-making that are core to debates about fairness, including a review of legal and philosophical perspectives on discrimination. This incisive textbook prepares students of machine learning to do quantitative work on fairness while reflecting critically on its foundations and its practical utility.• Introduces the technical and normative foundations of fairness in automated decision-making• Covers the formal and computational methods for characterizing and addressing problems• Provides a critical assessment of their intellectual foundations and practical utility• Features rich pedagogy and extensive instructor resources

2023

sf Barocas, S., Hardt, M., Narayanan, A. Fairness in Machine Learning: Limitations and Opportunities MIT Press, December 2023 (book)

Denoising Representation Learning for Causal Discovery

Sakenyte, U.

Université de Genèva, Switzerland, December 2023, external supervision (mastersthesis)

ei Sakenyte, U. Denoising Representation Learning for Causal Discovery Université de Genèva, Switzerland, December 2023, external supervision (mastersthesis)

Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures

Jenny, D.

ETH Zurich, Switzerland, November 2023, external supervision (thesis)

ei Jenny, D. Navigating the Ocean of Biases: Political Bias Attribution in Language Models via Causal Structures ETH Zurich, Switzerland, November 2023, external supervision (thesis)

Hydraulically Amplified Self-healing Electrostatic Actuators

Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K.

(US Patent 11795979B2), October 2023 (patent)

Abstract

An electro-hydraulic actuator includes a deformable shell defining an enclosed internal cavity and containing a liquid dielectric, first and second electrodes on first and second sides, respectively, of the enclosed internal cavity. An electrostatic force between the first and second electrodes upon application of a voltage to one of the electrodes draws the electrodes towards each other to displace the liquid dielectric within the enclosed internal cavity. The shell includes active and inactive areas such that the electrostatic forces between the first and second electrodes displaces the liquid dielectric within the enclosed internal cavity from the active area of the shell to the inactive area of the shell. The first and second electrodes, the deformable shell, and the liquid dielectric cooperate to form a self-healing capacitor, and the liquid dielectric is configured for automatically filling breaches in the liquid dielectric resulting from dielectric breakdown.

rm Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K. Hydraulically Amplified Self-healing Electrostatic Actuators (US Patent 11795979B2), October 2023 (patent)

Efficient Sampling from Differentiable Matrix Elements

Kofler, A.

Technical University of Munich, Germany, September 2023 (mastersthesis)

ei Kofler, A. Efficient Sampling from Differentiable Matrix Elements Technical University of Munich, Germany, September 2023 (mastersthesis)

High Strain Peano Hydraulically Amplified Self-Healing Electrostatic (HASEL) Transducers

Keplinger, C. M., Wang, X., Mitchell, S. K.

(US Patent App. 18/138,621), August 2023 (patent)

Abstract

High strain hydraulically amplified self-healing electrostatic transducers having increased maximum theoretical and practical strains are disclosed. In particular, the actuators include electrode configurations having a zipping front created by the attraction of the electrodes that is configured orthogonally to a strain axis along which the actuators. This configuration produces increased strains. In turn, various form factors for the actuator configuration are presented including an artificial circular muscle and a strain amplifying pulley system. Other actuator configurations are contemplated that include independent and opposed electrode pairs to create cyclic activation, hybrid electrode configurations, and use of strain limiting layers for controlled deflection of the actuator.

rm Keplinger, C. M., Wang, X., Mitchell, S. K. High Strain Peano Hydraulically Amplified Self-Healing Electrostatic (HASEL) Transducers (US Patent App. 18/138,621), August 2023 (patent)

Capacitive Self-Sensing for Electrostatic Transducers with High Voltage Isolation

Correll, N., Ly, K. D., Kellaris, N. A., Keplinger, C. M.

(US Patent App. 17/928,453), June 2023 (patent)

Abstract

Transducer systems disclosed herein include self-sensing capabilities. In particular, electrostatic transducers include a low voltage electrode and a high voltage electrode. A low voltage sensing unit is coupled with the low voltage electrode of the electrostatic transducer. The low voltage sensing unit is configured to measure a capacitance of the electrostatic transducer, from which displacement of the electrostatic transducer may be calculated. High voltage drive signals received by the high voltage electrode during actuation may be isolated from the low voltage sensing unit. The isolation may be provided by dielectric material of the electrostatic transducer, a voltage suppression component, and/or a voltage suppression module comprising a low impedance ground path. In the event of an electrical failure of the transducer, the low voltage sensing unit may be isolated from high voltages.

rm Correll, N., Ly, K. D., Kellaris, N. A., Keplinger, C. M. Capacitive Self-Sensing for Electrostatic Transducers with High Voltage Isolation (US Patent App. 17/928,453), June 2023 (patent)

High Strain Peano Hydraulically Amplified Self-healing Electrostatic (HASEL) Transducers

Keplinger, C. M., Wang, X., Mitchell, S. K.

(US Patent 11635094), April 2023 (patent)

Abstract

rm Keplinger, C. M., Wang, X., Mitchell, S. K. High Strain Peano Hydraulically Amplified Self-healing Electrostatic (HASEL) Transducers (US Patent 11635094), April 2023 (patent)

Intrinsic complexity and mechanisms of expressivity of cortical neurons

Spieler, A. M.

University of Tübingen, Germany, March 2023 (mastersthesis)

ei Spieler, A. M. Intrinsic complexity and mechanisms of expressivity of cortical neurons University of Tübingen, Germany, March 2023 (mastersthesis)

CausalEffect Estimation by Combining Observational and Interventional Data

Kladny, K.

ETH Zurich, Switzerland, February 2023 (mastersthesis)

lds ei

lds ei Kladny, K. CausalEffect Estimation by Combining Observational and Interventional Data ETH Zurich, Switzerland, February 2023 (mastersthesis)

Towards Generative Machine Teaching

Qui, Z.

Technical University of Munich, Germany, February 2023 (mastersthesis)

ei Qui, Z. Towards Generative Machine Teaching Technical University of Munich, Germany, February 2023 (mastersthesis)

ArchiSound: Audio Generation with Diffusion

Schneider, F.

ETH Zurich, Switzerland, January 2023, external supervision (mastersthesis)

ei Schneider, F. ArchiSound: Audio Generation with Diffusion ETH Zurich, Switzerland, January 2023, external supervision (mastersthesis)

Generation and Quantification of Spin in Robot Table Tennis

Dittrich, A.

University of Stuttgart, Germany, January 2023 (mastersthesis)

ei Dittrich, A. Generation and Quantification of Spin in Robot Table Tennis University of Stuttgart, Germany, January 2023 (mastersthesis)

Tube-shaped robotic device with anisotropic surface structure

Wang, T., Hu, W., Sitti, M.

2023, US Patent App. 18/133,104 (patent)

pi Wang, T., Hu, W., Sitti, M. Tube-shaped robotic device with anisotropic surface structure 2023, US Patent App. 18/133,104 (patent)

Carrier, use of a carrier, method of activating a carrier and method of making a carrier

Drotlef, D., Sitti, M., Amjadi, M.

2023, US Patent App. 16/500,442 (patent)

pi Drotlef, D., Sitti, M., Amjadi, M. Carrier, use of a carrier, method of activating a carrier and method of making a carrier 2023, US Patent App. 16/500,442 (patent)

Microfibers with mushroom-shaped tips for optimal adhesion

Sitti, M., Aksak, B.

2023, US Patent 11,613,674 (patent)

pi Sitti, M., Aksak, B. Microfibers with mushroom-shaped tips for optimal adhesion 2023, US Patent 11,613,674 (patent)

Method of fabricating a magnetic deformable machine and deformable 3D magnetic machine

Zhang, J., Ren, Z., Hu, W., Sitti, M.

2023, US Patent App. 18/020,161 (patent)

pi Zhang, J., Ren, Z., Hu, W., Sitti, M. Method of fabricating a magnetic deformable machine and deformable 3D magnetic machine 2023, US Patent App. 18/020,161 (patent)

Magnetic trap system and method of navigating a microscopic device

Son, D., Ugurlu, M., Bluemer, P., Sitti, M.

2023, US Patent App. 17/871,598 (patent)

pi Son, D., Ugurlu, M., Bluemer, P., Sitti, M. Magnetic trap system and method of navigating a microscopic device 2023, US Patent App. 17/871,598 (patent)

A Liquid Repellent Fibrillar Dry Adhesive Material and a Method of Producing the Same

Sitti, M., Drotlef, D., Liimatainen, V.

2023, US Patent App. 17/785,452 (patent)

pi Sitti, M., Drotlef, D., Liimatainen, V. A Liquid Repellent Fibrillar Dry Adhesive Material and a Method of Producing the Same 2023, US Patent App. 17/785,452 (patent)

Simultaneous calibration method for magnetic localization and actuation systems

Sitti, M., Son, D., Dong, X.

2023, US Patent 11,717,142 (patent)

pi Sitti, M., Son, D., Dong, X. Simultaneous calibration method for magnetic localization and actuation systems 2023, US Patent 11,717,142 (patent)

Dry adhesives and methods for making dry adhesives

M Sitti, M. M. B. A.

2023, US Patent 11,773,298, 2023 (patent)

pi M Sitti, M. M. B. A. Dry adhesives and methods for making dry adhesives 2023, US Patent 11,773,298, 2023 (patent)

2022

DRY ADHESIVES AND METHODS FOR MAKING DRY ADHESIVES

Metin Sitti, Michael Murphy, Burak Aksak

December 2022, US Patent App. 17/895,334, 2022 (patent)

2022

pi Metin Sitti, Michael Murphy, Burak Aksak DRY ADHESIVES AND METHODS FOR MAKING DRY ADHESIVES December 2022, US Patent App. 17/895,334, 2022 (patent)

Hydraulically Amplified Self-healing Electrostatic Transducers Harnessing Zipping Mechanism

Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K., Morrissey, T. G.

(US Patent 11486421B2), November 2022 (patent)

Abstract

Hydraulically-amplified, self-healing, electrostatic transducers that harness electrostatic and hydraulic forces to achieve various actuation modes. Electrostatic forces between electrode pairs of the transducers generated upon application of a voltage to the electrode pairs draws the electrodes in each pair towards each other to displace a liquid dielectric contained within an enclosed internal cavity of the transducers to drive actuation in various manners. The electrodes and the liquid dielectric form a self-healing capacitor whereby the liquid dielectric automatically fills breaches in the liquid dielectric resulting from dielectric breakdown. Due to the resting shape of the cavity, a zipping-mechanism allows for selectively actuating the electrodes to a desired extent by controlling the voltage supplied.

rm Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K., Morrissey, T. G. Hydraulically Amplified Self-healing Electrostatic Transducers Harnessing Zipping Mechanism (US Patent 11486421B2), November 2022 (patent)

Hydraulically Amplified Self-Healing Electrostatic (HASEL) Pumps

Mitchell, S. K., Acome, E. L., Keplinger, C. M.

(US Patent App. 17/635,339), October 2022 (patent)

Abstract

A pumping system includes a conduit with an inlet region and an outlet region and a first pump coupled with the conduit between the inlet region and the outlet region. The first pump includes a first actuator chamber configured to house at least a first actuator, a first pump chamber aligned along a longitudinal axis of the conduit, wherein the first pump chamber is in fluid communication with the inlet region and the outlet region, and a first flexible diaphragm separating the first actuator chamber from the first pump chamber. Methods for operating the pumping system are also disclosed.

rm Mitchell, S. K., Acome, E. L., Keplinger, C. M. Hydraulically Amplified Self-Healing Electrostatic (HASEL) Pumps (US Patent App. 17/635,339), October 2022 (patent)

Investigating Independent Mechanisms in Neural Networks

Liang, W.

Université Paris-Saclay, France, October 2022 (mastersthesis)

ei Liang, W. Investigating Independent Mechanisms in Neural Networks Université Paris-Saclay, France, October 2022 (mastersthesis)

Modeling subgroup differences in fMRI data: disentangling subgroup-specific responses from shared ones

Keidar, D.

ETH Zurich, Switzerland, October 2022 (mastersthesis)

ei Keidar, D. Modeling subgroup differences in fMRI data: disentangling subgroup-specific responses from shared ones ETH Zurich, Switzerland, October 2022 (mastersthesis)

Multi-Target Multi-Object Manipulation using Relational Deep Reinforcement Learning

Feil, M.

Technnical University Munich, Germany, September 2022 (mastersthesis)

ei Feil, M. Multi-Target Multi-Object Manipulation using Relational Deep Reinforcement Learning Technnical University Munich, Germany, September 2022 (mastersthesis)

Independent Mechanism Analysis for High Dimensions

Sliwa, J.

University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (mastersthesis)

ei Sliwa, J. Independent Mechanism Analysis for High Dimensions University of Tübingen, Germany, September 2022, (Graduate Training Centre of Neuroscience) (mastersthesis)

Hydraulically Amplified Self-healing Electrostatic Actuators

Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K.

(US Patent 11408452), August 2022 (patent)

Abstract

rm Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K. Hydraulically Amplified Self-healing Electrostatic Actuators (US Patent 11408452), August 2022 (patent)

Patterns, Predictions, and Actions: Foundations of Machine Learning

Hardt, M., Recht, B.

Princeton University Press, August 2022 (book)

Abstract

An authoritative, up-to-date graduate textbook on machine learning that highlights its historical context and societal impacts Patterns, Predictions, and Actions introduces graduate students to the essentials of machine learning while offering invaluable perspective on its history and social implications. Beginning with the foundations of decision making, Moritz Hardt and Benjamin Recht explain how representation, optimization, and generalization are the constituents of supervised learning. They go on to provide self-contained discussions of causality, the practice of causal inference, sequential decision making, and reinforcement learning, equipping readers with the concepts and tools they need to assess the consequences that may arise from acting on statistical decisions. Provides a modern introduction to machine learning, showing how data patterns support predictions and consequential actions Pays special attention to societal impacts and fairness in decision making Traces the development of machine learning from its origins to today Features a novel chapter on machine learning benchmarks and datasets Invites readers from all backgrounds, requiring some experience with probability, calculus, and linear algebra An essential textbook for students and a guide for researchers

sf Hardt, M., Recht, B. Patterns, Predictions, and Actions: Foundations of Machine Learning Princeton University Press, August 2022 (book)

On the Adversarial Robustness of Causal Algorithmic Recourse

Dominguez-Olmedo, R.

University of Tübingen, Germany, August 2022 (mastersthesis)

ei Dominguez-Olmedo, R. On the Adversarial Robustness of Causal Algorithmic Recourse University of Tübingen, Germany, August 2022 (mastersthesis)

Independent Mechanism Analysis in High-Dimensional Observation Spaces

Ghosh, S.

ETH Zurich, Switzerland, June 2022 (mastersthesis)

ei Ghosh, S. Independent Mechanism Analysis in High-Dimensional Observation Spaces ETH Zurich, Switzerland, June 2022 (mastersthesis)

Composite Layering of Hydraulically Amplified Self-Healing Electrostatic Transducers

Keplinger, C. M., Mitchell, S. K., Kellaris, N. A., Rothemund, P.

(US Patent App. 17436455), May 2022 (patent)

Abstract

A hydraulically amplified self-healing electrostatic (HASEL) transducer includes a composite, multi-layered structure. In an example, a HASEL transducer includes a dielectric layer including at least one fluid dielectric layer. The dielectric layer includes a first side and a second side opposing the first side. The HASEL transducer further includes a first electrode disposed at the first side of the dielectric layer, a second electrode disposed at the second side of the dielectric layer, a first outer layer disposed at the first electrode opposite the dielectric layer, and a second outer layer disposed at the second electrode opposite the dielectric layer. The first outer layer and second outer layer exhibit different mechanical and electrical properties from the dielectric layer.

rm Keplinger, C. M., Mitchell, S. K., Kellaris, N. A., Rothemund, P. Composite Layering of Hydraulically Amplified Self-Healing Electrostatic Transducers (US Patent App. 17436455), May 2022 (patent)

Voltage dependent investigations on the spin polarization of layered heterostructues

Miller, M.

Universität Stuttgart, Stuttgart, 2022 (mastersthesis)

mms

mms Miller, M. Voltage dependent investigations on the spin polarization of layered heterostructues Universität Stuttgart, Stuttgart, 2022 (mastersthesis)

2021

Learning Neural Causal Models with Active Interventions

Scherrer, N.

ETH Zurich, Switzerland, November 2021 (mastersthesis)

2021

ei Scherrer, N. Learning Neural Causal Models with Active Interventions ETH Zurich, Switzerland, November 2021 (mastersthesis)

HealthGen: Conditional Generation of Realistic Medical Time Series with Informative Missingness

Bing, S.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

ei Bing, S. HealthGen: Conditional Generation of Realistic Medical Time Series with Informative Missingness ETH Zurich, Switzerland, October 2021 (mastersthesis)

Study of the Interventional Consistency of Autoencoders

Lanzillotta, G.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

ei Lanzillotta, G. Study of the Interventional Consistency of Autoencoders ETH Zurich, Switzerland, October 2021 (mastersthesis)

Training with Few to Manipulate Many. On OOD generalization in relational reinforcement learning

Mambelli, D.

ETH Zurich, Switzerland, October 2021 (mastersthesis)

ei Mambelli, D. Training with Few to Manipulate Many. On OOD generalization in relational reinforcement learning ETH Zurich, Switzerland, October 2021 (mastersthesis)

Skinned multi-infant linear body model

Hesse, N., Pujades, S., Romero, J., Black, M.

(US Patent 11,127,163, 2021), September 2021 (patent)

Abstract

A computer-implemented method for automatically obtaining pose and shape parameters of a human body. The method includes obtaining a sequence of digital 3D images of the body, recorded by at least one depth camera; automatically obtaining pose and shape parameters of the body, based on images of the sequence and a statistical body model; and outputting the pose and shape parameters. The body may be an infant body.

ps Hesse, N., Pujades, S., Romero, J., Black, M. Skinned multi-infant linear body model (US Patent 11,127,163, 2021), September 2021 (patent)

Robotic Surgery Training in AR: Multimodal Record and Replay

Krauthausen, F.

pages: 1-147, University of Stuttgart, Stuttgart, May 2021, Study Program in Software Engineering (mastersthesis)

hi Krauthausen, F. Robotic Surgery Training in AR: Multimodal Record and Replay pages: 1-147, University of Stuttgart, Stuttgart, May 2021, Study Program in Software Engineering (mastersthesis)

Nguyen, V., Javot, B., Kuchenbecker, K. J.

An electric machine with two-phase planar Lorentz coils and a ring-shaped Halbach array for high torque density and high-precision applications

(EP21170679.1), April 2021 (patent)

Abstract

An electric machine, in particular a motor or a generator, comprising a rotor and a stator, wherein the rotor comprises a planar, ring-shaped rotor base element and the stator comprises a planar ring-shaped stator base element, wherein the rotor base element and the stator base element are aligned along an axial axis (Z) of the electric machine, wherein a plurality of magnet elements are arranged around the circumference of the ring-shaped rotor base element forming a Halbach magnet-ring assembly, wherein the Halbach magnet-ring assembly generates a magnetic field (BR) with axial and azimuthal components, wherein a plurality of coils are arranged around the circumference (C) of the ring-shaped stator base element.

hi Nguyen, V., Javot, B., Kuchenbecker, K. J. An electric machine with two-phase planar Lorentz coils and a ring-shaped Halbach array for high torque density and high-precision applications (EP21170679.1), April 2021 (patent)

Hydraulically Amplified Self-Healing Electrostatic Transducers Harnessing Zipping Mechanism

Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K., Morrissey, T. G.

(US Patent 20210003149A1), January 2021 (patent)

Abstract

rm Keplinger, C. M., Acome, E. L., Kellaris, N. A., Mitchell, S. K., Morrissey, T. G. Hydraulically Amplified Self-Healing Electrostatic Transducers Harnessing Zipping Mechanism (US Patent 20210003149A1), January 2021 (patent)

Direct detection of spin Hall effect induced torques in platinum/ferromagnetic bilayer systems

Alten, F.

Universität Stuttgart, Stuttgart, January 2021 (mastersthesis)

mms

mms Alten, F. Direct detection of spin Hall effect induced torques in platinum/ferromagnetic bilayer systems Universität Stuttgart, Stuttgart, January 2021 (mastersthesis)

Sun, H., Martius, G., Kuchenbecker, K. J.

Sensor Arrangement for Sensing Forces and Methods for Fabricating a Sensor Arrangement and Parts Thereof

(PCT/EP2021/050230), Max Planck Institute for Intelligent Systems, Max Planck Ring 4, January 2021 (patent)

Abstract

The invention relates to a vision-based haptic sensor arrangement for sensing forces, to a method for fabricating a top portion of a sensor arrangement, and to a method for fabricating a sensor arrangement.

al hi

al hi Sun, H., Martius, G., Kuchenbecker, K. J. Sensor Arrangement for Sensing Forces and Methods for Fabricating a Sensor Arrangement and Parts Thereof (PCT/EP2021/050230), Max Planck Institute for Intelligent Systems, Max Planck Ring 4, January 2021 (patent)

Sun, H., Martius, G., Kuchenbecker, K. J.

Method for force inference, method for training a feed-forward neural network, force inference module, and sensor arrangement

(PCT/EP2021/050231), Max Planck Institute for Intelligent Systems, Max Planck Ring 4, January 2021 (patent)

Abstract

The invention relates to a method for force inference of a sensor arrangement for sensing forces, to a method for training a feed-forward neural network, to a force inference module, and to a sensor arrangement.

al hi

al hi Sun, H., Martius, G., Kuchenbecker, K. J. Method for force inference, method for training a feed-forward neural network, force inference module, and sensor arrangement (PCT/EP2021/050231), Max Planck Institute for Intelligent Systems, Max Planck Ring 4, January 2021 (patent)

Magnetically actuated capsule endoscope, magnetic field generating and sensing apparatus and method of actuating a magnetically actuated capsule endoscope

Sitti, M., Son, D.

2021, US Patent App. 16/617,348 (patent)

pi Sitti, M., Son, D. Magnetically actuated capsule endoscope, magnetic field generating and sensing apparatus and method of actuating a magnetically actuated capsule endoscope 2021, US Patent App. 16/617,348 (patent)

Slippery micropropellers penetrate the vitreous humor

Wu, Z., Qiu, T., Fischer, P.

(US20210170056A1), 2021 (patent)

Abstract

Microparticles actively propel through the vitreous humour and reach the retina in porcine eyes. The slippery micro helical propellers are constructed by the combination of glancing angle deposition technique and the fusion of the slippery liquid layer. The magnetically propulsion in the vitreous humour relies on the matched size of the propeller to the collagen network of the vitreous, and the anti-adhesion coating of the collagen fiber bundles. Clinical optical coherence tomography observed the displacement of the slippery micropropellers through the vitreous to the macular area on the retina. The slippery micropropellers realize the controllable massive movements to the retina in 30 mins, while exerting the travelling distance of above one centimeter. The injection of the slippery micropropellers, the magnetically-powered controllable propulsion in the vitreous, and the optical coherence tomography imaging technique, constitute an intact method for rapid targeted ocular delivery, providing a promising approach towards ophthalmologic applications.

pf Wu, Z., Qiu, T., Fischer, P. Slippery micropropellers penetrate the vitreous humor (US20210170056A1), 2021 (patent)