Institute Homepage
Institute Homepage DE Sign In

Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation

Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group

Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award

Physical Intelligence Patent Method and device for reversibly attaching a phase changing metal to an object Zhou Ye, G. Z. L. M. S. US Patent Application 10675718, January 2020
A method for reversibly attaching a phase changing metal to an object, the method comprising the steps of: providing a substrate having at least one surface at which the phase changing metal is attached, heating the phase changing metal above a phase changing temperature at which the phase changing metal changes its phase from solid to liquid, bringing the phase changing metal, when the phase changing metal is in the liquid phase or before the phase changing metal is brought into the liquid phase, into contact with the object, permitting the phase changing metal to cool below the phase changing temperature, whereby the phase changing metal becomes solid and the object and the phase changing metal become attached to each other, reheating the phase changing metal above the phase changing temperature to liquefy the phase changing metal, and removing the substrate from the object, with the phase changing metal separating from the object and remaining with the substrate.
US Patent Application Database US Patent Application (PDF) URL BibTeX
Physical Intelligence Bioinspired Autonomous Miniature Robots Patent Method of actuating a shape changeable member, shape changeable member and actuating system Hu, W., Lum, G. Z., Mastrangeli, M., Sitti, M. Google Patents, January 2020, US Patent App. 16/477,593
The present invention relates to a method of actuating a shape changeable member of actuatable material. The invention further relates to a shape changeable member and to a system comprising such a shape changeable member and a magnetic field apparatus.
BibTeX
Physical Intelligence Patent Method of fabricating a shape-changeable magentic member, method of producing a shape changeable magnetic member and shape changeable magnetic member Guo Zhan Lum, Z. Y. M. S. US Patent Application 16845646, January 2020
The present invention relates to a method of fabricating a shape-changeable magnetic member comprising a plurality of segments with each segment being able to be magnetized with a desired magnitude and orientation of magnetization, to a method of producing a shape changeable magnetic member composed of a plurality of segments and to a shape changeable magnetic member.
US Patent Application Database US Patent Application (PDF) BibTeX
Intelligent Control Systems Article Overcoming Bandwidth Limitations in Wireless Sensor Networks by Exploitation of Cyclic Signal Patterns: An Event-triggered Learning Approach Beuchert, J., Solowjow, F., Trimpe, S., Seel, T. Sensors, 20(1):260, January 2020 (Published) PDF DOI BibTeX
Autonomous Vision Conference Paper Scalable Active Learning for Object Detection Haussmann, E. F. M. C. K. I. J. X. H. R. D. M. A. K. N. F. C. A. J. M. Proceedings 31st IEEE Intelligent Vehicles Symposium (IV), 1430-1435, IEEE, 31st IEEE Intelligent Vehicles Symposium (IV), 2020 (Accepted) DOI BibTeX
Physical Intelligence Article 3D microprinting of iron platinum nanoparticle-based magnetic mobile microrobots Giltinan, J., Sridhar, V., Bozuyuk, U., Sheehan, D., Sitti, M. Advanced Intelligent Systems, 3(1):2000204, 2020 DOI BibTeX
Physical Intelligence Article 3D microstructures of liquid crystal networks with programmed voxelated director fields Guo, Y., Shahsavan, H., Sitti, M. Advanced Materials, 32(38):2002753, 2020 DOI URL BibTeX
Empirical Inference Article A 32-channel multi-coil setup optimized for human brain shimming at 9.4T Aghaeifar, A., Zhou, J., Heule, R., Tabibian, B., Schölkopf, B., Jia, F., Zaitsev, M., Scheffler, K. Magnetic Resonance in Medicine, 83(2):749-764, 2020 (Published) DOI URL BibTeX
Conference Paper A Probabilistic Framework for Constrained Manipulations and Task and Motion Planning under Uncertainty Ha, J., Driess, D., Toussaint, M. In 2020 IEEE International Conference on Robotics and Automation (ICRA 2020), 6745-6751, IEEE, Piscataway, NJ, IEEE International Conference on Robotics and Automation (ICRA 2020), 2020 (Published) DOI BibTeX
Empirical Inference Article A Probabilistic Framework for Imitating Human Race Driver Behavior Löckel, S., Peters, J., van Vliet, P. IEEE Robotics and Automation Letters, 5(2):2086-2093, 2020 (Published) DOI BibTeX
Empirical Inference Autonomous Learning Autonomous Motion Movement Generation and Control Conference Paper A Real-Robot Dataset for Assessing Transferability of Learned Dynamics Models Agudelo-España, D., Zadaianchuk, A., Wenk, P., Garg, A., Akpo, J., Grimminger, F., Viereck, J., Naveau, M., Righetti, L., Martius, G., Krause, A., Schölkopf, B., Bauer, S., Wüthrich, M. IEEE International Conference on Robotics and Automation (ICRA), 8151-8157, IEEE, 2020 (Published) Project Page PDF DOI BibTeX
Empirical Inference Article A Sober Look at the Unsupervised Learning of Disentangled Representations and their Evaluation Locatello, F., Bauer, S., Lucic, M., Raetsch, G., Gelly, S., Schölkopf, B., Bachem, O. Journal of Machine Learning Research, 21:1-62, 2020 (Published) URL BibTeX
Micro, Nano, and Molecular Systems Patent A conjugate complex facilitating the transport of a cargo through a medium Rothenstein, D., Bill, J., Fischer, P. (US20200215202A1), 2020
The present invention relates to conjugate complexes, comprising at least one biological entity, at least one cargo moiety, and at least one effector moiety that is capable of converting, degrading, and/or modifying a given medium, wherein the at least one cargo moiety and the at least one effector moiety are directly or indirectly coupled to the biological entity. The present invention further relates to uses thereof and methods for facilitating the transport of a cargo moiety through a given medium.
BibTeX
Physical Intelligence Article A realistic simulation environment for MRI-based robust control of untethered magnetic robots with intra-operational imaging Tiryaki, M. E., Erin, Ö., Sitti, M. IEEE Robotics and Automation Letters, 5(3):4501-4508, 2020 DOI URL BibTeX
Rationality Enhancement Software Workshop Conference Paper ACTrain: Ein KI-basiertes Aufmerksamkeitstraining für die Wissensarbeit Wirzberger, M., Oreshnikov, I., Passy, J., Lado, A., Shenhav, A., Lieder, F. 66th Spring Conference of the German Ergonomics Society, 2020
Unser digitales Zeitalter lebt von Informationen und stellt unsere begrenzte Verarbeitungskapazität damit täglich auf die Probe. Gerade in der Wissensarbeit haben ständige Ablenkungen erhebliche Leistungseinbußen zur Folge. Unsere intelligente Anwendung ACTrain setzt genau an dieser Stelle an und verwandelt Computertätigkeiten in eine Trainingshalle für den Geist. Feedback auf Basis maschineller Lernverfahren zeigt anschaulich den Wert auf, sich nicht von einer selbst gewählten Aufgabe ablenken zu lassen. Diese metakognitive Einsicht soll zum Durchhalten motivieren und das zugrunde liegende Fertigkeitsniveau der Aufmerksamkeitskontrolle stärken. In laufenden Feldexperimenten untersuchen wir die Frage, ob das Training mit diesem optimalen Feedback die Aufmerksamkeits- und Selbstkontrollfertigkeiten im Vergleich zu einer Kontrollgruppe ohne Feedback verbessern kann.
URL BibTeX
Micro, Nano, and Molecular Systems Article Acoustic Vibration-Induced Actuation of Multiple Microrotors in Microfluidics Zhou, Y., Wang, H., Ma, Z., Yang, J. K. W., Ai, Y. Advanced Materials Technologies, 5(9):2000323, 2020 (Published) DOI BibTeX
Physical Intelligence Article Acoustically powered surface-slipping mobile microrobots Aghakhani, A., Yasa, O., Wrede, P., Sitti, M. Proceedings of the National Academy of Sciences, 117(7):3469-3477, 2020
Untethered synthetic microrobots have significant potential to revolutionize minimally invasive medical interventions in the future. However, their relatively slow speed and low controllability near surfaces typically are some of the barriers standing in the way of their medical applications. Here, we introduce acoustically powered microrobots with a fast, unidirectional surface-slipping locomotion on both flat and curved surfaces. The proposed three-dimensionally printed, bullet-shaped microrobot contains a spherical air bubble trapped inside its internal body cavity, where the bubble is resonated using acoustic waves. The net fluidic flow due to the bubble oscillation orients the microrobot's axisymmetric axis perpendicular to the wall and then propels it laterally at very high speeds (up to 90 body lengths per second with a body length of 25 µm) while inducing an attractive force toward the wall. To achieve unidirectional locomotion, a small fin is added to the microrobot’s cylindrical body surface, which biases the propulsion direction. For motion direction control, the microrobots are coated anisotropically with a soft magnetic nanofilm layer, allowing steering under a uniform magnetic field. Finally, surface locomotion capability of the microrobots is demonstrated inside a three-dimensional circular cross-sectional microchannel under acoustic actuation. Overall, the combination of acoustic powering and magnetic steering can be effectively utilized to actuate and navigate these microrobots in confined and hard-to-reach body location areas in a minimally invasive fashion.
DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Activated diffusiophoresis Rohwer, C. M., Kardar, M., Krüger, M. The Journal of Chemical Physics, 152(8):084109, American Institute of Physics, Woodbury, N.Y., 2020 DOI BibTeX
Physical Intelligence Article Additive manufacturing of cellulose-based materials with continuous, multidirectional stiffness gradients Giachini, P. A. G. S., Gupta, S. S., Wang, W., Wood, D., Yunusa, M., Baharlou, E., Sitti, M., Menges, A. Science Advances, 6(8):eaay0929, 2020
Functionally graded materials (FGMs) enable applications in fields such as biomedicine and architecture, but their fabrication suffers from shortcomings in gradient continuity, interfacial bonding, and directional freedom. In addition, most commercial design software fail to incorporate property gradient data, hindering explorations of the design space of FGMs. Here, we leveraged a combined approach of materials engineering and digital processing to enable extrusion-based multimaterial additive manufacturing of cellulose-based tunable viscoelastic materials with continuous, high-contrast, and multidirectional stiffness gradients. A method to engineer sets of cellulose-based materials with similar compositions, yet distinct mechanical and rheological properties, was established. In parallel, a digital workflow was developed to embed gradient information into design models with integrated fabrication path planning. The payoff of integrating these physical and digital tools is the ability to achieve the same stiffness gradient in multiple ways, opening design possibilities previously limited by the rigid coupling of material and geometry.
DOI BibTeX
Theory of Inhomogeneous Condensed Matter Book Chapter Adopting the Boundary Homogenization Approximation from Chemical Kinetics to Motile Chemically Active Particles Popescu, M. N., Uspal, W. E. In Chemical Kinetics, 517-540, (Editors: Lindenberg, Katja and Metzler, Ralf and Oshanin, Gleb), World Scientific, New Jersey, NJ, 2020 DOI BibTeX
Empirical Inference Article An Adaptive Optimizer for Measurement-Frugal Variational Algorithms Kübler, J. M., Arrasmith, A., Cincio, L., Coles, P. J. Quantum, 4, 2020 (Published) DOI URL BibTeX
Autonomous Motion Conference Paper An Interior Point Method Solving Motion Planning Problems with Narrow Passages Mainprice, J., Ratliff, N., Toussaint, M., Schaal, S. In 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020), 547-552, IEEE, Piscataway, NJ, 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN 2020), 2020 (Published) DOI BibTeX
Autonomous Learning Article Analytical classical density functionals from an equation learning network Lin, S., Martius, G., Oettel, M. The Journal of Chemical Physics, 152(2):021102, 2020 (Published) arXiv Supplementary Preprint_PDF DOI BibTeX
Empirical Inference Probabilistic Numerics Article Analytical probabilistic modeling of dose-volume histograms Wahl, N., Hennig, P., Wieser, H., Bangert, M. Medical Physics, 47(10):5260-5273, 2020 (Published) DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Apparent phototaxis enabled by Brownian motion Niese, L., Wang, L., Das, S., Simmchen, J. Soft Matter, 16(47):10585-10590, Royal Society of Chemistry, Cambridge, UK, 2020 DOI BibTeX
Empirical Inference Miscellaneous Assaying Large-scale Testing Models to Interpret Covid-19 Case Numbers. A Cross-country Study Besserve, M., Buchholz, S., Schölkopf, B. 2020 (Submitted) arXiv BibTeX
Empirical Inference Article Assisted teleoperation in changing environments with a mixture of virtual guides Ewerton, M., Arenz, O., Peters, J. Advanced Robotics, 34(18):1157-1170, 2020 (Published) DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Axisymmetric spheroidal squirmers and self-diffusiophoretic particles Pöhnl, R., Popescu, M. N., Uspal, W. E. Journal of Physics: Condensed Matter, 32(16):164001, IOP Publishing, Bristol, 2020 DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Ballistic propagation of density correlations and excess wall forces in quenched granular media Schindler, T., Rohwer, C. M. Physical Review E, 102(5):052901, 2020 DOI URL BibTeX
Modern Magnetic Systems Materials Article Bandgap-adjustment and enhanced surface photovoltage in Y-substituted LaTaIVO2N Bubeck, C., Widenmeyer, M., De Denko, A. T., Richter, G., Coduri, M., Salas-Colera, E., Goering, E., Zhang, H., Yoon, S., Osterloh, F. E., Weidenkaff, A. Journal of Materials Chemistry A, 8(23):11837-11848, Royal Society of Chemistry, Cambridge, UK, 2020 DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Behavior of the van der Waals force between a plate and a single-walled carbon nanotube under uniform hydrostatic pressure: a theoretical study Valchev, G., Djondjorov, P., Vassilev, V., Dantchev, D. Journal of Physics: Condensed Matter, 32(40):405001, IOP Publishing, Bristol, 2020 DOI BibTeX
Physical Intelligence Bioinspired Autonomous Miniature Robots Article Bioinspired cilia arrays with programmable nonreciprocal motion and metachronal coordination Dong, X., Lum, G. Z., Hu, W., Zhang, R., Ren, Z., Onck, P. R., Sitti, M. Science Advances, 6(45):eabc9323, 2020 DOI BibTeX
Physical Intelligence Article Bioinspired underwater locomotion of light-driven liquid crystal gels Shahsavan, H., Aghakhani, A., Zeng, H., Guo, Y., Davidson, Z. S., Priimagi, A., Sitti, M. Proceedings of the National Academy of Sciences, 117(10):5125-5133, 2020
Untethered dynamic shape programming and control of soft materials have significant applications in technologies such as soft robots, medical devices, organ-on-a-chip, and optical devices. Here, we present a solution to remotely actuate and move soft materials underwater in a fast, efficient, and controlled manner using photoresponsive liquid crystal gels (LCGs). LCG constructs with engineered molecular alignment show a low and sharp phase-transition temperature and experience considerable density reduction by light exposure, thereby allowing rapid and reversible shape changes. We demonstrate different modes of underwater locomotion, such as crawling, walking, jumping, and swimming, by localized and time-varying illumination of LCGs. The diverse locomotion modes of smart LCGs can provide a new toolbox for designing efficient light-fueled soft robots in fluid-immersed media.
DOI BibTeX
Physical Intelligence Article Biosynthetic self-healing materials for soft machines Pena-Francesch, A., Jung, H., Demirel, M. C., Sitti, M. Nature Materials, 19(11):1230-1235, 2020 DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Blessing and Curse: How a Supercapacitor Large Capacitance Causes its Slow Charging Lian, C., Janssen, M., Liu, H., van Roij, R. Physical Review Letters, 124(7):076001, American Physical Society, Woodbury, N.Y., 2020 DOI BibTeX
Modern Magnetic Systems Article Bound and stable vortex-antivortex pairs in high-Tc superconductors Simmendinger, J., Bihler, M., Ionescu, A. M., Weigand, M., Schütz, G., Albrecht, J. New Journal of Physics, 22(12):123035, IOP Publishing, Bristol, 2020 DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Bridging transitions and capillary forces for colloids in a slit Vasilyev, O. A., Labbe-Laurent, M., Dietrich, S., Kondrat, S. The Journal of Chemical Physics, 153(1):014901, American Institute of Physics, Woodbury, N.Y., 2020 DOI BibTeX
Modern Magnetic Systems Article Building blocks for magnon optics: Emission and conversion of short spin waves Groß, F., Zelent, M., Träger, N., Förster, J., Sanli, U. T., Sauter, R., Decker, M., Back, C. H., Weigand, M., Keskinbora, K., Schütz, G., Krawczyk, M., Gräfe, J. ACS Nano, 14(12):17184-17193, American Chemical Society, Washington, DC, 2020 DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Bulk ionic screening lengths from extremely large-scale molecular dynamics simulations Zeman, J., Kondrat, S., Holm, C. Chemical Communications, 56(100):15635-15638, Royal Society of Chemistry, Cambridge, UK, 2020 DOI BibTeX
Physical Intelligence Article Carbon nitride-based light-driven microswimmers with intrinsic photocharging ability Sridhar, V., Podjaski, F., Kröger, J., Jiménez-Solano, A., Park, B., Lotsch, B. V., Sitti, M. Proceedings of the National Academy of Sciences, 117(40):24748-24756, 2020 DOI URL BibTeX
Theory of Inhomogeneous Condensed Matter Article Cassie-Wenzel transition of a binary liquid mixture on a nanosculptured surface Singh, S. L., Schimmele, L., Dietrich, S. Physical Review E, 101(5):052115, American Physical Society, Melville, NY, 2020 DOI BibTeX
Empirical Inference Article Causal Discovery from Heterogeneous/Nonstationary Data Huang, B., Zhang, K., Zhang, J., Ramsey, J., Sanchez-Romero, R., Glymour, C., Schölkopf, B. Journal of Machine Learning Research, 21(1):1-53, 2020 (Published) URL BibTeX
Empirical Inference Miscellaneous Causal learning with sufficient statistics: an information bottleneck approach Chicharro, D., Besserve, M., Panzeri, S. 2020 (Submitted) arXiv BibTeX
Theory of Inhomogeneous Condensed Matter Article Charge symmetry broken complex coacervation Majee, A., Bier, M., Blossey, R., Podgornik, R. Physical Review Research, 2(4):043417, American Physical Society (APS), College Park, Maryland, United States, 2020 (Published) DOI BibTeX
Theory of Inhomogeneous Condensed Matter Article Chemically Active Particles: From One to Few on the Way to Many Popescu, M. N. Langmuir, 36(25):6861-6870, American Chemical Society, Columbus, OH, 2020 DOI BibTeX
Empirical Inference Article Clinical Predictive Models for COVID-19: Systematic Study Schwab, P., DuMont Schütte, A., Dietz, B., Bauer, S. Journal of Medical Internet Research, 22(10), 2020 (Published) DOI URL BibTeX
Physical Intelligence Article Cohesive self-organization of mobile microrobotic swarms Yigit, B., Alapan, Y., Sitti, M. Soft Matter, 16(8):1996-2004, 2020 DOI BibTeX
Micro, Nano, and Molecular Systems Master Thesis Colloidal particles supporting urase activity Baldauf, A. Univ. of Stuttgart, 2020 BibTeX
Materials Article Communication - Highly Sensitive Glassy Carbon Electrode Altered by Nanoporous Gold for the Electrochemical Detection of Nitrite Zhang, A., Yang, Z., Chen, Y., Schützendübe, P., Huang, Y., Liu, Y., Wang, Z. Journal of the Electrochemical Society, 167(8):086504, Electrochemical Society, New York, NY, USA, 2020 DOI BibTeX
Autonomous Vision Book Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art Janai, J., Güney, F., Behl, A., Geiger, A. 12(1-3), Foundations and Trends® in Computer Graphics and Vision, now Publishers Inc., Hanover, MA, 2020 (Published)
Recent years have witnessed enormous progress in AI-related fields such as computer vision, machine learning, and autonomous vehicles. As with any rapidly growing field, it becomes increasingly difficult to stay up-to-date or enter the field as a beginner. While several survey papers on particular sub-problems have appeared, no comprehensive survey on problems, datasets, and methods in computer vision for autonomous vehicles has been published. This monograph attempts to narrow this gap by providing a survey on the state-of-the-art datasets and techniques. Our survey includes both the historically most relevant literature as well as the current state of the art on several specific topics, including recognition, reconstruction, motion estimation, tracking, scene understanding, and end-to-end learning for autonomous driving. Towards this goal, we analyze the performance of the state of the art on several challenging benchmarking datasets, including KITTI, MOT, and Cityscapes. Besides, we discuss open problems and current research challenges. To ease accessibility and accommodate missing references, we also provide a website that allows navigating topics as well as methods and provides additional information.
pdf Project Page link DOI BibTeX