Adaptive Locomotion of Soft Microrobots
Networked Control and Communication
Controller Learning using Bayesian Optimization
Event-based Wireless Control of Cyber-physical Systems
Model-based Reinforcement Learning for PID Control
Learning Probabilistic Dynamics Models
Gaussian Filtering as Variational Inference
Research Overview
The Intelligent Control Systems (ICS) group aims to develop machine learning and decision algorithms for machines in the physical world. Our research often starts with fundamental theoretical questions on learning and control, leading us to develop new methods and algorithms, which we finally implement and demonstrate on physical machines such as robots, vehicles, and other autonomous systems.
When learning on physical machines, some special challenges arise, which are different from other machine learning domains typically involving pure software or computer systems. For example, learning in the real world often has to cope with imperfect and relatively small data sets, because physical systems cannot be sampled arbitrarily and exhibit high-dimensional and continuous state-action spaces. A constant stream of data (e. g. from sensors) requires online and lifelong learning, but often on embedded hardware with limited computational resources. Finally, theoretical guarantees on safety, robustness, and reliability are essential for physical learning systems, but often not available in standard machine learning. These are some of the fundamental challenges that arise when artificial intelligence meets the physical world – and that drive our research. In addition to learning, control, and decision making for a single physical system, we are also interested in distributed and networked problems, for example, where multiple intelligent agents cooperate to achieve a common goal. How can a team of robots efficiently coordinate their actions? What information should they exchange, and when? And how to design for limited embedded resources such as bandwidth, computation, or energy? These are some of the questions that we address in this research direction.
As we seek to bridge computational and physical intelligence, research at ICS is highly interdisciplinary. In particular, we combine and intersect the disciplines of machine learning, systems & control theory, applied mathematics, and robotics. The main directions of the research at ICS can be summarized as:
- Learning-based control: machine learning and control theory for learning on physical systems with guarantees;
- Distributed intelligence: learning, control, and cooperation across multi-agent and cyber-physical networks;
- Resource efficiency: achieving high performance control and learning with limited resources (embedded computation, small data, communication bandwidth, energy).
The ICS group was founded in February 2018, when Sebastian Trimpe was appointed as a Max Planck Research Group Leader (W2) at MPI-IS Stuttgart. The Max Planck Research Group is primarily funded through the Cyber Valley initiative. Since its start, the ICS group grew rapidly to around eight PhD and postdoctoral researchers, as well as many students and interns. In May 2020, Sebastian Trimpe accepted a full professorship at RWTH Aachen University, where since he has been building up a new Institute for Data Science in Mechanical Engineering. ICS has been continued for a transition period with the agreed end date of April 2022. With several researchers transitioning from Stuttgart to Aachen, the ICS group formed the foundation for an entire new institute at RWTH. We are grateful for the opportunities that we have had at MPI-IS. The ecosystem allowed us to grow quickly, form a strong team, and have impact in several new research directions at the intersection of Machine Learning and Automatic Control.