Publications | Max Planck Institute for Intelligent Systems

Language Models Can Reduce Asymmetry in Information Markets

Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B.

arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

Abstract

This work addresses the buyer's inspection paradox for information markets. The paradox is that buyers need to access information to determine its value, while sellers need to limit access to prevent theft. To study this, we introduce an open-source simulated digital marketplace where intelligent agents, powered by language models, buy and sell information on behalf of external participants. The central mechanism enabling this marketplace is the agents' dual capabilities: they not only have the capacity to assess the quality of privileged information but also come equipped with the ability to forget. This ability to induce amnesia allows vendors to grant temporary access to proprietary information, significantly reducing the risk of unauthorized retention while enabling agents to accurately gauge the information's relevance to specific queries or tasks. To perform well, agents must make rational decisions, strategically explore the marketplace through generated sub-queries, and synthesize answers from purchased information. Concretely, our experiments (a) uncover biases in language models leading to irrational behavior and evaluate techniques to mitigate these biases, (b) investigate how price affects demand in the context of informational goods, and (c) show that inspection and higher budgets both lead to higher quality outcomes.

ei Rahaman, N., Weiss, M., Wüthrich, M., Bengio, Y., Li, E., Pal, C., Schölkopf, B. Language Models Can Reduce Asymmetry in Information Markets arXiv:2403.14443, March 2024, Published as: Redesigning Information Markets in the Era of Language Models, Conference on Language Modeling (COLM) (techreport)

Koopman Spectral Analysis Uncovers the Temporal Structure of Spontaneous Neural Events

Shao, K., Xu, Y., Logothetis, N., Shen, Z., Besserve, M.

Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

ei Shao, K., Xu, Y., Logothetis, N., Shen, Z., Besserve, M. Koopman Spectral Analysis Uncovers the Temporal Structure of Spontaneous Neural Events Computational and Systems Neuroscience Meeting (COSYNE), March 2024 (poster)

Learning a Terrain- and Robot-Aware Dynamics Model for Autonomous Mobile Robot Navigation

Achterhold, J., Guttikonda, S., Kreber, J. U., Li, H., Stueckler, J.

CoRR abs/2409.11452, 2024, Preprint submitted to Robotics and Autonomous Systems Journal. https://arxiv.org/abs/2409.11452 (techreport) Submitted

Abstract

Mobile robots should be capable of planning cost-efficient paths for autonomous navigation. Typically, the terrain and robot properties are subject to variations. For instance, properties of the terrain such as friction may vary across different locations. Also, properties of the robot may change such as payloads or wear and tear, e.g., causing changing actuator gains or joint friction. Autonomous navigation approaches should thus be able to adapt to such variations. In this article, we propose a novel approach for learning a probabilistic, terrain- and robot-aware forward dynamics model (TRADYN) which can adapt to such variations and demonstrate its use for navigation. Our learning approach extends recent advances in meta-learning forward dynamics models based on Neural Processes for mobile robot navigation. We evaluate our method in simulation for 2D navigation of a robot with uni-cycle dynamics with varying properties on terrain with spatially varying friction coefficients. In our experiments, we demonstrate that TRADYN has lower prediction error over long time horizons than model ablations which do not adapt to robot or terrain variations. We also evaluate our model for navigation planning in a model-predictive control framework and under various sources of noise. We demonstrate that our approach yields improved performance in planning control-efficient paths by taking robot and terrain properties into account.

preprint [BibTex]

ev Achterhold, J., Guttikonda, S., Kreber, J. U., Li, H., Stueckler, J. Learning a Terrain- and Robot-Aware Dynamics Model for Autonomous Mobile Robot Navigation CoRR abs/2409.11452, 2024, Preprint submitted to Robotics and Autonomous Systems Journal. https://arxiv.org/abs/2409.11452 (techreport) Submitted

preprint [BibTex]

A Pontryagin Perspective on Reinforcement Learning

Eberhard, O., Vernade, C., Muehlebach, M.

Max Planck Institute for Intelligent Systems, 2024 (techreport)

lds

lds Eberhard, O., Vernade, C., Muehlebach, M. A Pontryagin Perspective on Reinforcement Learning Max Planck Institute for Intelligent Systems, 2024 (techreport)

Distributed Event-Based Learning via ADMM

Er, D., Trimpe, S., Muehlebach, M.

Max Planck Institute for Intelligent Systems, 2024 (techreport)

lds

lds Er, D., Trimpe, S., Muehlebach, M. Distributed Event-Based Learning via ADMM Max Planck Institute for Intelligent Systems, 2024 (techreport)

preprint supplemental video link (url) [BibTex]

Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators

Baumeister, F., Mack, L., Stueckler, J.

CoRR abs/2409.13228, CoRR, 2024, Submitted to IEEE International Conference on Robotics and Automation (ICRA) 2025 (techreport) Submitted

Abstract

Few-shot adaptation is an important capability for intelligent robots that perform tasks in open-world settings such as everyday environments or flexible production. In this paper, we propose a novel approach for non-prehensile manipulation which iteratively adapts a physics-based dynamics model for model-predictive control. We adapt the parameters of the model incrementally with a few examples of robot-object interactions. This is achieved by sampling-based optimization of the parameters using a parallelizable rigid-body physics simulation as dynamic world model. In turn, the optimized dynamics model can be used for model-predictive control using efficient sampling-based optimization. We evaluate our few-shot adaptation approach in several object pushing experiments in simulation and with a real robot.

ev Baumeister, F., Mack, L., Stueckler, J. Incremental Few-Shot Adaptation for Non-Prehensile Object Manipulation using Parallelizable Physics Simulators CoRR abs/2409.13228, CoRR, 2024, Submitted to IEEE International Conference on Robotics and Automation (ICRA) 2025 (techreport) Submitted

preprint supplemental video link (url) [BibTex]

2023

Fairness in Machine Learning: Limitations and Opportunities

Barocas, S., Hardt, M., Narayanan, A.

MIT Press, December 2023 (book)

Abstract

An introduction to the intellectual foundations and practical utility of the recent work on fairness and machine learning. Fairness and Machine Learning introduces advanced undergraduate and graduate students to the intellectual foundations of this recently emergent field, drawing on a diverse range of disciplinary perspectives to identify the opportunities and hazards of automated decision-making. It surveys the risks in many applications of machine learning and provides a review of an emerging set of proposed solutions, showing how even well-intentioned applications may give rise to objectionable results. It covers the statistical and causal measures used to evaluate the fairness of machine learning models as well as the procedural and substantive aspects of decision-making that are core to debates about fairness, including a review of legal and philosophical perspectives on discrimination. This incisive textbook prepares students of machine learning to do quantitative work on fairness while reflecting critically on its foundations and its practical utility.• Introduces the technical and normative foundations of fairness in automated decision-making• Covers the formal and computational methods for characterizing and addressing problems• Provides a critical assessment of their intellectual foundations and practical utility• Features rich pedagogy and extensive instructor resources

2023

sf Barocas, S., Hardt, M., Narayanan, A. Fairness in Machine Learning: Limitations and Opportunities MIT Press, December 2023 (book)

arxiv poster link (url) [BibTex]

An Open-Source Modular Treadmill for Dynamic Force Measurement with Load Dependant Range Adjustment

Sarvestani, A., Ruppert, F., Badri-Spröwitz, A.

2023 (unpublished) Submitted

Abstract

Ground reaction force sensing is one of the key components of gait analysis in legged locomotion research. To measure continuous force data during locomotion, we present a novel compound instrumented treadmill design. The treadmill is 1.7 m long, with a natural frequency of 170 Hz and an adjustable range that can be used for humans and small robots alike. Here, we present the treadmill’s design methodology and characterize it in its natural frequency, noise behavior and real-life performance. Additionally, we apply an ISO 376 norm conform calibration procedure for all spatial force directions and center of pressure position. We achieve a force accuracy of ≤ 5.6 N for the ground reaction forces and ≤ 13 mm in center of pressure position.

dlg

arXiv link (url) DOI [BibTex]

dlg Sarvestani, A., Ruppert, F., Badri-Spröwitz, A. An Open-Source Modular Treadmill for Dynamic Force Measurement with Load Dependant Range Adjustment 2023 (unpublished) Submitted

arXiv link (url) DOI [BibTex]

Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80

Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D.

Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

Abstract

Robotic applications require the integration of various modalities, encompassing perception, control of real robots and possibly the control of simulated environments. While the state-of-the-art robotic software solutions such as ROS 2 provide most of the required features, flexible synchronization between algorithms, data streams and control loops can be tedious. o80 is a versatile C++ framework for robotics which provides a shared memory model and a command framework for real-time critical systems. It enables expert users to set up complex robotic systems and generate Python bindings for scientists. o80's unique feature is its flexible synchronization between processes, including the traditional blocking commands and the novel ``bursting mode'', which allows user code to control the execution of the lower process control loop. This makes it particularly useful for setups that mix real and simulated environments.

ei Berenz, V., Widmaier, F., Guist, S., Schölkopf, B., Büchler, D. Synchronizing Machine Learning Algorithms, Realtime Robotic Control and Simulated Environment with o80 Robot Software Architectures Workshop (RSA) 2023, ICRA, 2023 (techreport)

arxiv poster link (url) [BibTex]

2022

Causality, causal digital twins, and their applications

Schölkopf, B.

Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling (Dagstuhl Seminar 22382), (Editors: Berens, Philipp and Cranmer, Kyle and Lawrence, Neil D. and von Luxburg, Ulrike and Montgomery, Jessica), September 2022 (talk)

2022

ei Schölkopf, B. Causality, causal digital twins, and their applications Machine Learning for Science: Bridging Data-Driven and Mechanistic Modelling (Dagstuhl Seminar 22382), (Editors: Berens, Philipp and Cranmer, Kyle and Lawrence, Neil D. and von Luxburg, Ulrike and Montgomery, Jessica), September 2022 (talk)

Patterns, Predictions, and Actions: Foundations of Machine Learning

Hardt, M., Recht, B.

Princeton University Press, August 2022 (book)

Abstract

An authoritative, up-to-date graduate textbook on machine learning that highlights its historical context and societal impacts Patterns, Predictions, and Actions introduces graduate students to the essentials of machine learning while offering invaluable perspective on its history and social implications. Beginning with the foundations of decision making, Moritz Hardt and Benjamin Recht explain how representation, optimization, and generalization are the constituents of supervised learning. They go on to provide self-contained discussions of causality, the practice of causal inference, sequential decision making, and reinforcement learning, equipping readers with the concepts and tools they need to assess the consequences that may arise from acting on statistical decisions. Provides a modern introduction to machine learning, showing how data patterns support predictions and consequential actions Pays special attention to societal impacts and fairness in decision making Traces the development of machine learning from its origins to today Features a novel chapter on machine learning benchmarks and datasets Invites readers from all backgrounds, requiring some experience with probability, calculus, and linear algebra An essential textbook for students and a guide for researchers

sf Hardt, M., Recht, B. Patterns, Predictions, and Actions: Foundations of Machine Learning Princeton University Press, August 2022 (book)

Learning Plastic Matching of Robot Dynamics in Closed-Loop Central Pattern Generators: Data

Ruppert, F., Badri-Spröwitz, A.

Edmond, May 2022 (techreport)

dlg

dlg Ruppert, F., Badri-Spröwitz, A. Learning Plastic Matching of Robot Dynamics in Closed-Loop Central Pattern Generators: Data Edmond, May 2022 (techreport)

Data for BirdBot Achieves Energy-Efﬁcient Gait with Minimal Control Using Avian-Inspired Leg Clutching

Badri-Spröwitz, A., Sarvestani, A. A., Sitti, M., Daley, M. A.

Edmond, March 2022 (techreport)

dlg pi

dlg pi Badri-Spröwitz, A., Sarvestani, A. A., Sitti, M., Daley, M. A. Data for BirdBot Achieves Energy-Efﬁcient Gait with Minimal Control Using Avian-Inspired Leg Clutching Edmond, March 2022 (techreport)

Observability Analysis of Visual-Inertial Odometry with Online Calibration of Velocity-Control Based Kinematic Motion Models

Li, H., Stueckler, J.

abs/2204.06651, CoRR/arxiv, 2022 (techreport)

Abstract

In this paper, we analyze the observability of the visual-inertial odometry (VIO) using stereo cameras with a velocity-control based kinematic motion model. Previous work shows that in general case the global position and yaw are unobservable in VIO system, additionally the roll and pitch become also unobservable if there is no rotation. We prove that by integrating a planar motion constraint roll and pitch become observable. We also show that the parameters of the motion model are observable.

ev Li, H., Stueckler, J. Observability Analysis of Visual-Inertial Odometry with Online Calibration of Velocity-Control Based Kinematic Motion Models abs/2204.06651, CoRR/arxiv, 2022 (techreport)

Strecke, M., Stückler, J.

2021

Physically Plausible Tracking & Reconstruction of Dynamic Objects

KIT Science Week Scientific Conference & DGR-Days 2021, October 2021 (talk)

2021

ev Strecke, M., Stückler, J. Physically Plausible Tracking & Reconstruction of Dynamic Objects KIT Science Week Scientific Conference & DGR-Days 2021, October 2021 (talk)

Promoting metacognitive learning through systematic reflection

Frederic Becker, , Lieder, F.

The first edition of Life Improvement Science Conference, June 2021 (poster)

Abstract

Human decision-making is sometimes systematically biased toward suboptimal decisions. For example, people often make short-sighted choices because they don't give enough weight to the long-term consequences of their actions. Previous studies showed that it is possible to overcome such biases by teaching people a more rational decision strategy through instruction, demonstrations, or practice with feedback. The benefits of these approaches tend to be limited to situations that are very similar to those used during the training. One way to overcome this limitation is to create general tools and strategies that people can use to improve their decision-making in any situation. Here we propose one such approach, namely directing people to systematically reflect on how they make their decisions. In systematic reflection, past experience is re-evaluated with the intention to learn. In this study, we investigate how reflection affects how people learn to plan and whether reflective learning can help people to discover more far-sighted planning strategies. In our experiment participants solve a series of 30 planning problems where the immediate rewards are smaller and therefore less important than long-term rewards. Building on Wolfbauer et al. (2020), the experimental group is guided by four reflection prompts asking the participant to describe their planning strategy, the strategy's performance, and his or her emotional response, insights, and intention to change their strategy. The control group practices planning without reflection prompts. Our pilot data suggest that systematic reflection helps people to more rapidly discover adaptive planning strategies. Our findings suggest that reflection is useful not only for helping people learn what to do in a specific situation but also for helping people learn how to think about what to do. In future work, we will compare the effects of different types of reflection on the subsequent changes in people's decision strategies. Developing apps that prompt people to reflect on their decisions may be a promising approach to accelerating cognitive growth and promoting lifelong learning.

re Frederic Becker, , Lieder, F. Promoting metacognitive learning through systematic reflection The first edition of Life Improvement Science Conference, June 2021 (poster)

Preprint Project Page [BibTex]

Improving Human Decision-Making by Discovering Efficient Strategies for Hierarchical Planning

Heindrich, L., Consul, S., Stojcheski, J., Lieder, F.

Tübingen, Germany, The first edition of Life Improvement Science Conference, June 2021 (talk) Accepted

Abstract

The discovery of decision strategies is an essential part of creating effective cognitive tutors that teach planning and decision-making skills to humans. In the context of bounded rationality, this requires weighing the benefits of different planning operations compared to their computational costs. For small decision problems, it has already been shown that near-optimal decision strategies can be discovered automatically and that the discovered strategies can be taught to humans to increase their performance. Unfortunately, these near-optimal strategy discovery algorithms have not been able to scale well to larger problems due to their computational complexity. In this talk, we will present recent work at the Rationality Enhancement Group to overcome the computational bottleneck of existing strategy discovery algorithms. Our approach makes use of the hierarchical structure of human behavior by decomposing sequential decision problems into two sub-problems: setting a goal and planning how to achieve it. An additional metacontroller component is introduced to switch the current goal when it becomes beneficial. The hierarchical decomposition enables us to discover near-optimal strategies for human planning in larger and more complex tasks than previously possible. We then show in online experiments that teaching the discovered strategies to humans improves their performance in complex sequential decision-making tasks.

Project Page [BibTex]

re Heindrich, L., Consul, S., Stojcheski, J., Lieder, F. Improving Human Decision-Making by Discovering Efficient Strategies for Hierarchical Planning Tübingen, Germany, The first edition of Life Improvement Science Conference, June 2021 (talk) Accepted

Project Page [BibTex]

Toward a Science of Effective Well-Doing

Lieder, F., Prentice, M., Corwin-Renner, E.

May 2021 (techreport)

Abstract

Well-doing, broadly construed, encompasses acting and thinking in ways that contribute to humanity’s flourishing in the long run. This often takes the form of setting a prosocial goal and pursuing it over an extended period of time. To set and pursue goals in a way that is extremely beneficial for humanity (effective well-doing), people often have to employ critical thinking and far-sighted, rational decision-making in the service of the greater good. To promote effective well-doing, we need to better understand its determinants and psychological mechanisms, as well as the barriers to effective well-doing and how they can be overcome. In this article, we introduce a taxonomy of different forms of well-doing and introduce a conceptual model of the cognitive mechanisms of effective well-doing. We view effective well-doing as the upper end of a moral continuum whose lower half comprises behaviors that are harmful to humanity (ill-doing), and we argue that the capacity for effective well-doing has to be developed through personal growth (e.g., learning how to pursue goals effectively). Research on these phenomena has so far been scattered across numerous disconnected literatures from multiple disciplines. To bring these communities together, we call for the establishment of a transdisciplinary research field focussed on understanding and promoting effective well-doing and personal growth as well as understanding and reducing ill-doing. We define this research field in terms of its goals and questions. We review what is already known about these questions in different disciplines and argue that laying the scientific foundation for promoting effective well-doing is one of the most valuable contributions that the behavioral sciences can make in the 21st century.

re Lieder, F., Prentice, M., Corwin-Renner, E. Toward a Science of Effective Well-Doing May 2021 (techreport)

Preprint Project Page [BibTex]

Optimal To-Do List Gamification for Long Term Planning

Consul, S., Stojcheski, J., Felso, V., Lieder, F.

arXiv preprint arXiv:2109.06505, 2021 (techreport)

re Consul, S., Stojcheski, J., Felso, V., Lieder, F. Optimal To-Do List Gamification for Long Term Planning arXiv preprint arXiv:2109.06505, 2021 (techreport)

Reinforcement Learning Algorithms: Analysis and Applications

Belousov, B., H., A., Klink, P., Parisi, S., Peters, J.

883, Studies in Computational Intelligence, Springer International Publishing, 2021 (book)

ei Belousov, B., H., A., Klink, P., Parisi, S., Peters, J. Reinforcement Learning Algorithms: Analysis and Applications 883, Studies in Computational Intelligence, Springer International Publishing, 2021 (book)

2020

Voltage dependent interfacial magnetism in multilayer systems

Nacke, R.

Universität Stuttgart, Stuttgart, December 2020 (thesis)

mms

2020

mms Nacke, R. Voltage dependent interfacial magnetism in multilayer systems Universität Stuttgart, Stuttgart, December 2020 (thesis)

link (url) DOI Project Page [BibTex]

Towards Hybrid Active and Passive Compliant Mechanisms in Legged Robots

Milad Shafiee Ashtiani, A. A. S., Badri-Sproewitz, A.

IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, October 2020 (poster) Accepted

dlg

Abstract Poster [BibTex]

dlg Milad Shafiee Ashtiani, A. A. S., Badri-Sproewitz, A. Towards Hybrid Active and Passive Compliant Mechanisms in Legged Robots IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), IEEE, October 2020 (poster) Accepted

Abstract Poster [BibTex]

Optimal To-Do List Gamification

Stojcheski, J., Felso, V., Lieder, F.

ArXiv Preprint, 2020 (techreport)

Abstract

What should I work on first? What can wait until later? Which projects should I prioritize and which tasks are not worth my time? These are challenging questions that many people face every day. People’s intuitive strategy is to prioritize their immediate experience over the long-term consequences. This leads to procrastination and the neglect of important long-term projects in favor of seemingly urgent tasks that are less important. Optimal gamification strives to help people overcome these problems by incentivizing each task by a number of points that communicates how valuable it is in the long-run. Unfortunately, computing the optimal number of points with standard dynamic programming methods quickly becomes intractable as the number of a person’s projects and the number of tasks required by each project increase. Here, we introduce and evaluate a scalable method for identifying which tasks are most important in the long run and incentivizing each task according to its long-term value. Our method makes it possible to create to-do list gamification apps that can handle the size and complexity of people’s to-do lists in the real world.

re Stojcheski, J., Felso, V., Lieder, F. Optimal To-Do List Gamification ArXiv Preprint, 2020 (techreport)

link (url) DOI Project Page [BibTex]

Beyond Basins of Attraction: Quantifying Robustness of Natural Dynamics

Heim, S., Badri-Spröwitz, A.

May 2020 (talk)

dlg

Presentation [BibTex]

dlg Heim, S., Badri-Spröwitz, A. Beyond Basins of Attraction: Quantifying Robustness of Natural Dynamics May 2020 (talk)

Presentation [BibTex]

VP above or below? A new perspective on the story of the virtual point

Drama, Ö., Badri-Spröwitz, A.

Dynamic Walking, May 2020 (poster)

Abstract

The spring inverted pendulum model with an extended trunk (TSLIP) is widely used to investigate the postural stability in bipedal locomotion [1, 2]. The challenge of the model is to define a hip torque that generates feasible gait patterns while stabilizing the floating trunk. The virtual point (VP) method is proposed as a simplified solution, where the hip torque is coupled to the passive compliant leg force via a virtual point. This geometric coupling is based on the assumption that the instantaneous ground reaction forces of the stance phase (GRF) intersect at a single virtual point.

dlg

Poster Abstract link (url) [BibTex]

dlg Drama, Ö., Badri-Spröwitz, A. VP above or below? A new perspective on the story of the virtual point Dynamic Walking, May 2020 (poster)

Poster Abstract link (url) [BibTex]

Viscous Damping in Legged Locomotion

Mo, A., Izzi, F., Haeufle, D. F. B., Badri-Spröwitz, A.

Dynamic Walking, May 2020 (poster)

Abstract

Damping likely plays an essential role in legged animal locomotion, but remains an insufficiently understood mechanism. Intrinsic damping muscle forces can potentially add to the joint torque output during unexpected impacts, stabilise movements, convert the system’s energy, and reject unexpected perturbations.

dlg

dlg Mo, A., Izzi, F., Haeufle, D. F. B., Badri-Spröwitz, A. Viscous Damping in Legged Locomotion Dynamic Walking, May 2020 (poster)

How Quadrupeds Benefit from Lower Leg Passive Elasticity

Ruppert, F., Badri-Spröwitz, A.

Dynamic Walking, May 2020 (poster)

Abstract

Recently developed and fully actuated, legged robots start showing exciting locomotion capabilities, but rely heavily on high-power actuators, high-frequency sensors, and complex locomotion controllers. The engineering solutions implemented in these legged robots are much different compared to animals. Vertebrate animals share magnitudes slower neurocontrol signal velocities [1] compared to their robot counterparts. Also, animals feature a plethora of cascaded and underactuated passive elastic structures [2].

dlg

dlg Ruppert, F., Badri-Spröwitz, A. How Quadrupeds Benefit from Lower Leg Passive Elasticity Dynamic Walking, May 2020 (poster)

Potential for elastic soft tissue deformation and mechanosensory function within the lumbosacral spinal canal of birds

Kamska, V., Daley, M., Badri-Spröwitz, A.

Society for Integrative and Comparative Biology Annual Meeting (SICB Annual Meeting 2020), January 2020 (poster)

dlg

dlg Kamska, V., Daley, M., Badri-Spröwitz, A. Potential for elastic soft tissue deformation and mechanosensory function within the lumbosacral spinal canal of birds Society for Integrative and Comparative Biology Annual Meeting (SICB Annual Meeting 2020), January 2020 (poster)

Talk video link (url) [BibTex]

Identifying Causal Structure in Dynamical Systems

Baumann, D., Solowjow, F., Johansson, K. H., Trimpe, S.

2020 (techreport)

ics

arXiv [BibTex]

ics Baumann, D., Solowjow, F., Johansson, K. H., Trimpe, S. Identifying Causal Structure in Dynamical Systems 2020 (techreport)

arXiv [BibTex]

Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art

Janai, J., Güney, F., Behl, A., Geiger, A.

12(1-3), Foundations and Trends® in Computer Graphics and Vision, now Publishers Inc., Hanover, MA, 2020 (book)

Abstract

Recent years have witnessed enormous progress in AI-related fields such as computer vision, machine learning, and autonomous vehicles. As with any rapidly growing field, it becomes increasingly difficult to stay up-to-date or enter the field as a beginner. While several survey papers on particular sub-problems have appeared, no comprehensive survey on problems, datasets, and methods in computer vision for autonomous vehicles has been published. This monograph attempts to narrow this gap by providing a survey on the state-of-the-art datasets and techniques. Our survey includes both the historically most relevant literature as well as the current state of the art on several specific topics, including recognition, reconstruction, motion estimation, tracking, scene understanding, and end-to-end learning for autonomous driving. Towards this goal, we analyze the performance of the state of the art on several challenging benchmarking datasets, including KITTI, MOT, and Cityscapes. Besides, we discuss open problems and current research challenges. To ease accessibility and accommodate missing references, we also provide a website that allows navigating topics as well as methods and provides additional information.

avg

pdf Project Page link DOI Project Page [BibTex]

avg Janai, J., Güney, F., Behl, A., Geiger, A. Computer Vision for Autonomous Vehicles: Problems, Datasets and State-of-the-Art 12(1-3), Foundations and Trends® in Computer Graphics and Vision, now Publishers Inc., Hanover, MA, 2020 (book)

pdf Project Page link DOI Project Page [BibTex]

2019

Multivariate coupling estimation between continuous signals and point processes

Safavi, S., Logothetis, N., Besserve, M.

Neural Information Processing Systems 2019 - Workshop on Learning with Temporal Point Processes, December 2019 (talk)

2019

ei Safavi, S., Logothetis, N., Besserve, M. Multivariate coupling estimation between continuous signals and point processes Neural Information Processing Systems 2019 - Workshop on Learning with Temporal Point Processes, December 2019 (talk)

Talk video link (url) [BibTex]

ProtoGAN: Towards Few Shot Learning for Action Recognition

Dwivedi, S. K., Gupta, V., Mitra, R., Ahmed, S., Jain, A.

Proc. International Conference on Computer Vision (ICCV) Workshops, October 2019 (manual)

Abstract

Few-shot learning (FSL) for action recognition is a challenging task of recognizing novel action categories which are represented by few instances in the training data. In a more generalized FSL setting (G-FSL), both seen as well as novel action categories need to be recognized. Conventional classifiers suffer due to inadequate data in FSL setting and inherent bias towards seen action categories in G-FSL setting. In this paper, we address this problem by proposing a novel ProtoGAN framework which synthesizes additional examples for novel categories by conditioning a conditional generative adversarial network with class prototype vectors. These class prototype vectors are learnt using a Class Prototype Transfer Network (CPTN) from examples of seen categories. Our synthesized examples for a novel class are semantically similar to real examples belonging to that class and is used to train a model exhibiting better generalization towards novel classes. We support our claim by performing extensive experiments on three datasets: UCF101, HMDB51 and Olympic-Sports. To the best of our knowledge, we are the first to report the results for G-FSL and provide a strong benchmark for future research. We also outperform the state-of-the-art method in FSL for all the aforementioned datasets.

paper data [BibTex]

ps Dwivedi, S. K., Gupta, V., Mitra, R., Ahmed, S., Jain, A. ProtoGAN: Towards Few Shot Learning for Action Recognition Proc. International Conference on Computer Vision (ICCV) Workshops, October 2019 (manual)

paper data [BibTex]

Perception of temporal dependencies in autoregressive motion

Meding, K., Schölkopf, B., Wichmann, F. A.

Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

ei Meding, K., Schölkopf, B., Wichmann, F. A. Perception of temporal dependencies in autoregressive motion Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

Phenomenal Causality and Sensory Realism

Bruijns, S. A., Meding, K., Schölkopf, B., Wichmann, F. A.

Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

ei Bruijns, S. A., Meding, K., Schölkopf, B., Wichmann, F. A. Phenomenal Causality and Sensory Realism Perception, 48(2-suppl):141, 42nd European Conference on Visual Perception (ECVP), August 2019 (poster)

Neural mass modeling of the Ponto-Geniculo-Occipital wave and its neuromodulation

Shao, K., Logothetis, N., Besserve, M.

28th Annual Computational Neuroscience Meeting (CNS*2019), July 2019 (poster)

ei Shao, K., Logothetis, N., Besserve, M. Neural mass modeling of the Ponto-Geniculo-Occipital wave and its neuromodulation 28th Annual Computational Neuroscience Meeting (CNS*2019), July 2019 (poster)

Demo Abstract: Fast Feedback Control and Coordination with Mode Changes for Wireless Cyber-Physical Systems

(Best Demo Award)

Mager, F., Baumann, D., Jacob, R., Thiele, L., Trimpe, S., Zimmerling, M.

Proceedings of the 18th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), pages: 340-341, 18th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), April 2019 (poster)

ics

arXiv PDF DOI [BibTex]

ics Mager, F., Baumann, D., Jacob, R., Thiele, L., Trimpe, S., Zimmerling, M. Demo Abstract: Fast Feedback Control and Coordination with Mode Changes for Wireless Cyber-Physical Systems Proceedings of the 18th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), pages: 340-341, 18th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), April 2019 (poster)

arXiv PDF DOI [BibTex]

The Silver Ratio and its Relation to Controllability

Muehlebach, M.

2019 (techreport)

lds

lds Muehlebach, M. The Silver Ratio and its Relation to Controllability 2019 (techreport)

Prototyping Micro- and Nano-Optics with Focused Ion Beam Lithography

Keskinbora, K.

SL48, pages: 46, SPIE.Spotlight, SPIE Press, Bellingham, WA, 2019 (book)

mms

mms Keskinbora, K. Prototyping Micro- and Nano-Optics with Focused Ion Beam Lithography SL48, pages: 46, SPIE.Spotlight, SPIE Press, Bellingham, WA, 2019 (book)

Impact of trunk orientation for dynamic bipedal locomotion [DW 2018] link (url) [BibTex]

2018

Impact of Trunk Orientation for Dynamic Bipedal Locomotion

Drama, Ö.

Dynamic Walking Conference, May 2018 (talk)

Abstract

Impact of trunk orientation for dynamic bipedal locomotion My research revolves around investigating the functional demands of bipedal running, with focus on stabilizing trunk orientation. When we think about postural stability, there are two critical questions we need to answer: What are the necessary and sufficient conditions to achieve and maintain trunk stability? I am concentrating on how morphology affects control strategies in achieving trunk stability. In particular, I denote the trunk pitch as the predominant morphology parameter and explore the requirements it imposes on a chosen control strategy. To analyze this, I use a spring loaded inverted pendulum model extended with a rigid trunk, which is actuated by a hip motor. The challenge for the controller design here is to have a single hip actuator to achieve two coupled tasks of moving the legs to generate motion and stabilizing the trunk. I enforce orthograde and pronograde postures and aim to identify the effect of these trunk orientations on the hip torque and ground reaction profiles for different control strategies.

dlg

2018

dlg Drama, Ö. Impact of Trunk Orientation for Dynamic Bipedal Locomotion Dynamic Walking Conference, May 2018 (talk)

Impact of trunk orientation for dynamic bipedal locomotion [DW 2018] link (url) [BibTex]

Poster Abstract: Toward Fast Closed-loop Control over Multi-hop Low-power Wireless Networks

Mager, F., Baumann, D., Trimpe, S., Zimmerling, M.

Proceedings of the 17th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), pages: 158-159, Porto, Portugal, April 2018 (poster)

ics

ics Mager, F., Baumann, D., Trimpe, S., Zimmerling, M. Poster Abstract: Toward Fast Closed-loop Control over Multi-hop Low-power Wireless Networks Proceedings of the 17th ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), pages: 158-159, Porto, Portugal, April 2018 (poster)

Representation of sensory uncertainty in macaque visual cortex

Goris, R., Henaff, O., Meding, K.

Computational and Systems Neuroscience (COSYNE) 2018, March 2018 (poster)

ei Goris, R., Henaff, O., Meding, K. Representation of sensory uncertainty in macaque visual cortex Computational and Systems Neuroscience (COSYNE) 2018, March 2018 (poster)

Detailed Dense Inference with Convolutional Neural Networks via Discrete Wavelet Transform

Ma, L., Stueckler, J., Wu, T., Cremers, D.

arxiv, 2018, arXiv:1808.01834 (techreport)

ev Ma, L., Stueckler, J., Wu, T., Cremers, D. Detailed Dense Inference with Convolutional Neural Networks via Discrete Wavelet Transform arxiv, 2018, arXiv:1808.01834 (techreport)

Generalized phase locking analysis of electrophysiology data

Safavi, S., Panagiotaropoulos, T., Kapoor, V., Logothetis, N. K., Besserve, M.

7th AREADNE Conference on Research in Encoding and Decoding of Neural Ensembles, 2018 (poster)

ei Safavi, S., Panagiotaropoulos, T., Kapoor, V., Logothetis, N. K., Besserve, M. Generalized phase locking analysis of electrophysiology data 7th AREADNE Conference on Research in Encoding and Decoding of Neural Ensembles, 2018 (poster)

On the Approximation of Constrained Linear Quadratic Regulator Problems and their Application to Model Predictive Control

Muehlebach, M., D’Andrea, R.

2018 (techreport)

lds

lds Muehlebach, M., D’Andrea, R. On the Approximation of Constrained Linear Quadratic Regulator Problems and their Application to Model Predictive Control 2018 (techreport)

NEWMA: a new method for scalable model-free online change-point detection

Keriven, N., Garreau, D., Poli, I.

2018 (techreport)

slt

slt Keriven, N., Garreau, D., Poli, I. NEWMA: a new method for scalable model-free online change-point detection 2018 (techreport)

Pérez-Pellitero, E., Sajjadi, M. S. M., Hirsch, M., Schölkopf, B.

Photorealistic Video Super Resolution

Workshop and Challenge on Perceptual Image Restoration and Manipulation (PIRM) at the 15th European Conference on Computer Vision (ECCV), 2018 (poster)

ei Pérez-Pellitero, E., Sajjadi, M. S. M., Hirsch, M., Schölkopf, B. Photorealistic Video Super Resolution Workshop and Challenge on Perceptual Image Restoration and Manipulation (PIRM) at the 15th European Conference on Computer Vision (ECCV), 2018 (poster)

Retinal image quality of the human eye across the visual field

Meding, K., Hirsch, M., Wichmann, F. A.

14th Biannual Conference of the German Society for Cognitive Science (KOGWIS 2018), 2018 (poster)

ei Meding, K., Hirsch, M., Wichmann, F. A. Retinal image quality of the human eye across the visual field 14th Biannual Conference of the German Society for Cognitive Science (KOGWIS 2018), 2018 (poster)

2017

Improving performance of linear field generation with multi-coil setup by optimizing coils position

Aghaeifar, A., Loktyushin, A., Eschelbach, M., Scheffler, K.

Magnetic Resonance Materials in Physics, Biology and Medicine, 30(Supplement 1):S259, 34th Annual Scientific Meeting of the European Society for Magnetic Resonance in Medicine and Biology (ESMRMB), October 2017 (poster)

2017

ei Aghaeifar, A., Loktyushin, A., Eschelbach, M., Scheffler, K. Improving performance of linear field generation with multi-coil setup by optimizing coils position Magnetic Resonance Materials in Physics, Biology and Medicine, 30(Supplement 1):S259, 34th Annual Scientific Meeting of the European Society for Magnetic Resonance in Medicine and Biology (ESMRMB), October 2017 (poster)

Estimating B0 inhomogeneities with projection FID navigator readouts

Loktyushin, A., Ehses, P., Schölkopf, B., Scheffler, K.

25th Annual Meeting and Exhibition of the International Society for Magnetic Resonance in Medicine (ISMRM), April 2017 (poster)

ei Loktyushin, A., Ehses, P., Schölkopf, B., Scheffler, K. Estimating B0 inhomogeneities with projection FID navigator readouts 25th Annual Meeting and Exhibition of the International Society for Magnetic Resonance in Medicine (ISMRM), April 2017 (poster)