Events & Talks

Workshop 12-07-2022 Movie Screening "Coded Bias" and Discussion CODED BIAS explores the fallout of MIT Media Lab researcher Joy Buolamwini’s discovery that facial recognition does not see dark-skinned faces accurately, and her journey to push for the first-ever legislation in the U.S. to govern against bias in the algorithms that impact us all. Ksenia Keplinger Monika Kotz Oliwia Gust Claudia Daefler

Physical Intelligence Talk Prof. Xuanhe Zhao 07-07-2022 Soft Materials Innovation for Health and Sustainability Polymers and water are the major components that constitute most living species on the earth, ranging from animals, plants, and fungi to bacteria. Polymers are also pervasive and indispensable in almost every aspect of our daily life, ranging from food, clothing, housing, and healthcare to transportation, communication and entertainment. Furthermore, over 6% of global electricity generated from coal is used to make plastics, and microplastics are already ubiquitous in global biosphere. Intrigued by their ubiquity and impacts, MIT Zhao Lab is focused on the study and development of soft mate...

Event 02-07-2022 2022 Science & Innovation Days Tübingen MPI-IS Tübingen präsentiert Forschungsaktivitäten am 2. Juli 2022: Capture Hall, Robotic Lab, Sensor Finger, Kinderuni-Video Claudia Daefler Georg Martius Huanbo Sun Tsvetelina Alexiadis Claudia Gallatz Felix Grimminger Majid Khadiv

Conference 28-06-2022 - 29-06-2022 IMPRS-IS Prolongation: On-Site Evaluation The IMPRS-IS Ph.D. program is currently undergoing a prolongation process to apply for six more years of funding. This process involves an on-site visit from a team of external evaluators. During this visit, the evaluation committee will visit the two sites of MPI-IS. MPI-IS community members are welcome to join for the event’s scientific talks and poster sessions. Katherine J. Kuchenbecker Leila Masri Sara Sorce

Robotic Materials Workshop 15-06-2022 - 18-06-2022 Shaping the Future of Robotics through Materials Innovation The goal of this workshop is to bring together a group of international experts working at the intersection of materials science and robotics to discuss how materials innovation can shape the future of robotics. The workshop will feature invited talks that stimulate subsequent organized breakout sessions to discuss key future research themes and to set the course in the field. The meeting will take place at Castle Ringberg in the south of Germany, which offers an inspiring setting to discuss cutting edge research, to initiate new collaborations, and to reinvigorate existing connections. Philipp Rothemund Christoph Keplinger

Perceiving Systems Talk Rana Hanocka 13-06-2022 Shape editing, generation, and stylization Manual authoring of 3D content is a laborious and tedious task. In this talk, I present some of 3DL's recent and on-going efforts toward building tools which provide intuitive control for editing, manipulating, and generating 3D shapes. I will discuss how recent advancements, such as joint vision-language embedding spaces can be used to stylize 3D objects, driven by natural language. Finally, I will conclude with ongoing and future work in this direction, as well as other related areas. Omid Taheri

Perceiving Systems Talk Mohammed Hassan 13-06-2022 Title: Synthesizing Physical Character-Scene Interactions Movement is how people interact with and affect their environment. For realistic virtual character animation, it is necessary to realistically synthesize such interactions between virtual characters and their surroundings. Despite recent progress in character animation using machine learning, most systems focus on controlling an agent's movements in fairly simple and homogeneous environments, with limited interactions with other objects. Furthermore, many previous approaches that synthesize human-scene interaction require significant manual labeling of the training data. In contrast, we pre... Nikos Athanasiou

Perceiving Systems Talk Youngjoong Kwon 09-06-2022 Learning to create Digital Humans: Generalizable Radiance Fields for Human Performance Rendering In this work, we aim at synthesizing a free-viewpoint video of an arbitrary human performance using sparse multi-view cameras. Recently, several works have addressed this problem by learning person-specific neural radiance fields (NeRF) to capture the appearance of a particular human, In parallel, some work proposed to use pixel-aligned features to generalize radiance fields to arbitrary new scenes and objects. Adopting such generalization approaches to humans, however, is highly challenging due to the heavy occlusions and dynamic articulations of body parts. To tackle this, we propose a no... Yuliang Xiu

Perceiving Systems Talk Tianye Li 07-06-2022 Reconstruction and Synthesis for Dynamic Humans and Scenes This thesis focuses on automated systems to capture realistic 4D visual content for general humans and scenes, such that we can animate and replay the captured content. Firstly, we design a system to reconstruct and register a large quantity of high-quality 4D faces across identities, expressions, and poses by utilizing geometric, photometric, and motion cues. Based on well-curated datasets we propose a lightweight yet expressive face model that works on a wide range of populations, by separately modeling the shape (identity), expression, and poses of human faces. Secondly, we design an inf... Nikos Athanasiou Timo Bolkart

Physical Intelligence Talk Renee Zhao 31-05-2022 Multifunctional magnetic origami robots Millimeter/centimeter-scale origami robots have recently been explored for biomedical applications due to their inherent shape-morphing capability. However, they mainly rely on passive or/and irreversible deformation that significantly hinders the clinic functions in an on-demand manner. Here, we report magnetically actuated origami robots that can crawl and swim for effective locomotion and targeted drug delivery in severely confined spaces and aqueous environments. We design our robots based on the Kresling origami, whose thin shell structure 1) provides an internal cavity for drug storag... Metin Sitti

Event 05-05-2022 "Warum sind Computer dumm?" Machine Learning und KI-Forscher Bernhard Schölkopf macht mit bei der digitalen Kinder-Uni der Hector Kinderakademien Wann? Donnerstag, den 05. Mai 2022 von 17:00 – 18:00 Uhr

Perceiving Systems Talk Jiashi Feng 02-05-2022 Learning to estimate 3D human poses without labeled data Estimating 3D human poses from images or videos is a fundamental task in computer vision. However, the limitation of training data with high-quality 3D pose annotations largely hinder its development and deployment in real applications. In this talk, I will introduce our recent works on training 3D pose estimation models without requiring 3D labeled data. Our first step is to present PoseAug, a new auto-augmentation framework that learns to augment the available training poses towards a greater diversity and thus improve generalization of the trained 2D-to-3D pose estimator. Specifically, P... Michael Black

Perceiving Systems Talk Lixin Yang 25-04-2022 Leverage Kinematic and Contact constraints for understanding hand-object interaction My works focus on inferring and understanding the human hand’s interaction with objects from visual inputs, which include several tasks like pose estimation, grasping pose generation, and interacting pose transfer. Unlike the single-body pose estimation task, understanding the Hand-object (multi-bodies) interactions in 3D spaces is more challenging, due to its high degree of articulations, the projection ambiguity, self or mutual occlusions, and the complicated physical constraints. Designing algorithms to tackle these challenges is my goal. We find that the mutual contact can provide rich ... Yuliang Xiu

Perceiving Systems Talk Chunlu Li 19-04-2022 Model-based Face Reconstruction and Occlusion Segmentation from Weak Supervision 3D face reconstruction under occlusions is highly challenging because of the large variability of the appearance and location of occluders. Currently, the most successful methods fit a 3D face model through inverse rendering and assume a given segmentation of the occluder to avoid fitting the occluder. However, the segmentation annotations are costly since training an occlusion segmentation model requires large amounts of annotated data. To overcome this, we introduce a model-based approach for 3D face reconstruction that is highly robust to occlusions but does not require any occlusion ann... Victoria Fernandez Abrevaya

Perceiving Systems Talk Angela Yao 12-04-2022 Mixing Synthetic and Real-World Captures for RGB Hand Pose Estimation How can we learn models for hand pose estimation without any (real-world) labels? This talk presents our recent efforts in tackling the challenging scenario of learning from labelled synthetic data and unlabelled real-world data. I will focus on two strategies that we find to be effective: (1) cross-modal consistency and alignment for representation learning and (2) pseudo-label corrections and refinement. The second part of the talk will introduce Assembly101, our newly recorded dataset that tackles 3D hand pose and action understanding over time. Assembly101 is a new procedural activit... Dimitris Tzionas

Physical Intelligence Talk David J. Cappelleri 11-04-2022 Microrobotics to Micro Aerial Vehicles: Robots Interacting with the Environment The Multi-Scale Robotics & Automation Lab (MSRAL) at Purdue University performs cutting-edge research on robotic and automation systems at various length scales: macro-scale (cm to m), meso-scale (~100's of um to a few mm's), and micro-scale (10's of um to 100's of um). All of the developed systems are designed to interact with the environment in unique ways. In this talk, I will discuss some recent MSRAL microrobotics projects on developing learned models for 2D micromanipulation tasks and different types of families of wireless mobile microrobots driven by external magnetic fields that w... Metin Sitti

Haptic Intelligence Talk Dominika Lisy 07-04-2022 Boundary-Crossing Empathy: The Figuration of the Skin, Bodies, and Boundaries What does it mean to have empathic interactions with robots? What is the role of a body, its surface, and the sense of self for building relations? And how does it change what it means to be human? These could be seen as overarching questions of my PhD project which aims to provide a feminist ethical framework for designing and imagining interactions with robots. I am interested in thinking about the role of binary divides such as human/non-human, self/other or reason/emotion in affective human-robot interaction. I want to look closely at their conceptual and material relations and under... Katherine J. Kuchenbecker

Perceiving Systems Talk Henry Clever 07-04-2022 Modeling Humans at Rest with Applications to Robotic Assistance Humans spend a large part of their lives resting. Machine perception of this class of body poses would be beneficial to numerous applications, but it is complicated by line-of-sight occlusion from bedding. Pressure sensing mats are a promising alternative, but data is challenging to collect at scale. To overcome this, we use modern physics engines to simulate bodies resting on a soft bed with a pressure sensing mat. This method can efficiently generate data at scale for training deep neural networks. We present a deep model trained on this data that infers 3D human pose and body shape from ... Dimitris Tzionas Chun-Hao Paul Huang

Perceiving Systems Talk Sida Peng 07-04-2022 Reconstructing Static Scenes and Dynamic Humans with Implicit Neural Representations 3D reconstruction is a long-standing problem in computer vision and has a variety of applications such as virtual reality, 3D content generation, and telepresence. In this talk, I will present our progress on 3D reconstruction of static scenes and dynamic humans with implicit neural representations. The first part of the talk introduces an effective regularization when optimizing implicit neural representations on indoor scenes based on the Manhattan-world Assumption. In the second part, I will show some animatable implicit neural representations for modeling dynamic humans from videos. Hongwei Yi

Haptic Intelligence Talk Alborz Aghamaleki Sarvestani 05-04-2022 Mechanical Design, Development and Testing of Bioinspired Legged Robots for Dynamic Locomotion Animals like ostriches perform complex locomotion tasks in the presence of large neurocontrol delays and potentially with limited central command. It is surprising that legged robots with high control frequencies and microsecond-range control delays are still unable to compete with legged animals in terms of agility, robustness, performance, and energy efficiency. These observations led us to look closely at animals to draw inspiration and improve robotic leg designs. For example, we observed that certain leg joints moved in a coordinated manner but without neural command when manually flex... Katherine J. Kuchenbecker

Haptic Intelligence Talk Giulia Ballardini 18-03-2022 Assessment and Enhancement of Proprioceptive Performance In daily living activities, proprioception – information about limbs’ position and movement and the force that they applied - is fundamental to respond to the environment and rapidly react to changing circumstances. For example, it allows us to maneuver and find our way around obstacles in the dark and manipulate objects out of view, preventing their slippage. Many neurological conditions and traumatic events affect motor and somatosensory functions. Reliable methods to quantify proprioceptive deficits are crucial for better understanding the pathophysiology of disability, enhancing the det... Katherine J. Kuchenbecker

Haptic Intelligence Talk Buse Aktaş 17-03-2022 Multidimensional Tunable Mechanics Using Jamming Jamming is a structural phenomenon that provides tunable mechanical behavior. A jamming structure typically consists of a collection of elements with low effective stiffness and damping. When a pressure gradient, such as vacuum, is applied, kinematic and frictional coupling increase, resulting in dramatically altered mechanical properties. This results in a number of functional capabilities useful for robotics applications including: tunable stiffness, tunable force threshold, tunable dynamic response, reversible plasticity, shape locking, and variable kinematics. Engineers have used jammin... Katherine J. Kuchenbecker

Haptic Intelligence Talk Gemma Carolina Bettelani 14-03-2022 On the Role of Tactile Perception for the Representation of Motion and Space: Modeling and Applications to Advanced Human-Machine Interaction It is well known from the literature that cutaneous touch plays a crucial role in the perception of physical properties of the objects (e.g. shape, texture). However, the tactile mechanoreceptors are also important in building a perceptual representation of space and motion and in guiding and controlling human movements. Unveiling and mathematically modelling the components underpinning these phenomena is important not only to shed light on the neuroscientific mechanisms of the human somatosensory system but also to design artificial devices and experimental protocols for advanced human-mac... Katherine J. Kuchenbecker

Max Planck Lecture Professor Bilge Yildiz 10-03-2022 Understanding and tuning the surface chemistry of perovskite oxides to activate oxygen exchange and water splitting reactions The deployment of decarbonization technologies, including solid oxide fuel and electrolysis cells, is limited by slow rates of conversion reactions at surfaces, and instability of materials under operating conditions. A major scientific challenge has been the lack of knowledge of the chemistry and electronic structure on material surfaces in the harsh operational conditions.

Perceiving Systems Talk Pinelopi Papalampidi 08-02-2022 Structure-aware Narrative Understanding and Summarization In this work, we analyze and summarize full-length movies from multimodal input (i.e., video, text, audio). We first hypothesize that identifying the narrative structure of movies is a precondition for summarizing them. According to screenwriting theory, turning points (e.g., change of plans, major setback, climax) are crucial narrative moments within a movie that define the narrative structure and determine its progression and thematic units. Therefore, we introduce the task of Turning Point (TP) identification and leverage it for movie summarization and trailer generation. Next, we propos... Nikos Athanasiou Chun-Hao Paul Huang

Perceiving Systems Talk Ye Yuan 18-01-2022 Unified Simulation, Perception, and Generation of Human Behavior Understanding and modeling human behavior is fundamental to almost any computer vision and robotics applications that involve humans. In this talk, I will present a holistic approach to human behavior modeling and tackle its three essential aspects --- simulation, perception, and generation. I will show how the three aspects are deeply connected and how utilizing and improving one aspect can greatly benefit the other aspects. Since humans live in a physical world, we treat simulation as the foundation of our approach and start by developing a fundamental framework for representing human ... Hongwei Yi

Conference 12-01-2022 - 13-01-2022 Scientific Symposium All current and former employees and friends of the Max Planck Institute for Intelligent Systems and Cyber Valley are welcome to attend this event. If you have any questions, please contact Cyber Valley Research Coordinator - Florian Mayer (florian.mayer@cyber-valley.de) Bernhard Schölkopf Metin Sitti Michael Black Moritz Hardt Christoph Keplinger Katherine J. Kuchenbecker Matthias Tröndle Florian Mayer

Perceiving Systems Talk Tiantian Wang 11-01-2022 Animatable humans from monocular RGB(D) videos We aim to reconstruct animatable humans from monocular RGB(D) videos. Learning user-controlled representation under novel poses remains a challenging problem. To tackle this problem, I will introduce two related methods. First, to reconstruct animatable photo-realistic humans, we integrate observations across frames and encode the appearance at each individual frame by utilizing the human pose and point clouds as the input. In addition, we utilize a temporal transformer to integrate the features of points in the unseen frames and the tracked points in a handful of automatically-selected key... Arjun Chandrasekaran

Perceiving Systems Talk Arianna Rampini 14-12-2021 Discrete inverse spectral geometry for shape analysis Spectral quantities as the eigenvalues of the Laplacian operator are widely used in geometry processing since they provide a very informative summary of the intrinsic geometry of deformable shapes. Typically, the intrinsic properties of shapes are computed from their representation in 3D space and are used to encode compact geometric features, thus adopting a data-reduction principle. On the contrary, this talk focuses on the inverse problem: namely, recovering an extrinsic embedding from a purely intrinsic encoding, like in the classical “hearing the shape of the drum” problem. I will sta... Silvia Zuffi

Perceiving Systems Talk Yajie Zhao 10-12-2021 Next Generation Lifelike Avatar Creation High-fidelity avatar creation for films and games is tied with complex capture equipment, massive data, a long production cycle, and intensive manual labor by a production team. And it may still be in the notorious Uncanny Valley. In this talk, we will explore how to produce a lifelike avatar in a low-cost way. We will show how to leverage deep learning networks to accelerate and simplify the industrial avatar production procedure from data capturing to animation. And bring photorealism to the next level! Timo Bolkart

Empirical Inference Event 08-12-2021 NeurIPS 2021 Meetup @MPI-IS After almost 2 years of virtual conferences and with little in-person interaction we are happy to announce that the Empirical Inference Department at MPI-IS Tübingen will host an official NeurIPS 2021 Meetup as an in-person event at our institute. Annika Buchholz Maximilian Dax Heiner Kremer Lars Lorch Yucen Luo Bernhard Schölkopf

Haptic Intelligence Talk Arnaud Allemang--Trivalle 07-12-2021 Trimanipulation: Virtual reality training platform Supernumerary robotic limbs could significantly impact human capabilities, offering people to achieve actions that are not possible with only two natural hands. However, as three-hand control is not typical in everyday activities, it is currently unknown how to train people to acquire this "super" capability. In this talk, I will present a virtual reality trimanual platform that I developed during my master's thesis. This system offers to control three virtual hands separately or together in three degrees of freedom. The dominant foot served as the additional source of motor commands for t... Katherine J. Kuchenbecker

Haptic Intelligence Talk David Gueorguiev 25-11-2021 Vibrotactile Patterns for Haptic Surfaces I will explore several rendering solutions for providing rich haptic feedback on surfaces. The main topics will be potential physical barriers to propagation of vibrations in the tactile range, rendering of real-life haptic interactions such as virtual musical instruments, and the potential use of haptic illusions for navigation aids. Katherine J. Kuchenbecker

Haptic Intelligence IS Colloquium Wenzhen Yuan 09-11-2021 Simulating the GelSight Sensors: From Physics to Data In recent years, vision-based high-resolution tactile sensors such as GelSight have been widely used because the rich signal provides useful information regarding the state of the robot and the environment. However, a major barrier for applying tactile sensors like GelSight is the cost. To make the tactile sensors more accessible to a broader community, we propose to build a simulation model for vision-based tactile sensors like GelSight. We explore two modeling methods for making the model: a physically-based method that uses rendering technologies to simulate the sensor's optical design a... Katherine J. Kuchenbecker

Talk Prof. Guoqiang Bi 11-10-2021 Visualizing the multi-scale complexity of the brain.

Perceiving Systems Talk Yandong Wen 05-10-2021 Toward Reconstructing Face from Voice We address a new challenge posed by voice profiling - reconstructing someone’s face from their voice. Specifically, given an audio clip spoken by an unseen person, we aim to reconstruct a face that has as many associations as possible with the speaker in terms of identity. In this talk, I will introduce how we explore and approach the ultimate goal step by step. First, we investigate the audio-visual association by matching voices to faces based on identity, and vice versa. Second, we set up a baseline for reconstructing 2D face images from a voice recording and show reasonable reconstructi... Timo Bolkart

Event 30-09-2021 Jubiläum: 10 Jahre MPI-IS & 100 Jahre MPI-MF Das Max-Planck-Institut für Intelligente Systeme in Stuttgart und Tübingen begeht in diesem Jahr ein doppeltes Jubiläum. Als eines der ältesten und größten Institute der Max-Planck-Gesellschaft feiert das Max-Planck-Institut für Metallforschung sein 100-jähriges Bestehen. Gleichzeitig feiern wir auch das 10-jährige Bestehen des Max-Planck-Instituts für Intelligente Systeme, das aus der wissenschaftlichen Neuausrichtung des Instituts im Jahr 2011 hervorgegangen ist. Lassen Sie uns gemeinsam dieses für unser Institut his... Bernhard Schölkopf Matthias Tröndle Barbara Kettemann Oliwia Gust Claudia Daefler Alejandro Posada Nassim Taghipour Katherine J. Kuchenbecker Gisela Schütz

Perceiving Systems Talk Yuxiang Zhang and Yang Zheng 28-09-2021 DeepMultiCap & Lightweight Multi-person Total Motion Capture Using Sparse Multi-view Cameras We propose DeepMultiCap, a novel method for multi-person performance capture using sparse multi-view cameras. Our method can capture time varying surface details without the need of using pre-scanned template models. To tackle the serious occlusion challenge for close interacting scenes, we combine a recently proposed pixel-aligned implicit function with a parametric model for robust reconstruction of the invisible surface areas. An effective attention-aware module is designed to obtain the fine-grained geometry details from multi-view images, where high-fidelity results can be generated. I... Chun-Hao Paul Huang

Perceiving Systems Talk Meng-Yu Jennifer Kuo 27-09-2021 Refraction and Absorption for Underwater Shape Recovery In this talk the speaker will present her work on the recovery of rigid and deformable 3D shape from underwater images. Silvia Zuffi

Talk Prof. Shahd Safarani and Fabian Sinz 27-09-2021 Towards a robust vision by multi-task learning on monkey visual cortex.

Haptic Intelligence Talk Carlo Sferrazza 24-09-2021 Data-driven, Vision-based Tactile Sensing: Design, Simulation, and Applications to Robot Control Katherine J. Kuchenbecker

Perceiving Systems Talk Tianye Li 23-09-2021 Topologically Consistent Multi-View Face Inference Using Volumetric Sampling High-fidelity face digitization solutions often combine multi-view stereo (MVS) techniques for 3D reconstruction and a non-rigid registration step to establish dense correspondence across identities and expressions. A common problem is the need for manual clean-up after the MVS step, as 3D scans are typically affected by noise and outliers and contain hairy surface regions that need to be cleaned up by artists. Furthermore, mesh registration tends to fail for extreme facial expressions. Most learning-based methods use an underlying 3D morphable model (3DMM) to ensure robustness, but this li... Timo Bolkart

Perceiving Systems Talk Siwei Zhang 22-09-2021 Learning motion priors for 4D human body capture in 3D scenes It is challenging to recover realistic human-scene interactions and high-quality human motions while dealing with occlusions and partial views with a monocular RGB(D) camera. We address this problem by learning motion smoothness and infilling priors from the large scale mocap dataset AMASS, to reduce the jitters, and handle contacts and occlusions, respectively. Furthermore, we combine them into a multi-stage optimization pipeline for the high quality 4D human capture in complex 3D scenes. Chun-Hao Paul Huang

Talk Prof. Cavanagh, Patrick 13-09-2021 The role of motion in localizing objects

Perceiving Systems Talk Bharat Lal Bhatnagar 09-09-2021 Hybrid surface representations: Leveraging implicit functions and parametric models for 3D human modelling Representing 3D humans with parametric body models (eg: SMPL) allows us to control the 3D appearance of a human with explicit parameters for pose, shape and even clothing (to an extent). Implicit function based representations on the other hand, typically lack such interpretable control but can produce more detailed models as compared to parametric approaches. They also are not constrained by topology and resolution. In this talk I would like to discuss how we can combine these two directions and leverage the best of both worlds to model detailed and controllable 3D humans. I will primari... Ahmed Osman Arjun Chandrasekaran

Perceiving Systems Talk Jiefeng Li 06-09-2021 From skeleton to body: Keypoint Estimation is Helpful for Human Body Reconstruction My works mainly lie in inferring human structures from RGB inputs, which starts from 2D keypoint estimation, towards more complex tasks like 3D skeleton inference and SMPL-based human pose & shape estimation. Along this road, we find that high-level tasks, like human body estimation, can benefit a lot from low-level inferred structures, like 3D skeletons, and vice versa. Furthermore, in our latest work, "Human Pose Regression with Residual Log-likelihood Estimation", we unified all the above HPS tasks in a direct regression paradigm, replacing generally accepted heatmap without loss of accu... Yuliang Xiu

Haptic Intelligence PhD Thesis Defense 12-08-2021 HuggieBot: An Interactive Hugging Robot with Visual and Haptic Perception Hugs are one of the first forms of contact and affection humans experience. Receiving a hug is one of the best ways to feel socially supported, and the lack of social touch can have severe adverse effects on an individual's well-being. Due to the prevalence and health benefits of hugging, roboticists are interested in creating robots that can hug humans as seamlessly as humans hug other humans. However, hugs are complex affective interactions that need to adapt to the height, body shape, and preferences of the hugging partner, and they often include intra-hug gestures like squeezes. This di... Alexis Block Katherine J. Kuchenbecker

Perceiving Systems Talk Davis Rempe 27-07-2021 Modeling 3D Human Motion for Improved Pose Estimation Though substantial progress has been made in estimating 3D human poses from dynamic observations, recent methods still struggle to recover physically-plausible motions, and the presence of noise and occlusions remains challenging. In this talk, I'll introduce two methods that tackle these issues by leveraging models of 3D human motion - one physics-based and one learned. In the first approach, an initial 3D motion is refined using a physics-based trajectory optimization that leverages automatically-detected foot contacts from RGB video. In the second, a learned generative model is used as a... Muhammed Kocabas

Perceiving Systems Talk Hao Li 26-07-2021 AI SYNTHESIS: FROM AVATARS TO 3D SCENES In this talk I will motivate how digital humans will impact the future of communication, human-machine interaction, and content creation. I will present our latest 3D avatar digitization technology from Pinscreen from a single photo, and give a live demonstration. I will also showcase how we use hybrid CG and neural rendering solutions for real-time applications used in next generation virtual assistant and virtual production pipelines. I will then present a real-time teleportation system that only uses a single webcam as input, and our latest efforts at UC Berkeley in real-time AI synthesi... Yao Feng

Event 22-07-2021 2021 Ph.D. Graduation Ceremony With this Graduation Ceremony, we celebrate the success of 21 young researchers who successfully defended their doctoral theses during the past 12 months. Six world-class universities are awarding doctoral degrees to this year’s batch of graduating students, who are affiliated either directly with MPI-IS or indirectly through our doctoral programs (Cam-Tue, CLS, CMU, and IMPRS-IS). Cäcilia Heinisch Sarah Danes Sara Sorce Leila Masri

Forschung

Abteilungen

Forschungsgruppen

Personen

Kontakt

Our Institute

Unsere Geschichte

Karriere

Überblick über Promotionsprogramme

Karriere

Service-Einrichtungen

Zentrale Wissenschaftliche Einrichtungen

Werkstätten

Campus Services

Impact

Kooperationen

Initiativen und Partner

Forschung

Abteilungen

Forschungsgruppen

Personen

Kontakt

Our Institute

Unsere Geschichte

Karriere

Überblick über Promotionsprogramme

Karriere

Service-Einrichtungen

Zentrale Wissenschaftliche Einrichtungen

Werkstätten

Campus Services

Impact

Kooperationen

Initiativen und Partner

Events & Talks