Institute Homepage
Institute Homepage Sign In
Max Planck Institute for Intelligent Systems
  • Research
  • Publications
  • Alumni
NEURAL CAPTURE AND SYNTHESIS
  • Research
  • Publications
  • Alumni

Back

Research Overview

Digital Humans in Motion

Digital Multi-Media Forensics

Digitization of Objects and Scenes

Capturing Humans, Objects and Scenes

MICA: Towards Metrical Reconstruction of Human Faces

GAN-Avatar: Controllable Personalized GAN-based Human Head Avatars

INSTA: Instant Volumetric Head Avatars

Motion Synthesis

Imitator: Personalized Speech-driven 3D Facial Animation

FaceTalk: Audio-driven Motion Diffusion for Neural Parametric Head Models

3DiFace: Synthesizing and Editing Holistic 3D Facial Animations

(Generative) Appearance Modelling and Editing

HAAR: Tex-conditioned Generative Model of 3D Strand-based Human Hairstyles

High-Res Facial Appearance Capture from Polarized Smartphone Images

Stable Video Portraits

Neural Capture and Synthesis

Stable Video Portraits

Svp
Personalized video diffusion with 3D control.
Stable Video Portraits is a novel hybrid 2D/3D generation method that outputs photorealistic videos of talking faces leveraging a large pre-trained text-to-image prior (2D), controlled via a 3DMM (3D). It is based on a personalized image diffusion prior which allows us to generate new videos of the subject, and also to edit the appearance by blending the personalized image prior with a general text-conditioned model.
Max Planck Institute for Intelligent Systems

Max-Planck-Ring 4 72076 Tübingen Germany

Heisenbergstr. 3 70569 Stuttgart Germany

info@is.mpg.de

LinkedIn
Youtube
Facebook
Instagram

Research

Publications

DEPARTMENTS Empirical Inference Haptic Intelligence Perceiving Systems Physical Intelligence Robotic Materials Social Foundations of Computation RESEARCH GROUPS Algorithms and Society Biomimetic Materials and Machines Deep Models and Optimization Human Aspects of Machine Learning Learning and Dynamical Systems Neuromechanics of Movement Organizational Leadership and Diversity Robotic Composites and Compositions Robust Machine Learning Safety- and Efficiency- aligned Learning

People

Career

News

Events

Talks

Service SERVICES Administration Fine Mechanical Workshop Glass workshop IT Services Library Stuttgart Mechatronics Workshop Scientific Coordination Office FACILITIES Materials Medical Systems Optics and Sensing Laboratory Robotics Scientific Computing Software Workshop

Institute Campus & Guest House Boards & Members Collaborations Athena Group Contact Wiki (Internal)

© 2025 Max-Planck-Gesellschaft Imprint Privacy Policy Social Policy

For website questions and technical problems please contact web@is.mpg.de

Sign In

This website uses cookies to ensure you get the best experience. Learn more.

More information