3DiFace: Synthesizing and Editing Holistic 3D Facial Animations | Neural Capture and Synthesis – Max Planck Institute for Intelligent Systems

Institute Homepage

Institute Homepage Sign In

Research Overview

Digital Humans in Motion

Digital Multi-Media Forensics

Digitization of Objects and Scenes

Capturing Humans, Objects and Scenes

MICA: Towards Metrical Reconstruction of Human Faces

GAN-Avatar: Controllable Personalized GAN-based Human Head Avatars

INSTA: Instant Volumetric Head Avatars

Motion Synthesis

Imitator: Personalized Speech-driven 3D Facial Animation

FaceTalk: Audio-driven Motion Diffusion for Neural Parametric Head Models

3DiFace: Synthesizing and Editing Holistic 3D Facial Animations

(Generative) Appearance Modelling and Editing

HAAR: Tex-conditioned Generative Model of 3D Strand-based Human Hairstyles

High-Res Facial Appearance Capture from Polarized Smartphone Images

Stable Video Portraits

Neural Capture and Synthesis

3DiFace: Synthesizing and Editing Holistic 3D Facial Animations

3diface — Denoising diffusion model for synthesizing holistic facial animation.

3DiFACE is a lightweight audio-conditioned diffusion model, which produces diverse plausible lip and head motions for a single audio input, while also allowing editing via keyframing and interpolation.