High-Res Facial Appearance Capture from Polarized Smartphone Images | Neural Capture and Synthesis – Max Planck Institute for Intelligent Systems

Institute Homepage

Institute Homepage Sign In

Research Overview

Digital Humans in Motion

Digital Multi-Media Forensics

Digitization of Objects and Scenes

Capturing Humans, Objects and Scenes

MICA: Towards Metrical Reconstruction of Human Faces

GAN-Avatar: Controllable Personalized GAN-based Human Head Avatars

INSTA: Instant Volumetric Head Avatars

Motion Synthesis

Imitator: Personalized Speech-driven 3D Facial Animation

FaceTalk: Audio-driven Motion Diffusion for Neural Parametric Head Models

3DiFace: Synthesizing and Editing Holistic 3D Facial Animations

(Generative) Appearance Modelling and Editing

HAAR: Tex-conditioned Generative Model of 3D Strand-based Human Hairstyles

High-Res Facial Appearance Capture from Polarized Smartphone Images

Stable Video Portraits

Neural Capture and Synthesis

High-Res Facial Appearance Capture from Polarized Smartphone Images

Polface — Capturing high quality facial appearance maps at home.

We propose a novel method for high-quality facial texture reconstruction from RGB images using a novel capturing routine based on a single smartphone which we equip with an inexpensive polarization foil. Using differentiable rendering, we reconstruct the high-quality material properties of the skin from this smartphone data.