Institute Homepage
Institute Homepage Sign In

Back

Research Overview

Inferring and exploiting contact

Generative Proxemics: A Prior for 3D Social Interaction from Images

BITE -- Dog Shape and Pose from an Image

HOLD -- inferring 3D hand and object shape from video

MOVER -- Reconstructing 3D Scenes and People using Interaction

Datasets for understanding humans and animals

The Poses for Equine Research Dataset (PFERD)

BEAT2 Dataset for Holistic Co-Speech Gesture Generation

ARCTIC: A Dataset for Dexterous Bimanual Hand-Object Manipulation

The BioAMASS Dataset

OpenCapBench dataset

Human health and the 3D body

Body Shape Models in Treating Anorexia Nervosa

Customized Bone Plants for Humerus Shaft Fractures

Reconstructing Signing Avatars From Video Using Linguistic Priors

The AI animator

HAAR: Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles

Gaussian Garments

PuzzleAvatar: Assembling 3D Avatars from Personal Albums

FLARE: Fast Learning of Animatable and Relightable Mesh Avatars

Language, Vision, and World Models

AWOL: Analysis WithOut synthesis using Language

Re-Thinking Inverse Graphics with Large Language Models

TeCH: Text-guided Reconstruction of Clothed Humans

Human pose, shape, and motion capture

WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion

3D Human Pose Estimation via Intuitive Physics

Accurate 3D Body Shape Regression using Metric and Semantic Attributes

BEV

Generating human motion

Generating Human Interaction Motions in Scenes with Text Control

TEMOS: Generating Diverse Human Motions from Text

EMAGE: Full-body Gestures from Audio

TEACH: Temporal Action Compositions for 3D Humans

Robot Perception Group

AirCap: 3D Motion Capture

AirCap: Perception-Based Control

Data Team

Lab Tours and Public Outreach

Collecting Data - From the Idea to the Publication

Capture Technologies Setup

Completed Projects

Clothing Capture and Modeling

Modeling Human Movement

/ps/projects/action-and-behavior

/ps/projects/inverse-graphics-proj

/ps/projects/image-segmentation-and-semantics

/ps/projects/groups-and-crowds

/ps/projects/learning-from-synthetic-data

/ps/projects/learning-high-dimensional-deep-representations

/ps/projects/efficient-and-scalable-inference

Hierarchical Graphs for Generalized Modelling of Clothing Dynamics

Learning to Resolve Intersections in Neural Multi-Garment Simulations

Reconstructing Simulation-Ready Clothing with Photo-Realistic Appearance from Multi-View Video

Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles

Human Hair Reconstruction with Strand-Aligned 3D Gaussians

Joker: Conditional 3D Head Synthesis with Extreme Facial Expressions

Goal Driven Motion Generation

Perceiving Systems Members Publications

Members

no image
Perceiving Systems
Jürgen Gall

Publications

Perceiving Systems Article Coupled Action Recognition and Pose Estimation from Multiple Views Yao, A., Gall, J., van Gool, L. International Journal of Computer Vision, 100(1):16-37, October 2012 publisher's site code pdf BibTeX
Perceiving Systems Book Chapter Data-driven Manifolds for Outdoor Motion Capture Pons-Moll, G., Leal-Taix’e, L., Gall, J., Rosenhahn, B. In Outdoor and Large-Scale Real-World Scene Analysis, 7474:305-328, LNCS, (Editors: Dellaert, Frank and Frahm, Jan-Michael and Pollefeys, Marc and Rosenhahn, Bodo and Leal-Taix’e, Laura), Springer, 2012 video publisher's site pdf BibTeX
Perceiving Systems Conference Paper Destination Flow for Crowd Simulation Pellegrini, S., Gall, J., Sigal, L., van Gool, L. In Workshop on Analysis and Retrieval of Tracked Events and Motion in Imagery Streams, 7585:162-171, LNCS, Springer, 2012 pdf BibTeX
Perceiving Systems Conference Paper Metric Learning from Poses for Temporal Clustering of Human Motion L’opez-M’endez, A., Gall, J., Casas, J., van Gool, L. In British Machine Vision Conference (BMVC), 49.1-49.12, (Editors: Bowden, Richard and Collomosse, John and Mikolajczyk, Krystian), BMVA Press, 2012 video pdf BibTeX