Perceiving Systems Talk Biography
30 October 2025 at 14:00 - 15:00 | Aquarium, Max Planck Ring 4

Text, Touch and Trajectories: Reconstructing 3D Humans with 3T’s

ORGANIZERS
Perceiving Systems
  • Guest Scientist
Perceiving Systems
Department Manager
Perceiving Systems
Office Coordinator
Spokesperson
Director of the Perceiving Systems Department at the Max Planck Institute for Intelligent Systems

3D human reconstruction requires more than just modeling geometry - it demands a nuanced understanding of semantics, contacts, and motions. This talk explores how we can rethink reconstruction through the lens of 3Ts: Text, Touch, and Trajectories, as three complementary signals to infer human and object structures in the wild. Text, or natural language, provides an intuitive prior for object shape and category and we use it as support for hand-object reconstruction. Touch, or contact, provide cues that link humans to the outside world. I will introduce our state-of-the-art approach on world-coordinate human mesh recovery based on inferred contact points such as the feet or the hands. Finally, trajectories capture how the body moves through space, both locally and globally. I will describe how we use whole-body momentum as a physically grounded constraint to relate joint-level dynamics to global displacement.

Speaker Biography

Angela Yao (School of Computing at the National University of Singapore)

Dean's Chair Associate Professor

Angela is a Dean’s Chair Associate Professor in the School of Computing at the National University of Singapore (NUS), where she leads the Computer Vision and Machine Learning Group. His research focuses on video understanding and digital humans, supported by the NRF Fellowship as well as grants from the Ministry of Education (Singapore), AI Singapore, and several industry partners. Before joining NUS, she led a Visual Computing group at the University of Bonn, co-founded a startup on smart parking, and earned his PhD at ETH Zurich. She began his academic journey studying Engineering Science at the University of Toronto. She is currently on sabbatical in 2025, working at Meta Reality Labs in Zurich, Switzerland.