Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Autonomous Vision Conference Paper ARAH: Animatable Volume Rendering of Articulated Human SDFs Wang, S. S. K. G. A. T. S. Computer Vision – ECCV 2022 , 13692:1-19 , Lecture Note on Computer Science (LNCS), (Editors: Avidan, S; Brostow, G; Cisse, M; Farinella, GM; Hassner, T), Springer, 17th European Conference on Computer Vision (ECCV), October 2022 (Published) DOI BibTeX

Autonomous Vision Conference Paper KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients Hanselmann, N. R. K. C. K. B. A. G. A. Proceedings 17th European Conference on Computer Vision (ECCV), 13698:335-352, (Editors: Avidan, S; Brostow, G; Cisse, M; Farinella, GM; Hassner, T), IEEE, ECCV, October 2022 (Published) DOI BibTeX

Autonomous Vision Conference Paper TensoRF: Tensorial Radiance Fields Chen, A. X. Z. G. A. Y. J. S. H. Proceedings COMPUTER VISION - ECCV 2022, PT XXXII, 13692:333-350, IEEE, ECCV, October 2022 (Published) DOI BibTeX

Autonomous Vision Conference Paper NICE-SLAM: Neural Implicit Scalable Encoding for SLAM Zhu, Z. P. S. L. V. X. W. B. H. C. Z. O. M. R. P. M. 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 12776-12786, IEEE, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022) , June 2022 (Published) DOI BibTeX

Autonomous Vision Human-centric Vision & Learning Conference Paper PINA: Learning a Personalized Implicit Neural Avatar from a Single RGB-D Video Sequence Dong, Z. G. C. S. J. C. X. G. A. H. O. Proceedings 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 20438-20448, IEEE, CVPR, June 2022 (Published) DOI BibTeX

Perceiving Systems Autonomous Vision Conference Paper gDNA: Towards Generative Detailed Neural Avatars Chen, X., Jiang, T., Song, J., Yang, J., Black, M. J., Geiger, A., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 204395-20405, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published)
To make 3D human avatars widely available, we must be able to generate a variety of 3D virtual humans with varied identities and shapes in arbitrary poses. This task is challenging due to the diversity of clothed body shapes, their complex articulations, and the resulting rich, yet stochastic geometric detail in clothing. Hence, current methods to represent 3D people do not provide a full generative model of people in clothing. In this paper, we propose a novel method that learns to generate detailed 3D shapes of people in a variety of garments with corresponding skinning weights. Specifically, we devise a multi-subject forward skinning module that is learned from only a few posed, un-rigged scans per subject. To capture the stochastic nature of high-frequency details in garments, we leverage an adversarial loss formulation that encourages the model to capture the underlying statistics. We provide empirical evidence that this leads to realistic generation of local details such as clothing wrinkles. We show that our model is able to generate natural human avatars wearing diverse and detailed clothing. Furthermore, we show that our method can be used on the task of fitting human models to raw scans, outperforming the previous state-of-the-art.
Project page Video Code DOI URL BibTeX

Autonomous Vision Conference Paper RegNeRF: Regularizing Neural Radiance Fields for View Synthesis from Sparse Inputs Niemeyer, M. B. J. T. M. B. S. M. S. M. G. A. R. N. Proceedings 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 5470-5480, IEEE, 2022 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2022), 2022 (Published) DOI BibTeX