Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Perceiving Systems Conference Paper Collaborative Regression of Expressive Bodies using Moderation Feng, Y., Choutas, V., Bolkart, T., Tzionas, D., Black, M. J. 2021 International Conference on 3D Vision (3DV 2021), :792-804, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2021), December 2021 (Published) arXiv project pdf suppl DOI BibTeX
Thumb ticker lg pixie

Perceiving Systems Conference Paper Learning to Disambiguate Strongly Interacting Hands via Probabilistic Per-pixel Part Segmentation Fan, Z., Spurr, A., Kocabas, M., Tang, S., Black, M. J., Hilliges, O. 2021 International Conference on 3D Vision (3DV 2021), :1-10, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2021), December 2021 (Published) arXiv project code video DOI BibTeX
Thumb ticker lg hands3dv

Autonomous Vision Perceiving Systems Conference Paper MetaAvatar: Learning Animatable Clothed Human Models from Few Depth Images Wang, S., Mihajlovic, M., Ma, Q., Geiger, A., Tang, S. In Advances in Neural Information Processing Systems 34, 4:2810-2822, (Editors: Ranzato, M. and Beygelzimer, A. and Dauphin, Y. and Liang, P. S. and Wortman Vaughan, J.), Curran Associates, Inc., Red Hook, NY, 35th Conference on Neural Information Processing Systems (NeurIPS 2021), December 2021 (Published) Project page arXiv URL BibTeX
Thumb ticker lg metaavatar

Perceiving Systems Article The neural coding of face and body orientation in occipitotemporal cortex Foster, C., Zhao, M., Bolkart, T., Black, M. J., Bartels, A., Bülthoff, I. NeuroImage, 246:118783, December 2021 (Published) paper DOI BibTeX
Thumb ticker lg celianeuro

Perceiving Systems Article A pose-independent method for accurate and precise body composition from 3D optical scans Wong, M. C., Ng, B. K., Tian, I., Sobhiyeh, S., Pagano, I., Dechenaud, M., Kennedy, S. F., Liu, Y. E., Kelly, N., Chow, D., et al. Obesity, 29(11):1835-1847, Wiley, November 2021 (Published) Wiley online adress Author Version DOI BibTeX
Thumb ticker lg tpose obesity 21

Perceiving Systems Conference Paper How much coffee was consumed during EMNLP 2019? Fermi Problems: A New Reasoning Challenge for AI Kalyan, A., Kumar, A., Chandrasekaran, A., Sabharwal, A., Clark, P. In 2021 Conference on Empirical Methods in Natural Language Processing - Proceedings of the Conference, :7318-7328, (Editors: Moens, Marie-Francine and Huang, Xuanjing and Specia, Lucia and Wen-tau Yih, Scott), Association for Computational Linguistics, Stroudsburg, PA, Conference on Empirical Methods in Natural Language Processing (EMNLP 2021), November 2021 (Published) paper project webpage data DOI BibTeX
Thumb ticker lg fermi teaser cropped

Perceiving Systems Conference Paper Action-Conditioned 3D Human Motion Synthesis with Transformer VAE Petrovich, M., Black, M. J., Varol, G. In Proc. International Conference on Computer Vision (ICCV), :10965-10975, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) website code paper-arxiv video DOI BibTeX
Thumb ticker lg actor

Perceiving Systems Conference Paper Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings Prabhu, V., Chandrasekaran, A., Saenko, K., Hoffman, J. In Proc. International Conference on Computer Vision (ICCV), :8485-8494, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) paper project webpage Code Video DOI BibTeX
Thumb ticker lg adaclue cropped image

Perceiving Systems Conference Paper Learning Realistic Human Reposing using Cyclic Self-Supervision with 3D Shape, Pose, and Appearance Consistency Sanyal, S., Vorobiov, A., Bolkart, T., Loper, M., Mohler, B., Davis, L., Romero, J., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11118-11127, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf arxiv DOI BibTeX
Thumb ticker lg screenshot from 2021 10 06 21 50 55

Perceiving Systems Conference Paper Learning To Regress Bodies From Images Using Differentiable Semantic Rendering Dwivedi, S. K., Athanasiou, N., Kocabas, M., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11230-11239, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp code project-website video poster DOI BibTeX
Thumb ticker lg dsr1

Perceiving Systems Conference Paper Monocular, One-Stage, Regression of Multiple 3D People Sun, Y., Bao, Q., Liu, W., Fu, Y., Black, M. J., Mei, T. In Proc. International Conference on Computer Vision (ICCV), :11159-11168, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp arXiv code DOI BibTeX
Thumb ticker lg romp2

Perceiving Systems Conference Paper Stochastic Scene-Aware Motion Prediction Hassan, M., Ceylan, D., Villegas, R., Saito, J., Yang, J., Zhou, Y., Black, M. In Proc. International Conference on Computer Vision (ICCV), :11354-11364, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) Project Page pdf DOI BibTeX
Thumb ticker lg samp3

Perceiving Systems Conference Paper The Power of Points for Modeling Humans in Clothing Ma, Q., Yang, J., Tang, S., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :10954-10964, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) Project Page Code Video Dataset arXiv PDF Supp. Poster DOI BibTeX
Thumb ticker lg pop2

Perceiving Systems Conference Paper Topologically Consistent Multi-View Face Inference Using Volumetric Sampling Li, T., Liu, S., Bolkart, T., Liu, J., Li, H., Zhao, Y. In Proc. International Conference on Computer Vision (ICCV), :3804-3814, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) project paper DOI BibTeX
Thumb ticker lg tofu

Perceiving Systems Conference Paper PARE: Part Attention Regressor for 3D Human Body Estimation Kocabas, M., Huang, C. P., Hilliges, O., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11107-11117, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp code video arXiv project website poster DOI BibTeX
Thumb ticker lg website teaser v3

Perceiving Systems Autonomous Vision Conference Paper SNARF: Differentiable Forward Skinning for Animating Non-Rigid Neural Implicit Shapes Chen, X., Zheng, Y., Black, M. J., Hilliges, O., Geiger, A. In Proc. International Conference on Computer Vision (ICCV), :11574-11584, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf pdf 2 supplementary material project blog blog 2 video video 2 code DOI URL BibTeX
Thumb ticker lg snarf

Perceiving Systems Conference Paper SOMA: Solving Optical Marker-Based MoCap Automatically Ghorbani, N., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11097-11106, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) code pdf suppl arxiv project website video poster DOI BibTeX
Thumb ticker lg teaser

Perceiving Systems Conference Paper SPEC: Seeing People in the Wild with an Estimated Camera Kocabas, M., Huang, C. P., Tesch, J., Müller, L., Hilliges, O., Black, M. J. In Proc. International Conference on Computer Vision (ICCV), :11015-11025, IEEE, Piscataway, NJ, International Conference on Computer Vision, October 2021 (Published) pdf supp arXiv code video project website poster DOI BibTeX
Thumb ticker lg webpage teaser

Perceiving Systems Conference Paper Active Visual SLAM with Independently Rotating Camera Bonetto, E., Goldschmid, P., Black, M. J., Ahmad, A. In 2021 European Conference on Mobile Robots (ECMR 2021), :266-273, IEEE, Piscataway, NJ, European Conference on Mobile Robots (ECMR 2021), 2021 (Published) Code Data DOI URL BibTeX
Thumb ticker lg untitled

Perceiving Systems Article Separated and overlapping neural coding of face and body identity Foster, C., Zhao, M., Bolkart, T., Black, M. J., Bartels, A., Bülthoff, I. Human Brain Mapping, 42(13):4242-4260, September 2021 (Published) on-line DOI BibTeX
Thumb ticker lg celia

Perceiving Systems Patent Skinned multi-infant linear body model Hesse, N., Pujades, S., Romero, J., Black, M. (US Patent 11,127,163, 2021), September 2021 (Published) BibTeX
Thumb ticker lg smilpatent

Perceiving Systems Article The role of sexual orientation in the relationships between body perception, body weight dissatisfaction, physical comparison, and eating psychopathology in the cisgender population Meneguzzo, P., Collantoni, E., Bonello, E., Vergine, M., Behrens, S. C., Tenconi, E., Favaro, A. Eating and Weight Disorders - Studies on Anorexia, Bulimia and Obesity , 26(6):1985-2000, Springer, August 2021 (Published) DOI BibTeX
Thumb ticker lg behrens

Perceiving Systems Article Learning an Animatable Detailed 3D Face Model from In-the-Wild Images Feng, Y., Feng, H., Black, M. J., Bolkart, T. ACM Transactions on Graphics, 40(4):88:1-88:13, August 2021 (Published) pdf Sup Mat code video talk DOI BibTeX
Thumb ticker lg deca

Perceiving Systems Conference Paper On Self-Contact and Human Pose Müller, L., Osman, A. A. A., Tang, S., Huang, C. P., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :9985-9994, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) project arXiv poster video code DOI BibTeX
Thumb ticker lg mpi website teaser

Perceiving Systems Conference Paper Populating 3D Scenes by Learning Human-Scene Interaction Hassan, M., Ghosh, P., Tesch, J., Tzionas, D., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :14703-14713, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) project pdf poster video DOI BibTeX
Thumb ticker lg posa

Perceiving Systems Article Red shape, blue shape: Political ideology influences the social perception of body shape Quiros-Ramirez, M. A., Streuber, S., Black, M. J. Nature Humanities and Social Sciences Communications, 8:148, June 2021 (Published) pdf on-line sup. mat. sup. figure author pdf DOI BibTeX
Thumb ticker lg rsbsfig6crop

Perceiving Systems Conference Paper We are More than Our Joints: Predicting how 3D Bodies Move Zhang, Y., Black, M. J., Tang, S. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :3371-3381, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) code arXiv DOI BibTeX
Thumb ticker lg mojo

Perceiving Systems Conference Paper AGORA: Avatars in Geography Optimized for Regression Analysis Patel, P., Huang, C. P., Tesch, J., Hoffmann, D. T., Tripathi, S., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :13463-13473, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) dataset pdf video DOI BibTeX
Thumb ticker lg agora

Perceiving Systems Conference Paper BABEL: Bodies, Action and Behavior with English Labels Punnakkal, A. R., Chandrasekaran, A., Athanasiou, N., Quiros-Ramirez, M. A., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :722-731, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021) , June 2021 (Published) dataset poster pdf sup mat video code DOI BibTeX
Thumb ticker lg babel cropped teaser

Perceiving Systems Conference Paper LEAP: Learning Articulated Occupancy of People Mihajlovic, M., Zhang, Y., Black, M. J., Tang, S. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :10456-10466, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) project arXiv pdf code DOI BibTeX
Thumb ticker lg leap3

Perceiving Systems Conference Paper SCALE: Modeling Clothed Humans with a Surface Codec of Articulated Local Elements Ma, Q., Saito, S., Yang, J., Tang, S., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :16077-16088, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) Project Page Code Video arXiv PDF Supp. Poster DOI BibTeX
Thumb ticker lg scale ps website

Perceiving Systems Conference Paper SCANimate: Weakly Supervised Learning of Skinned Clothed Avatar Networks Saito, S., Yang, J., Ma, Q., Black, M. J. In 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), :2885-2896, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021), June 2021 (Published) Project Page PDF Supp. Video arXiv Poster code DOI URL BibTeX
Thumb ticker lg scanimate

Perceiving Systems Article Weight bias and linguistic body representation in anorexia nervosa: Findings from the BodyTalk project Behrens, S. C., Meneguzzo, P., Favaro, A., Teufel, M., Skoda, E., Lindner, M., Walder, L., Quiros-Ramirez, M. A., Zipfel, S., Mohler, B., et al. European Eating Disorders Review, 29(2):204-215, Wiley, March 2021 (Published) on-line pdf DOI BibTeX
Thumb ticker lg bodytalktiny

Perceiving Systems Conference Paper Enhancing Deep Semantic Segmentation of RGB-D Data with Entangled Forests Terreran, M., Bonetto, E., Ghidoni, S. 2020 25th International Conference on Pattern Recognition (ICPR 2020), :4634-4641, IEEE, Piscataway, NJ, 25th International Conference on Pattern Recognition (ICPR 2020), January 2021 (Published) DOI URL BibTeX
Thumb ticker lg entangledfeatures

Perceiving Systems Conference Paper SMPLpix: Neural Avatars from 3D Human Models Prokudin, S., Black, M. J., Romero, J. In 2021 IEEE Winter Conference on Applications of Computer Vision (WACV 2021), :1809-1818, IEEE, Piscataway, NJ, IEEE Winter Conference on Applications of Computer Vision (WACV 2021), January 2021 (Published) project official pdf video preprint code DOI BibTeX
Thumb ticker lg smplpix

Perceiving Systems Article Analyzing the Direction of Emotional Influence in Nonverbal Dyadic Communication: A Facial-Expression Study Shadaydeh, M., Müller, L., Schneider, D., Thuemmel, M., Kessler, T., Denzler, J. IEEE Access, 9:73780-73790, IEEE, 2021 (Published) DOI BibTeX
Thumb ticker lg leafaces

Perceiving Systems Article Body Image Disturbances and Weight Bias After Obesity Surgery: Semantic and Visual Evaluation in a Controlled Study, Findings from the BodyTalk Project Meneguzzo, P., Behrens, S. C., Favaro, A., Tenconi, E., Vindigni, V., Teufel, M., Skoda, E., Lindner, M., Quiros-Ramirez, M. A., Mohler, B., et al. Obesity Surgery, 31(4):1625-1634, 2021 (Published) paper pdf DOI BibTeX
Thumb ticker lg obesity

Perceiving Systems Conference Paper Collaborative Mapping of Archaeological Sites Using Multiple UAVs Patel, M., Bandopadhyay, A., Ahmad, A. In Lecture Notes in Networks and Systems, 412:54-70, Springer International Publishing, Intelligent Autonomous Systems 16, 2021 () DOI BibTeX
Thumb ticker lg cover