Publications

Perceiving Systems Conference Paper Capturing and Animation of Body and Clothing from Monocular Video Feng, Y., Yang, J., Pollefeys, M., Black, M. J., Bolkart, T. In Proceedings SIGGRAPH Asia 2022 Conference Papers Proceedings (SA ’22 2022) , SIGGRAPH Asia 2022 Conference Papers Proceedings (SA'22) , December 2022 (Published) project code pdf DOI URL BibTeX

Perceiving Systems Ph.D. Thesis Reconstructing Expressive 3D Humans from RGB Images Choutas, V. ETH Zurich, Max Planck Institute for Intelligent Systems and ETH Zurich, December 2022 (Published) pdf DOI BibTeX

Perceiving Systems Article How immersive virtual reality can become a key tool to advance research and psychotherapy of eating and weight disorders Behrens, S. C., Streuber, S., Keizer, A., Giel, K. E. Frontiers in Psychiatry, 13:1011620, November 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper DART: Articulated Hand Model with Diverse Accessories and Rich Textures Gao, D., Xiu, Y., Li, K., Yang, L., Wang, F., Zhang, P., Zhang, B., Lu, C., Tan, P. Thirty-sixth Conference on Neural Information Processing Systems (NeurIPS), NeurIPS 2022-Datasets and Benchmarks Track, November 2022 (Published) Home Code Video BibTeX

Perceiving Systems Conference Paper Deep Residual Reinforcement Learning based Autonomous Blimp Control Liu, Y. T., Price, E., Black, M. J., Ahmad, A. 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022), 12566-12573, IEEE, Piscataway, NJ, IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2022) , October 2022 (Published) DOI BibTeX

Perceiving Systems Conference Paper Learning to Fit Morphable Models Choutas, V., Bogo, F., Shen, J., Valentin, J. In Computer Vision – ECCV 2022, 6:160-179, Lecture Notes in Computer Science, 13666, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) Project page Video PDF Poster DOI BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Towards Metrical Reconstruction of Human Faces Zielonka, W., Bolkart, T., Thies, J. In Computer Vision – ECCV 2022, 13:250-269, Lecture Notes in Computer Science, 13673, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) pdf project video code DOI URL BibTeX

Perceiving Systems Conference Paper Towards Racially Unbiased Skin Tone Estimation via Scene Disambiguation Feng, H., Bolkart, T., Tesch, J., Black, M. J., Fernandez Abrevaya, V. In Computer Vision – ECCV 2022, 13:72-90, Lecture Notes in Computer Science, 13673, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) pdf project code DOI URL BibTeX

Perceiving Systems Conference Paper SUPR: A Sparse Unified Part-Based Human Representation Osman, A. A. A., Bolkart, T., Tzionas, D., Black, M. J. In Computer Vision – ECCV 2022, 2:568-585, Lecture Notes in Computer Science, 13662, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) Project website Code Main Paper Supp. Mat. Poster DOI BibTeX

Perceiving Systems Conference Paper TEMOS: Generating Diverse Human Motions from Textual Descriptions Petrovich, M., Black, M. J., Varol, G. In European Conference on Computer Vision (ECCV 2022), Springer International Publishing, ECCV, October 2022 (Published) website code paper-arxiv video DOI URL BibTeX

Perceiving Systems Conference Paper Neural Point-based Shape Modeling of Humans in Challenging Clothing Ma, Q., Yang, J., Black, M. J., Tang, S. In 2022 International Conference on 3D Vision (3DV 2022), 679-689, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project page Code arXiv Paper Supp Poster DOI URL BibTeX

Perceiving Systems Conference Paper Reconstructing Action-Conditioned Human-Object Interactions Using Commonsense Knowledge Priors Wang, X., Li, G., Kuo, Y., Kocabas, M., Aksan, E., Hilliges, O. In 2022 International Conference on 3D Vision (3DV 2022), 353-362, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project Page Video Arxiv DOI BibTeX

Perceiving Systems Conference Paper InterCap: Joint Markerless 3D Tracking of Humans and Objects in Interaction Huang, Y., Taheri, O., Black, M. J., Tzionas, D. In Pattern Recognition, 281-299, Lecture Notes in Computer Science, 13485, (Editors: Andres, Björn and Bernard, Florian and Cremers, Daniel and Frintrop, Simone and Goldlücke, Bastian and Ihrke, Ivo), Springer, Cham, 44th DAGM German Conference on Pattern Recognition (DAGM GCPR 2022), September 2022 (Published) Code Data YouTube Video pdf DOI URL BibTeX

Perceiving Systems Autonomous Learning Conference Paper InvGAN: Invertible GANs Ghosh, P., Zietlow, D., Black, M. J., Davis, L. S., Hu, X. In Pattern Recognition, 3-19, Lecture Notes in Computer Science, 13485, (Editors: Andres, Björn and Bernard, Florian and Cremers, Daniel and Frintrop, Simone and Goldlücke, Bastian and Ihrke, Ivo), Springer, Cham, 44th DAGM German Conference on Pattern Recognition (DAGM GCPR 2022), September 2022 (Published) pdf DOI BibTeX

Perceiving Systems Conference Paper TEACH: Temporal Action Composition for 3D Humans Athanasiou, N., Petrovich, M., Black, M. J., Varol, G. In 2022 International Conference on 3D Vision (3DV), 414-423, 3DV'22, September 2022 (Published) code arXiv website video camera-ready DOI URL BibTeX

Perceiving Systems Conference Paper TempCLR: Reconstructing Hands via Time-Coherent Contrastive Learning Ziani, A., Fan, Z., Kocabas, M., Christen, S., Hilliges, O. In 2022 International Conference on 3D Vision (3DV 2022), 627-636, IEEE, Piscataway, NJ, International Conference on 3D Vision (3DV 2022), September 2022 (Published) Project Page Code Arxiv Video DOI URL BibTeX

Perceiving Systems Article iRotate: Active visual SLAM for omnidirectional robots Bonetto, E., Goldschmid, P., Pabst, M., Black, M. J., Ahmad, A. Robotics and Autonomous Systems, 154:104102, Elsevier, August 2022 (Published) Code Data iRotate Data Independent Camera experiments DOI URL BibTeX

Perceiving Systems Conference Paper Accurate 3D Body Shape Regression using Metric and Semantic Attributes Choutas, V., Müller, L., Huang, C. P., Tang, S., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 2708-2718, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Video Paper Supplementary Material Poster DOI URL BibTeX

Perceiving Systems Optics and Sensing Laboratory Conference Paper Capturing and Inferring Dense Full-Body Human-Scene Contact Huang, C. P., Yi, H., Höschle, M., Safroshkin, M., Alexiadis, T., Polikovsky, S., Scharstein, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 13264-13275, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv BSTRO code video DOI URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper Human-Aware Object Placement for Visual Environment Reconstruction Yi, H., Huang, C. P., Tzionas, D., Kocabas, M., Hassan, M., Tang, S., Thies, J., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 3949-3960, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI URL BibTeX

Perceiving Systems Conference Paper Occluded Human Mesh Recovery Khirodkar, R., Tripathi, S., Kitani, K. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 1705-1715, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI BibTeX

Perceiving Systems Conference Paper Putting People in their Place: Monocular Regression of 3D People in Depth Sun, Y., Liu, W., Bao, Q., Fu, Y., Mei, T., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 13233-13242, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Project Code Data Sup Mat DOI URL BibTeX

Perceiving Systems Conference Paper Simulation and Control of Deformable Autonomous Airships in Turbulent Wind Price, E., Liu, Y., Black, M. J., Ahmad, A. In Intelligent Autonomous Systems 16, 608-626, Lecture Notes in Networks and Systems, 412, (Editors: Ang Jr, Marcelo H. and Asama, Hajime and Lin, Wei and Foong, Shaohui), Springer, Cham, 16th International Conference on Intelligent Autonomous Systems (IAS-16), 2022 (Published) pdf arXiv project/code DOI URL BibTeX

Perceiving Systems Conference Paper BARC: Learning to Regress 3D Dog Shape from Images by Exploiting Breed Information Rueegg, N., Zuffi, S., Schindler, K., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 3866-3874, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) pdf Sup. Mat. project Code Poster Video Demo DOI URL BibTeX

Perceiving Systems Conference Paper D-Grasp: Physically Plausible Dynamic Grasp Synthesis for Hand-Object Interactions Christen, S., Kocabas, M., Aksan, E., Hwangbo, J., Song, J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 20545-20554, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper project video code DOI BibTeX

Perceiving Systems Conference Paper EMOCA: Emotion Driven Monocular Face Capture and Animation Daněček, R., Black, M. J., Bolkart, T. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 20279-20290, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) code project pdf supplemental DOI URL BibTeX

Perceiving Systems Conference Paper GOAL: Generating 4D Whole-Body Motion for Hand-Object Grasping Taheri, O., Choutas, V., Black, M. J., Tzionas, D. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 13253-13263, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) arXiv Sup. Mat Project YouTube Code Models DOI URL BibTeX

Perceiving Systems Conference Paper I M Avatar: Implicit Morphable Head Avatars from Videos Zheng, Y., Fernández Abrevaya, V., Bühler, M. C., Chen, X., Black, M. J., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 13535-13545, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) paper video code synth. data DOI URL BibTeX

Perceiving Systems Conference Paper ICON: Implicit Clothed humans Obtained from Normals Xiu, Y., Yang, J., Tzionas, D., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 13286-13296 , IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Home Code Demo Video arXiv Paper Sup. Mat. Poster DOI URL BibTeX

Perceiving Systems Conference Paper OSSO: Obtaining Skeletal Shape from Outside Keller, M., Zuffi, S., Black, M. J., Pujades, S. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 20460-20469, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Paper Sup. Mat. DOI URL BibTeX

Perceiving Systems Autonomous Vision Conference Paper gDNA: Towards Generative Detailed Neural Avatars Chen, X., Jiang, T., Song, J., Yang, J., Black, M. J., Geiger, A., Hilliges, O. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 204395-20405, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) Project page Video Code DOI URL BibTeX

Perceiving Systems Article AirPose: Multi-View Fusion Network for Aerial 3D Human Pose and Shape Estimation Saini, N., Bonetto, E., Price, E., Ahmad, A., Black, M. J. IEEE Robotics and Automation Letters, 7(2):4805-4812, IEEE, April 2022, Also accepted and presented in the 2022 IEEE International Conference on Robotics and Automation (ICRA) (Published) paper code video pdf DOI BibTeX

Perceiving Systems Article Physical activity improves body image of sedentary adults. Exploring the roles of interoception and affective response Srismith, D., Dierkes, K., Zipfel, S., Thiel, A., Sudeck, G., Giel, K. E., Behrens, S. C. Current Psychology, Springer, 2022 (Published) DOI BibTeX

Perceiving Systems Ph.D. Thesis Whole-Body Motion Capture and Beyond: From Model-Based Inference to Learning-Based Regression Huang, Y. University of Tübingen, December 2022 (Published) download Thesis DOI BibTeX

Perceiving Systems Conference Paper Customized Multi-Person Tracker Ma, L., Tang, S., Black, M. J., Van Gool, L. In Computer Vision – ACCV 2018, Springer International Publishing, Asian Conference on Computer Vision, December 2018 PDF BibTeX

Perceiving Systems Article Deep Inertial Poser: Learning to Reconstruct Human Pose from Sparse Inertial Measurements in Real Time Huang, Y., Kaufmann, M., Aksan, E., Black, M. J., Hilliges, O., Pons-Moll, G. ACM Transactions on Graphics, (Proc. SIGGRAPH Asia), 37:185:1-185:15, ACM, November 2018, Two first authors contributed equally data code pdf preprint errata video DOI BibTeX

Perceiving Systems Article Deep Neural Network-based Cooperative Visual Tracking through Multiple Micro Aerial Vehicles Price, E., Lawless, G., Ludwig, R., Martinovic, I., Buelthoff, H. H., Black, M. J., Ahmad, A. IEEE Robotics and Automation Letters, Robotics and Automation Letters, 3(4):3193-3200, IEEE, October 2018, Also accepted and presented in the 2018 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). (Published) Published Version DOI URL BibTeX

Perceiving Systems Article First Impressions of Personality Traits From Body Shapes Hu, Y., Parde, C. J., Hill, M. Q., Mahmood, N., O’Toole, A. J. Psychological Science, 29(12):1969-–1983, October 2018 publisher site pdf DOI BibTeX

Perceiving Systems Autonomous Vision Conference Paper On the Integration of Optical Flow and Action Recognition Sevilla-Lara, L., Liao, Y., Güney, F., Jampani, V., Geiger, A., Black, M. J. In German Conference on Pattern Recognition (GCPR), LNCS 11269:281-297, Springer, Cham, October 2018 arXiv DOI BibTeX

Perceiving Systems Conference Paper Temporal Interpolation as an Unsupervised Pretraining Task for Optical Flow Estimation Wulff, J., Black, M. J. In German Conference on Pattern Recognition (GCPR), LNCS 11269:567-582, Springer, Cham, October 2018 pdf arXiv DOI BibTeX

Perceiving Systems Conference Paper Human Motion Parsing by Hierarchical Dynamic Clustering Zhang, Y., Tang, S., Sun, H., Neumann, H. In Proceedings of the British Machine Vision Conference (BMVC), 269, BMVA Press, 29th British Machine Vision Conference, September 2018 pdf BibTeX

Perceiving Systems Conference Paper Deep Directional Statistics: Pose Estimation with Uncertainty Quantification Prokudin, S., Gehler, P., Nowozin, S. European Conference on Computer Vision (ECCV), 9:542-559, September 2018 code pdf BibTeX

Perceiving Systems Conference Paper Generating 3D Faces using Convolutional Mesh Autoencoders Ranjan, A., Bolkart, T., Sanyal, S., Black, M. J. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11207:725-741, Springer, Cham, September 2018 Code (tensorflow) Code (pytorch) Project Page paper supplementary DOI BibTeX

Perceiving Systems Conference Paper Learning Human Optical Flow Ranjan, A., Romero, J., Black, M. J. In 29th British Machine Vision Conference, September 2018 video code pdf URL BibTeX

Perceiving Systems Conference Paper Learning an Infant Body Model from RGB-D Data for Accurate Full Body Motion Analysis Hesse, N., Pujades, S., Romero, J., Black, M. J., Bodensteiner, C., Arens, M., Hofmann, U. G., Tacke, U., Hadders-Algra, M., Weinberger, R., et al. In Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI), September 2018 pdf Project page video extended arXiv version DOI BibTeX

Perceiving Systems Conference Paper Neural Body Fitting: Unifying Deep Learning and Model-Based Human Pose and Shape Estimation Omran, M., Lassner, C., Pons-Moll, G., Gehler, P. V., Schiele, B. In 3DV, 484-494, September 2018 arXiv code BibTeX

Perceiving Systems Conference Paper Part-Aligned Bilinear Representations for Person Re-identification Suh, Y., Wang, J., Tang, S., Mei, T., Lee, K. M. In European Conference on Computer Vision (ECCV), 11218:418-437, Springer, Cham, September 2018 pdf supplementary DOI BibTeX

Perceiving Systems Conference Paper Recovering Accurate 3D Human Pose in The Wild Using IMUs and a Moving Camera Marcard, T. V., Henschel, R., Black, M. J., Rosenhahn, B., Pons-Moll, G. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11214:614-631, Springer, Cham, September 2018 pdf SupMat data project DOI BibTeX

Autonomous Vision Perceiving Systems Conference Paper Unsupervised Learning of Multi-Frame Optical Flow with Occlusions Janai, J., Güney, F., Ranjan, A., Black, M. J., Geiger, A. In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, vol 11220:713-731, Springer, Cham, September 2018 pdf suppmat Video Project Page DOI BibTeX

Perceiving Systems Article Visual Perception and Evaluation of Photo-Realistic Self-Avatars From 3D Body Scans in Males and Females Thaler, A., Piryankova, I., Stefanucci, J. K., Pujades, S., de la Rosa, S., Streuber, S., Romero, J., Black, M. J., Mohler, B. J. Frontiers in ICT, 5:1-14, September 2018 pdf DOI BibTeX

Publications

Filter by