Publications

Empirical Inference Perceiving Systems Conference Paper ChatHuman: Chatting about 3D Humans with Tools Lin, J., Feng, Y., Liu, W., Black, M. J. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2025, Accepted (Accepted) project pdf Paper BibTeX

Perceiving Systems Conference Paper InteractVLM: 3D Interaction Reasoning from 2D Foundational Models Dwivedi, S. K., Antić, D., Tripathi, S., Taheri, O., Schmid, C., Black, M. J., Tzionas, D. In IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), June 2025, Accepted (Accepted) Project Paper Code Video BibTeX

Perceiving Systems Conference Paper Gaussian Garments: Reconstructing Simulation-Ready Clothing with Photo-Realistic Appearance from Multi-View Video Rong, B., Grigorev, A., Wang, W., Black, M. J., Thomaszewski, B., Tsalicoglou, C., Hilliges, O. In International Conference on 3D Vision (3DV), International Conference on 3D Vision, March 2025 (Published) arXiv project video URL BibTeX

Perceiving Systems Conference Paper CameraHMR: Aligning People with Perspective Patel, P., Black, M. J. In International Conference on 3D Vision (3DV), International Conference on 3D Vision, March 2025 (Published) arXiv project BibTeX

Perceiving Systems Conference Paper CHOIR: A Versatile and Differentiable Hand-Object Interaction Representation Morales, T., Taheri, O., Lacey, G. In Winter Conference on Applications of Computer Vision (WACV), February 2025 (Published) GitHub Paper URL BibTeX

Perceiving Systems Conference Paper OpenCapBench: A Benchmark to Bridge Pose Estimation and Biomechanics Gozlan, Y., Falisse, A., Uhlrich, S., Gatti, A., Black, M., Chaudhari, A. In IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) , January 2025 (Published) arXiv code/data URL BibTeX

Perceiving Systems Conference Paper Joker: Conditional 3D Head Synthesis with Extreme Facial Expressions Prinzler, M., Zakharov, E., Sklyarova, V., Kabadayi, B., Thies, J. In International Conference on 3D Vision (3DV), International Conference on 3D Vision, 2025 (Published) project page arxiv BibTeX

Perceiving Systems Conference Paper MotionFix: Text-Driven 3D Human Motion Editing Athanasiou, N., Cseke, A., Diomataris, M., Black, M. J., Varol, G. In SIGGRAPH Asia 2024 Conference Proceedings, ACM, SIGGRAPH Asia , December 2024 (Published) Code (GitHub) Website Data Exploration ArXiv URL BibTeX

Perceiving Systems Conference Paper SPARK: Self-supervised Personalized Real-time Monocular Face Capture Baert, K., Bharadwaj, S., Castan, F., Maujean, B., Christie, M., Abrevaya, V., Boukhayma, A. In SIGGRAPH Asia 2024 Conference Proceedings, SIGGRAPH Asia, December 2024 (Published) DOI URL BibTeX

Perceiving Systems Conference Paper On predicting 3D bone locations inside the human body Dakri, A., Arora, V., Challier, L., Keller, M., Black, M. J., Pujades, S. In 26th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI), October 2024 (Published) Project page BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Stable Video Portraits Ostrek, M., Thies, J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, European Conference on Computer Vision (ECCV 2024), October 2024 (Published) URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Synthesizing Environment-Specific People in Photographs Ostrek, M., O’Sullivan, C., Black, M., Thies, J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, European Conference on Computer Vision (ECCV 2024), October 2024 (Published) URL BibTeX

Perceiving Systems Conference Paper HUMOS: Human Motion Model Conditioned on Body Shape Tripathi, S., Taheri, O., Lassner, C., Black, M. J., Holden, D., Stoll, C. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, October 2024 (Published) project arXiv BibTeX

Perceiving Systems Conference Paper Benchmarks and Challenges in Pose Estimation for Egocentric Hand Interactions with Objects Fan, Z., Ohkawa, T., Yang, L., Lin, N., Zhou, Z., Zhou, S., Liang, J., Gao, Z., Zhang, X., Zhang, X., et al. In European Conference on Computer Vision (ECCV 2024), :428-448, LNCS, Springer Cham, September 2024 (Published) Paper Leaderboard DOI BibTeX

Perceiving Systems Conference Paper Explorative Inbetweening of Time and Space Feng, H., Ding, Z., Xia, Z., Niklaus, S., Fernandez Abrevaya, V., Black, M. J., Zhang, X. In European Conference on Computer Vision (ECCV 2024), :378-395, LNCS, Springer Cham, September 2024 (Published) Paper Website DOI URL BibTeX

Perceiving Systems Conference Paper Generating Human Interaction Motions in Scenes with Text Control Yi, H., Thies, J., Black, M. J., Peng, X. B., Rempe, D. In European Conference on Computer Vision (ECCV 2024), :246-263, LNCS, Springer Cham, September 2024 (Published) pdf project DOI URL BibTeX

Perceiving Systems Conference Paper AWOL: Analysis WithOut synthesis using Language Zuffi, S., Black, M. J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, September 2024 (Published) Paper URL BibTeX

Perceiving Systems Conference Paper GraspXL: Generating Grasping Motions for Diverse Objects at Scale Zhang, H., Christen, S., Fan, Z., Hilliges, O., Song, J. In European Conference on Computer Vision (ECCV 2024), Part XXVI:386-403, LNCS, Springer Cham, September 2024 (Published) Code Video Paper DOI URL BibTeX

Perceiving Systems Conference Paper ContourCraft: Learning to Resolve Intersections in Neural Multi-Garment Simulations Grigorev, A., Becherini, G., Black, M., Hilliges, O., Thomaszewski, B. In ACM SIGGRAPH 2024 Conference Papers, :1-10, SIGGRAPH ’24, Association for Computing Machinery, New York, NY, USA, July 2024 (Published) paper arXiv project video code DOI URL BibTeX

Perceiving Systems Conference Paper A Unified Approach for Text- and Image-guided 4D Scene Generation Zheng, Y., Li, X., Nagano, K., Liu, S., Hilliges, O., Mello, S. D. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) paper project code BibTeX

Perceiving Systems Conference Paper Generative Proxemics: A Prior for 3D Social Interaction from Images Müller, L., Ye, V., Pavlakos, G., Black, M., Kanazawa, A. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :9687-9697, CVPR, June 2024 (Published) arXiv project code data DOI URL BibTeX

Perceiving Systems Conference Paper Multi-Track Timeline Control for Text-Driven 3D Human Motion Generation Petrovich, M., Litany, O., Iqbal, U., Black, M. J., Varol, G., Peng, X. B., Rempe, D. In CVPR Workshop on Human Motion Generation, Seattle, CVPR, June 2024 (Published) code website paper-arxiv video URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Neuropostors: Neural Geometry-aware 3D Crowd Character Impostors Ostrek, M., Mitra, N. J., O’Sullivan, C. In 27th International Conference on Pattern Recognition (ICPR), Springer, 27th International Conference on Pattern Recognition (ICPR), June 2024 (Published) BibTeX

Perceiving Systems Conference Paper Real-time Monocular Full-body Capture in World Space via Sequential Proxy-to-Motion Learning Zhang, H., Zhang, Y., Hu, L., Zhang, J., Yi, H., Zhang, S., Liu, Y. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) arxiv project BibTeX

Perceiving Systems Neural Capture and Synthesis Human-centric Vision & Learning Conference Paper Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) ArXiv Code URL BibTeX

Perceiving Systems Conference Paper 4D-DRESS: A 4D Dataset of Real-World Human Clothing With Semantic Annotations Wang, W., Ho, H., Guo, C., Rong, B., Grigorev, A., Song, J., Zarate, J. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) arXiv project code data BibTeX

Perceiving Systems Conference Paper AMUSE: Emotional Speech-driven 3D Body Animation via Disentangled Latent Diffusion Chhatre, K., Daněček, R., Athanasiou, N., Becherini, G., Peters, C., Black, M. J., Bolkart, T. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :1942-1953, June 2024 (Published) Project Paper Code URL BibTeX

Perceiving Systems Conference Paper ChatPose: Chatting about 3D Human Pose Feng, Y., Lin, J., Dwivedi, S. K., Sun, Y., Patel, P., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) Arxiv Project URL BibTeX

Perceiving Systems Conference Paper EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling Liu, H., Zhu, Z., Becherini, G., Peng, Y., Su, M., Zhou, Y., Zhe, X., Iwamoto, N., Zheng, B., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :1144-1154, CVPR, June 2024 (Published) arXiv project dataset code gradio colab video DOI URL BibTeX

Perceiving Systems Conference Paper HIT: Estimating Internal Human Implicit Tissues from the Body Surface Keller, M., Arora, V., Dakri, A., Chandhok, S., Machann, J., Fritsche, A., Black, M. J., Pujades, S. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :3480-3490, CVPR, June 2024 (Published) Project page Paper DOI URL BibTeX

Perceiving Systems Conference Paper HOLD: Category-agnostic 3D Reconstruction of Interacting Hands and Objects from Video Fan, Z., Parelli, M., Kadoglou, M. E., Kocabas, M., Chen, X., Black, M. J., Hilliges, O. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :494-504, CVPR, June 2024 (Published) Paper Project Code DOI URL BibTeX

Perceiving Systems Conference Paper HUGS: Human Gaussian Splats Kocabas, M., Chang, R., Gabriel, J., Tuzel, O., Ranjan, A. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) arXiv Github Project Page YouTube Poster BibTeX

Perceiving Systems Conference Paper MonoHair: High-Fidelity Hair Modeling from a Monocular Video Wu, K., Yang, L., Kuang, Z., Feng, Y., Han, X., Shen, Y., Fu, H., Zhou, K., Zheng, Y. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :24164-24173, CVPR, June 2024 (Published) Project Arxiv DOI URL BibTeX

Perceiving Systems Conference Paper SCULPT: Shape-Conditioned Unpaired Learning of Pose-dependent Clothed and Textured Human Meshes Sanyal, S., Ghosh, P., Yang, J., Black, M. J., Thies, J., Bolkart, T. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :2362-2371, CVPR, June 2024 (Published) Project page Data Code Video Arxiv DOI URL BibTeX

Perceiving Systems Conference Paper SMIRK: 3D Facial Expressions through Analysis-by-Neural-Synthesis Retsinas, G., Filntisis, P. P., Danecek, R., Abrevaya, V. F., Roussos, A., Bolkart, T., Maragos, P. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :2490-2501, CVPR, June 2024 (Published) arxiv project code DOI URL BibTeX

Perceiving Systems Conference Paper TokenHMR: Advancing Human Mesh Recovery with a Tokenized Pose Representation Dwivedi, S. K., Sun, Y., Patel, P., Feng, Y., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :1323-1333, CVPR, June 2024 (Published) Paper Project Code Poster Video DOI URL BibTeX

Perceiving Systems Conference Paper VAREN: Very Accurate and Realistic Equine Network Zuffi, S., Mellbin, Y., Li, C., Hoeschle, M., Kjellstrom, H., Polikovsky, S., Hernlund, E., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :5374-5383, CVPR, June 2024 (Published) project page paper DOI URL BibTeX

Perceiving Systems Conference Paper WANDR: Intention-guided Human Motion Generation Diomataris, M., Athanasiou, N., Taheri, O., Wang, X., Hilliges, O., Black, M. J. In 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :927,936, IEEE Computer Society, CVPR, June 2024 (Published) project website arXiv YouTube Video Code CVF DOI URL BibTeX

Perceiving Systems Conference Paper WHAM: Reconstructing World-grounded Humans with Accurate 3D Motion Shin, S., Kim, J., Halilaj, E., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :2070-2080, CVPR, June 2024 (Published) arXiv project code DOI URL BibTeX

Perceiving Systems Empirical Inference Conference Paper Ghost on the Shell: An Expressive Representation of General 3D Shapes Liu, Z., Feng, Y., Xiu, Y., Liu, W., Paull, L., Black, M. J., Schölkopf, B. In Proceedings of the Twelfth International Conference on Learning Representations (ICLR), The Twelfth International Conference on Learning Representations (ICLR), May 2024 (Published) Home Code Video Project BibTeX

Empirical Inference Perceiving Systems Conference Paper Parameter-Efficient Orthogonal Finetuning via Butterfly Factorization Liu, W., Qiu, Z., Feng, Y., Xiu, Y., Xue, Y., Yu, L., Feng, H., Liu, Z., Heo, J., Peng, S., et al. In Proceedings of the Twelfth International Conference on Learning Representations (ICLR), The Twelfth International Conference on Learning Representations, May 2024 (Published) Home Code HuggingFace project URL BibTeX

Perceiving Systems Conference Paper Physically plausible full-body hand-object interaction synthesis Braun, J., Christen, S., Kocabas, M., Aksan, E., Hilliges, O. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) arXiv Project Page Github YouTube BibTeX

Perceiving Systems Conference Paper ArtiGrasp: Physically Plausible Synthesis of Bi-Manual Dexterous Grasping and Articulation Zhang, H., Christen, S., Fan, Z., Zheng, L., Hwangbo, J., Song, J., Hilliges, O. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) pdf project code BibTeX

Perceiving Systems Conference Paper GRIP: Generating Interaction Poses Using Spatial Cues and Latent Consistency Taheri, O., Zhou, Y., Tzionas, D., Zhou, Y., Ceylan, D., Pirk, S., Black, M. J. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) Paper SupMat Poster URL BibTeX

Perceiving Systems Conference Paper PACE: Human and Camera Motion Estimation from in-the-wild Videos Kocabas, M., Yuan, Y., Molchanov, P., Guo, Y., Black, M. J., Hilliges, O., Kautz, J., Iqbal, U. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) arXiv Project Page YouTube Poster BibTeX

Perceiving Systems Conference Paper POCO: 3D Pose and Shape Estimation using Confidence Dwivedi, S. K., Schmid, C., Yi, H., Black, M. J., Tzionas, D. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) Code Paper SupMat Poster URL BibTeX

Perceiving Systems Conference Paper TADA! Text to Animatable Digital Avatars Liao, T., Yi, H., Xiu, Y., Tang, J., Huang, Y., Thies, J., Black, M. J. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) Home Code Video URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper TECA: Text-Guided Generation and Editing of Compositional 3D Avatars Zhang, H., Feng, Y., Kulits, P., Wen, Y., Thies, J., Black, M. J. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) arXiv project URL BibTeX

Perceiving Systems Conference Paper TeCH: Text-guided Reconstruction of Lifelike Clothed Humans Huang, Y., Yi, H., Xiu, Y., Liao, T., Tang, J., Cai, D., Thies, J. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) Code Home Video arXiv URL BibTeX

Perceiving Systems Conference Paper Adversarial Likelihood Estimation With One-Way Flows Ben-Dov, O., Gupta, P. S., Abrevaya, V., Black, M. J., Ghosh, P. In Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), :3779-3788, January 2024 (Published) pdf arXiv BibTeX

Publications

Filter by