Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Neural Capture and Synthesis Perceiving Systems Conference Paper Stable Video Portraits Ostrek, M., Thies, J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, European Conference on Computer Vision (ECCV 2024), October 2024 (Published) URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Synthesizing Environment-Specific People in Photographs Ostrek, M., O’Sullivan, C., Black, M., Thies, J. In European Conference on Computer Vision (ECCV 2024), LNCS, Springer Cham, European Conference on Computer Vision (ECCV 2024), October 2024 (Published) URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Neuropostors: Neural Geometry-aware 3D Crowd Character Impostors Ostrek, M., Mitra, N. J., O’Sullivan, C. In 27th International Conference on Pattern Recognition (ICPR), Springer, 27th International Conference on Pattern Recognition (ICPR), June 2024 (Published) BibTeX

Perceiving Systems Neural Capture and Synthesis Human-centric Vision & Learning Conference Paper Text-Conditioned Generative Model of 3D Strand-based Human Hairstyles Sklyarova, V., Zakharov, E., Hilliges, O., Black, M. J., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, June 2024 (Published) ArXiv Code URL BibTeX

Neural Capture and Synthesis Conference Paper GAN-Avatar: Controllable Personalized GAN-based Human Head Avatar Kabadayi, B., Zielonka, W., Bhatnagar, B. L., Pons-Moll, G., Thies, J. In International Conference on 3D Vision (3DV), March 2024 (Published) Video Webpage Code Arxiv BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper TECA: Text-Guided Generation and Editing of Compositional 3D Avatars Zhang, H., Feng, Y., Kulits, P., Wen, Y., Thies, J., Black, M. J. In International Conference on 3D Vision (3DV 2024), 3DV, March 2024 (Published) arXiv project URL BibTeX

Neural Capture and Synthesis Conference Paper FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models Aneja, S., Thies, J., Dail, A., Niessner, M. In Proceedings 2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :21263-21273, IEEE, CVPR, 2024 (Published) DOI URL BibTeX

Neural Capture and Synthesis Conference Paper High-Res Facial Appearance Capture from Polarized Smartphone Images Azinovic, D. M. O. H. C. N. M. T. J. In Proceedings 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :16836-16846, Vancouver, CA, CVPR, June 2023 (Published) DOI URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Instant Volumetric Head Avatars Zielonka, W., Bolkart, T., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :4574-4584, CVPR, June 2023 (Published) pdf project video code face tracker code dataset DOI URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper MIME: Human-Aware 3D Scene Generation Yi, H., Huang, C. P., Tripathi, S., Hering, L., Thies, J., Black, M. J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), :12965-12976, CVPR, June 2023 (Published) project arXiv paper URL BibTeX

Neural Capture and Synthesis Conference Paper DINER: Depth-aware Image-based Neural Radiance Fields Prinzler, M., Hilliges, O., Thies, J. In IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), CVPR, 2023, Accepted (Accepted) Video Code Arxiv URL BibTeX

Neural Capture and Synthesis Conference Paper ClipFace: Text-guided Editing of Textured 3D Morphable Models Aneja, S., Thies, J., Dai, A., Niessner, M. In PROCEEDINGS OF SIGGRAPH 2023 CONFERENCE PAPERS, SIGGRAPH 2023, :1-11, ACM SIGGRAPH Conference, 2023 (Published) DOI URL BibTeX

Neural Capture and Synthesis Perceiving Systems Conference Paper Towards Metrical Reconstruction of Human Faces Zielonka, W., Bolkart, T., Thies, J. In Computer Vision – ECCV 2022, 13:250-269, Lecture Notes in Computer Science, 13673, (Editors: Avidan, Shai and Brostow, Gabriel and Cissé, Moustapha and Farinella, Giovanni Maria and Hassner, Tal), Springer, Cham, 17th European Conference on Computer Vision (ECCV 2022), October 2022 (Published) pdf project video code DOI URL BibTeX

Perceiving Systems Neural Capture and Synthesis Conference Paper Human-Aware Object Placement for Visual Environment Reconstruction Yi, H., Huang, C. P., Tzionas, D., Kocabas, M., Hassan, M., Tang, S., Thies, J., Black, M. J. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), :3949-3960, IEEE, Piscataway, NJ, IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), June 2022 (Published) project arXiv DOI URL BibTeX

Neural Capture and Synthesis Conference Paper Neural Head Avatars from Monocular RGB Videos Grassal, P., Prinzler, M., Leistner, T., Rother, C., Nießner, M., Thies, J. In 2022 IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR) , :18632-18643 , IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 2022 (Published) Code Video DOI URL BibTeX

Neural Capture and Synthesis Conference Paper Dynamic Surface Function Networks for Clothed Human Bodies Burov, A., Nießner, M., Thies, J. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :10734-10744, IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021 (Published) DOI URL BibTeX

Neural Capture and Synthesis Conference Paper ID-Reveal: Identity-aware DeepFake Video Detection Cozzolino, D., Rössler, A., Thies, J., Nießner, M., Verdoliva, L. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :15088-15097 , IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021 (Published) Paper Video Code DOI URL BibTeX

Neural Capture and Synthesis Conference Paper Neural Parametric Models for 3D Deformable Shapes Palafox, P., Bozic, A., Thies, J., Nießner, M., Dai, A. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV 2021) , :12675-12685 , IEEE, IEEE/CVF International Conference on Computer Vision (ICCV 2021) , October 2021 (Published) DOI BibTeX

Neural Capture and Synthesis Conference Paper RetrievalFuse: Neural 3D Scene Reconstruction with a Database Siddiqui, Y., Thies, J., Ma, F., Shan, Q., Nießner, M., Dai, A. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), :12548-12557 , IEEE/CVF International Conference on Computer Vision (ICCV 2021), October 2021 (Published) DOI BibTeX

Neural Capture and Synthesis Conference Paper Neural RGB-D Surface Reconstruction Azinovic, D., Martin-Brualla, R., Goldman, D. B., Nießner, M., Thies, J. ArXiv, 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), :6280-6291 , IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2022), 2021 (Published) DOI URL BibTeX

Neural Capture and Synthesis Conference Paper TransformerFusion: Monocular RGB Scene Reconstruction using Transformers Bozic, A., Palafox, P., Thies, J., Dai, A., Nießner, M. Advances in Neural Information Processing Systems 34 (NeurIPS 2021) , 2:1403-1414 , 35th Conference on Neural Information Processing Systems , 2021 (Published) BibTeX