Header logo is

Learning an Infant Body Model from RGB-D Data for Accurate Full Body Motion Analysis


Conference Paper


Infant motion analysis enables early detection of neurodevelopmental disorders like cerebral palsy (CP). Diagnosis, however, is challenging, requiring expert human judgement. An automated solution would be beneficial but requires the accurate capture of 3D full-body movements. To that end, we develop a non-intrusive, low-cost, lightweight acquisition system that captures the shape and motion of infants. Going beyond work on modeling adult body shape, we learn a 3D Skinned Multi-Infant Linear body model (SMIL) from noisy, low-quality, and incomplete RGB-D data. We demonstrate the capture of shape and motion with 37 infants in a clinical environment. Quantitative experiments show that SMIL faithfully represents the data and properly factorizes the shape and pose of the infants. With a case study based on general movement assessment (GMA), we demonstrate that SMIL captures enough information to allow medical assessment. SMIL provides a new tool and a step towards a fully automatic system for GMA.

Author(s): Nikolas Hesse and Sergi Pujades and Javier Romero and Michael J. Black and Christoph Bodensteiner and Michael Arens and Ulrich G. Hofmann and Uta Tacke and Mijna Hadders-Algra and Raphael Weinberger and Wolfgang Muller-Felber and A. Sebastian Schroeder
Book Title: Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI)
Year: 2018
Month: September

Department(s): Perceiving Systems
Research Project(s): Medical Diagnosis
Bibtex Type: Conference Paper (inproceedings)
Paper Type: Conference

DOI: 10.1007/978-3-030-00928-1_89

Links: pdf
Project page
extended arXiv version


  title = {Learning an Infant Body Model from {RGB-D} Data for Accurate Full Body Motion Analysis},
  author = {Hesse, Nikolas and Pujades, Sergi and Romero, Javier and Black, Michael J. and Bodensteiner, Christoph and Arens, Michael and Hofmann, Ulrich G. and Tacke, Uta and Hadders-Algra, Mijna and Weinberger, Raphael and Muller-Felber, Wolfgang and Schroeder, A. Sebastian},
  booktitle = {Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI)},
  month = sep,
  year = {2018},
  month_numeric = {9}