Perceiving Systems Conference Paper 2019

Markerless Outdoor Human Motion Capture Using Multiple Autonomous Micro Aerial Vehicles

Code Data Video
Thumb ticker sm profile
Perceiving Systems
  • Guest Scientist
Thumb ticker sm portrait small
Perceiving Systems
  • Guest Scientist
Thumb ticker sm scholar
Perceiving Systems
  • Doctoral Researcher
Thumb ticker sm re  1
Software Workshop
Senior Research Engineer @ Software Workshop
Thumb ticker sm new small
Perceiving Systems
  • Student Assistant
Thumb ticker sm slika
Perceiving Systems
  • Affiliated Researcher
Thumb ticker sm aamir
Perceiving Systems
Tenure-track Professor, University of Stuttgart, Research Group Leader (mpi-is)
Thumb ticker sm headshot2021
Perceiving Systems
Director
Iccv 2 cover crop small

Capturing human motion in natural scenarios means moving motion capture out of the lab and into the wild. Typical approaches rely on fixed, calibrated, cameras and reflective markers on the body, significantly limiting the motions that can be captured. To make motion capture truly unconstrained, we describe the first fully autonomous outdoor capture system based on flying vehicles. We use multiple micro-aerial-vehicles(MAVs), each equipped with a monocular RGB camera, an IMU, and a GPS receiver module. These detect the person, optimize their position, and localize themselves approximately. We then develop a markerless motion capture method that is suitable for this challenging scenario with a distant subject, viewed from above, with approximately calibrated and moving cameras. We combine multiple state-of-the-art 2D joint detectors with a 3D human body model and a powerful prior on human pose. We jointly optimize for 3D body pose and camera pose to robustly fit the 2D measurements. To our knowledge, this is the first successful demonstration of outdoor, full-body, markerless motion capture from autonomous flying vehicles.

Author(s): Nitin Saini and Eric Price and Rahul Tallamraju and Raffi Enficiaud and Roman Ludwig and Igor Martinović and Aamir Ahmad and Michael Black
Links:
Book Title: Proceedings 2019 IEEE/CVF International Conference on Computer Vision (ICCV)
Pages: 823--832
Year: 2019
Month: October
Day: 27-30
Publisher: IEEE
Project(s):
Bibtex Type: Conference Paper (conference)
DOI: 10.1109/ICCV.2019.00091
Event Name: International Conference on Computer Vision (ICCV)
Event Place: Seoul, South Korea
State: Published
Electronic Archiving: grant_archive
ISBN: 978-1-7281-4803-8
Attachments:

BibTex

@conference{Nitin_ICCV_19,
  title = {Markerless Outdoor Human Motion Capture Using Multiple Autonomous Micro Aerial Vehicles},
  booktitle = {Proceedings 2019 IEEE/CVF International Conference on Computer Vision (ICCV)},
  abstract = {Capturing human motion in natural scenarios means moving motion capture out of the lab and into the wild. Typical approaches rely on fixed, calibrated, cameras and reflective markers on the body, significantly limiting the motions that can be captured. To make motion capture truly unconstrained, we describe the first fully autonomous outdoor capture system based on flying vehicles. We use multiple micro-aerial-vehicles(MAVs), each equipped with a monocular RGB camera, an IMU, and a GPS receiver module. These detect the person, optimize their position, and localize themselves approximately. We then develop a markerless motion capture method that is suitable for this challenging scenario with a distant subject, viewed from above, with approximately calibrated and moving cameras. We combine multiple state-of-the-art 2D joint detectors with a 3D human body model and a powerful prior on human pose. We jointly optimize for 3D body pose and camera pose to robustly fit the 2D measurements. To our knowledge, this is the first successful demonstration of outdoor, full-body, markerless motion capture from autonomous flying vehicles.},
  pages = {823--832},
  publisher = {IEEE},
  month = oct,
  year = {2019},
  slug = {nitin_iccv_19},
  author = {Saini, Nitin and Price, Eric and Tallamraju, Rahul and Enficiaud, Raffi and Ludwig, Roman and Martinović, Igor and Ahmad, Aamir and Black, Michael},
  month_numeric = {10}
}