Perceiving Systems The MIT License 2019-09-11

Three-D Safari: Learning to Estimate Zebra Pose, Shape, and Texture from Images "In the Wild"

Perceiving Systems
  • Guest Scientist
Perceiving Systems
Perceiving Systems
Emeritus / Acting Director

We present the first method to perform automatic 3D pose, shape and texture capture of animals from images acquired in-the-wild. In particular, we focus on the problem of capturing 3D information about Grevy's zebras from a collection of images. We integrate the recent SMAL animal model into a network-based regression pipeline, which we train end-to-end on synthetically generated images with pose, shape, and background variation. We couple 3D pose and shape prediction with the task of texture synthesis, obtaining a full texture map of the animal from a single image. The predicted texture map allows a novel per-instance unsupervised optimization over the network features. We called the method SMALST (SMAL with learned Shape and Texture).

Release Date: 11 September 2019
licence_type: The MIT License
Copyright: Max Planck Society
Authors: Silvia Zuffi, Angjoo Kanazawa, Tanya Berger-Wolf, Michael J. Black
Repository: https://github.com/silviazuffi/smalst
Project(s):