Header logo is


2017


Human Shape Estimation using Statistical Body Models
Human Shape Estimation using Statistical Body Models

Loper, M. M.

University of Tübingen, May 2017 (thesis)

Abstract
Human body estimation methods transform real-world observations into predictions about human body state. These estimation methods benefit a variety of health, entertainment, clothing, and ergonomics applications. State may include pose, overall body shape, and appearance. Body state estimation is underconstrained by observations; ambiguity presents itself both in the form of missing data within observations, and also in the form of unknown correspondences between observations. We address this challenge with the use of a statistical body model: a data-driven virtual human. This helps resolve ambiguity in two ways. First, it fills in missing data, meaning that incomplete observations still result in complete shape estimates. Second, the model provides a statistically-motivated penalty for unlikely states, which enables more plausible body shape estimates. Body state inference requires more than a body model; we therefore build obser- vation models whose output is compared with real observations. In this thesis, body state is estimated from three types of observations: 3D motion capture markers, depth and color images, and high-resolution 3D scans. In each case, a forward process is proposed which simulates observations. By comparing observations to the results of the forward process, state can be adjusted to minimize the difference between simulated and observed data. We use gradient-based methods because they are critical to the precise estimation of state with a large number of parameters. The contributions of this work include three parts. First, we propose a method for the estimation of body shape, nonrigid deformation, and pose from 3D markers. Second, we present a concise approach to differentiating through the rendering process, with application to body shape estimation. And finally, we present a statistical body model trained from human body scans, with state-of-the-art fidelity, good runtime performance, and compatibility with existing animation packages.

ps

Official Version [BibTex]


Learning Inference Models for Computer Vision
Learning Inference Models for Computer Vision

Jampani, V.

MPI for Intelligent Systems and University of Tübingen, 2017 (phdthesis)

Abstract
Computer vision can be understood as the ability to perform 'inference' on image data. Breakthroughs in computer vision technology are often marked by advances in inference techniques, as even the model design is often dictated by the complexity of inference in them. This thesis proposes learning based inference schemes and demonstrates applications in computer vision. We propose techniques for inference in both generative and discriminative computer vision models. Despite their intuitive appeal, the use of generative models in vision is hampered by the difficulty of posterior inference, which is often too complex or too slow to be practical. We propose techniques for improving inference in two widely used techniques: Markov Chain Monte Carlo (MCMC) sampling and message-passing inference. Our inference strategy is to learn separate discriminative models that assist Bayesian inference in a generative model. Experiments on a range of generative vision models show that the proposed techniques accelerate the inference process and/or converge to better solutions. A main complication in the design of discriminative models is the inclusion of prior knowledge in a principled way. For better inference in discriminative models, we propose techniques that modify the original model itself, as inference is simple evaluation of the model. We concentrate on convolutional neural network (CNN) models and propose a generalization of standard spatial convolutions, which are the basic building blocks of CNN architectures, to bilateral convolutions. First, we generalize the existing use of bilateral filters and then propose new neural network architectures with learnable bilateral filters, which we call `Bilateral Neural Networks'. We show how the bilateral filtering modules can be used for modifying existing CNN architectures for better image segmentation and propose a neural network approach for temporal information propagation in videos. Experiments demonstrate the potential of the proposed bilateral networks on a wide range of vision tasks and datasets. In summary, we propose learning based techniques for better inference in several computer vision models ranging from inverse graphics to freely parameterized neural networks. In generative vision models, our inference techniques alleviate some of the crucial hurdles in Bayesian posterior inference, paving new ways for the use of model based machine learning in vision. In discriminative CNN models, the proposed filter generalizations aid in the design of new neural network architectures that can handle sparse high-dimensional data as well as provide a way for incorporating prior knowledge into CNNs.

ps

pdf [BibTex]

pdf [BibTex]


Methods, apparatuses, and systems for micromanipulation with adhesive fibrillar structures
Methods, apparatuses, and systems for micromanipulation with adhesive fibrillar structures

Sitti, M., Mengüç, Y.

US Patent 9,731,422, 2017 (patent)

Abstract
The present invention are methods for fabrication of micro- and/or nano-scale adhesive fibers and their use for movement and manipulation of objects. Further disclosed is a method of manipulating a part by providing a manipulation device with a plurality of fibers, where each fiber has a tip with a flat surface that is parallel to a backing layer, contacting the flat surfaces on an object, moving the object to a new location, then disengaging the tips from the object.

pi

link (url) [BibTex]


Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects
Capturing Hand-Object Interaction and Reconstruction of Manipulated Objects

Tzionas, D.

University of Bonn, 2017 (phdthesis)

Abstract
Hand motion capture with an RGB-D sensor gained recently a lot of research attention, however, even most recent approaches focus on the case of a single isolated hand. We focus instead on hands that interact with other hands or with a rigid or articulated object. Our framework successfully captures motion in such scenarios by combining a generative model with discriminatively trained salient points, collision detection and physics simulation to achieve a low tracking error with physically plausible poses. All components are unified in a single objective function that can be optimized with standard optimization techniques. We initially assume a-priori knowledge of the object's shape and skeleton. In case of unknown object shape there are existing 3d reconstruction methods that capitalize on distinctive geometric or texture features. These methods though fail for textureless and highly symmetric objects like household articles, mechanical parts or toys. We show that extracting 3d hand motion for in-hand scanning effectively facilitates the reconstruction of such objects and we fuse the rich additional information of hands into a 3d reconstruction pipeline. Finally, although shape reconstruction is enough for rigid objects, there is a lack of tools that build rigged models of articulated objects that deform realistically using RGB-D data. We propose a method that creates a fully rigged model consisting of a watertight mesh, embedded skeleton and skinning weights by employing a combination of deformable mesh tracking, motion segmentation based on spectral clustering and skeletonization based on mean curvature flow.

ps

Thesis link (url) Project Page [BibTex]


no image
Understanding FORC using synthetic micro-structured systems with variable coupling- and coercivefield distributions

Groß, Felix

Universität Stuttgart, Stuttgart, 2017 (mastersthesis)

mms

[BibTex]


no image
Adsorption von Wasserstoffmolekülen in nanoporösen Gerüststrukturen

Kotzur, Nadine

Universität Stuttgart, Stuttgart, 2017 (mastersthesis)

mms

[BibTex]

[BibTex]

2016


Non-parametric Models for Structured Data and Applications to Human Bodies and Natural Scenes
Non-parametric Models for Structured Data and Applications to Human Bodies and Natural Scenes

Lehrmann, A.

ETH Zurich, July 2016 (phdthesis)

Abstract
The purpose of this thesis is the study of non-parametric models for structured data and their fields of application in computer vision. We aim at the development of context-sensitive architectures which are both expressive and efficient. Our focus is on directed graphical models, in particular Bayesian networks, where we combine the flexibility of non-parametric local distributions with the efficiency of a global topology with bounded treewidth. A bound on the treewidth is obtained by either constraining the maximum indegree of the underlying graph structure or by introducing determinism. The non-parametric distributions in the nodes of the graph are given by decision trees or kernel density estimators. The information flow implied by specific network topologies, especially the resultant (conditional) independencies, allows for a natural integration and control of contextual information. We distinguish between three different types of context: static, dynamic, and semantic. In four different approaches we propose models which exhibit varying combinations of these contextual properties and allow modeling of structured data in space, time, and hierarchies derived thereof. The generative character of the presented models enables a direct synthesis of plausible hypotheses. Extensive experiments validate the developed models in two application scenarios which are of particular interest in computer vision: human bodies and natural scenes. In the practical sections of this work we discuss both areas from different angles and show applications of our models to human pose, motion, and segmentation as well as object categorization and localization. Here, we benefit from the availability of modern datasets of unprecedented size and diversity. Comparisons to traditional approaches and state-of-the-art research on the basis of well-established evaluation criteria allows the objective assessment of our contributions.

ps

pdf [BibTex]


System and method to magnetically actuate a capsule endoscopic robot for diagnosis and treatment
System and method to magnetically actuate a capsule endoscopic robot for diagnosis and treatment

Sitti, M., Yim, S.

May 2016, US Patent 9,445,711 (patent)

Abstract
Present invention describes a swallowable device with a soft, compliant exterior, whose shape can be changed through the use of magnetic fields, and which can be locomoted in a rolling motion through magnetic control from the exterior of the patient. The present invention could be used for a variety of medical applications inside the GI tract including but not limited to drug delivery, biopsy, heat cauterization, pH sensing, biochemical sensing, micro-surgery, and active imaging.

pi

link (url) [BibTex]


Remotely addressable magnetic composite micro-actuators
Remotely addressable magnetic composite micro-actuators

Sitti, M., Diller, E., Miyashita, S.

Febuary 2016, US Patent App. 15/018,008 (patent)

Abstract
The present invention describes methods to fabricate actuators that can be remotely controlled in an addressable manner, and methods to provide remote control such micro-actuators. The actuators are composites of two permanent magnet materials, one of which is has high coercivity, and the other of which switches magnetization direction by applied fields. By switching the second material's magnetization direction, the two magnets either work together or cancel each other, resulting in distinct “on” and “off” behavior of the devices. The device can be switched “on” or “off” remotely using a field pulse of short duration.

pi

[BibTex]

[BibTex]


Remotely addressable magnetic composite micro-actuators
Remotely addressable magnetic composite micro-actuators

Sitti, M., Diller, E., Miyashita, S.

Febuary 2016, US Patent 9,281,112 (patent)

Abstract
The present invention describes methods to fabricate actuators that can be remotely controlled in an addressable manner, and methods to provide remote control such micro-actuators. The actuators are composites of two permanent magnet materials, one of which is has high coercivity, and the other of which switches magnetization direction by applied fields. By switching the second material's magnetization direction, the two magnets either work together or cancel each other, resulting in distinct “on” and “off” behavior of the devices. The device can be switched “on” or “off” remotely using a field pulse of short duration.

pi

link (url) [BibTex]

link (url) [BibTex]


{Statische und dynamische Magnetisierungseigenschaften nanoskaliger \"Uberstrukturen}
Statische und dynamische Magnetisierungseigenschaften nanoskaliger Überstrukturen

Gräfe, J.

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2016 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Gepinnte Bahnmomente in magnetischen Heterostrukturen

Audehm, P.

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2016 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Austauschgekoppelte Moden in magnetischen Vortexstrukturen

Dieterle, G.

Universität Stuttgart, Stuttgart, 2016 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Density matrix calculations for the ultrafast demagnetization after femtosecond laser pulses

Weng, Weikai

Universität Stuttgart, Stuttgart, 2016 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Helium und Hydrogen Isotope Adsorption and Separation in Metal-Organic Frameworks

Zaiser, Ingrid

Universität Stuttgart, Stuttgart (und Cuvillier Verlag, Göttingen), 2016 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Statics and dynamics of simple fluids on chemically patterned substrates

Dörfler, F.

Universität Stuttgart, Stuttgart, Germany, 2010 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Entnetzung verspannter Filme

Reindl, A.

Universität Stuttgart, Stuttgart, 2010 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Advanced ferromagnetic nanostructures

Goll, D.

Universität Stuttgart, Stuttgart, 2010 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Wasserstoff in funktionellen Dünnschichtsystemen

Honert, J.

Universität Stuttgart, Stuttgart, 2010 (mastersthesis)

mms

[BibTex]

[BibTex]

2009


no image
Magnetische L10-FePt Nanostrukturen für höchste Datenspeicherdichten

Breitling, A.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

[BibTex]

2009


[BibTex]


no image
Ab-initio Elliott-Yafet modeling of ultrafast demagnetization after laser irradiation

Illg, C.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Element specific investigation of the magnetization profile at the CrO2/RuO2 interface

Zafar, K.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Bayesian Methods for Autonomous Learning Systems (Phd Thesis)

Ting, J.

Department of Computer Science, University of Southern California, Los Angeles, CA, 2009, clmc (phdthesis)

am

PDF [BibTex]

PDF [BibTex]


no image
Magnetic resonant reflectometry on exchange bias systems

Brück, S.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
In-situ - Untersuchungen zu Interdiffusion und Magnetismus in magnetischen Multilayern

Schmidt, M.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Theorie der elektronischen Zustände in oxidischen magnetischen Materialien

Kostoglou, C.

Universität Stuttgart, Stuttgart, 2009 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Magnetooptische Untersuchungen an Ferromagnet- und Supraleiter-Nanosystemen und deren Hybriden

Treiber, S.

Universität Stuttgart, Stuttgart, 2009 (mastersthesis)

mms

[BibTex]

[BibTex]

2004


no image
Investigation of oxide layers in tunnel junctions

Amaladass, E. P.

University of Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

2004


[BibTex]


no image
Untersuchung der Desorptionskinetik von Metallhydriden in Bezug auf technische Anwendungen

von Zeppelin, F.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Towards Tractable Parameter-Free Statistical Learning (Phd Thesis)

D’Souza, A

Department of Computer Science, University of Southern California, Los Angeles, 2004, clmc (phdthesis)

am

link (url) [BibTex]

link (url) [BibTex]


no image
Dynamik von Wasserstoff in nanokristallinen Systemen

Stanik, E.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Inselwachstum auf Festkörperoberflächen unter Ionenbestrahlung

Frank, A.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Flusslinienverankerung in HTSL-Schichten mit kontrollierter Defektstruktur im Nanometerbereich

Leonhardt, S.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Investigation of the stability of metals on polymers

Amoako, G.

University of Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Flusslinienverankerung in Hochtemperatursupraleitern auf nanostrukturierten Substraten

Brück, S.

Universität Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Ionenstreuung mit Monolagen-Tiefenauflösung

Olliges, S.

Universität Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Untersuchungen zum Magnetismus von Clustern und Nanopartikeln und zum Einfluss der Wechselwirkung mit ihrer Umgebung

Fauth, Kai

Julius-Maximilians-Universität Würzburg, Würzburg, 2004 (phdthesis)

mms

[BibTex]

[BibTex]