Header logo is


2019


Towards Geometric Understanding of Motion
Towards Geometric Understanding of Motion

Ranjan, A.

University of Tübingen, December 2019 (phdthesis)

Abstract

The motion of the world is inherently dependent on the spatial structure of the world and its geometry. Therefore, classical optical flow methods try to model this geometry to solve for the motion. However, recent deep learning methods take a completely different approach. They try to predict optical flow by learning from labelled data. Although deep networks have shown state-of-the-art performance on classification problems in computer vision, they have not been as effective in solving optical flow. The key reason is that deep learning methods do not explicitly model the structure of the world in a neural network, and instead expect the network to learn about the structure from data. We hypothesize that it is difficult for a network to learn about motion without any constraint on the structure of the world. Therefore, we explore several approaches to explicitly model the geometry of the world and its spatial structure in deep neural networks.

The spatial structure in images can be captured by representing it at multiple scales. To represent multiple scales of images in deep neural nets, we introduce a Spatial Pyramid Network (SpyNet). Such a network can leverage global information for estimating large motions and local information for estimating small motions. We show that SpyNet significantly improves over previous optical flow networks while also being the smallest and fastest neural network for motion estimation. SPyNet achieves a 97% reduction in model parameters over previous methods and is more accurate.

The spatial structure of the world extends to people and their motion. Humans have a very well-defined structure, and this information is useful in estimating optical flow for humans. To leverage this information, we create a synthetic dataset for human optical flow using a statistical human body model and motion capture sequences. We use this dataset to train deep networks and see significant improvement in the ability of the networks to estimate human optical flow.

The structure and geometry of the world affects the motion. Therefore, learning about the structure of the scene together with the motion can benefit both problems. To facilitate this, we introduce Competitive Collaboration, where several neural networks are constrained by geometry and can jointly learn about structure and motion in the scene without any labels. To this end, we show that jointly learning single view depth prediction, camera motion, optical flow and motion segmentation using Competitive Collaboration achieves state-of-the-art results among unsupervised approaches.

Our findings provide support for our hypothesis that explicit constraints on structure and geometry of the world lead to better methods for motion estimation.

ps

PhD Thesis [BibTex]

2019


PhD Thesis [BibTex]


no image
X-ray microscopic characterization of high-Tc-supercoductors using image processing

Bihler, M.

Universität Stuttgart, Stuttgart, 2019 (mastersthesis)

mms

[BibTex]


no image
Novel X-ray lenses for direct and coherent imaging

Sanli, U. T.

Universität Stuttgart, Stuttgart, 2019 (phdthesis)

mms

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2007


no image
On the theory of magnetization dynamics of non-collinear spin systems in the s-d model

De Angeli, L.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

2007


[BibTex]


no image
Zur ab-initio Elektronentheorie des Magnetismus bei endlichen Temperaturen

Dietermann, F.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Röntgenzirkulardichroische Untersuchungen an ferromagnetischen verdünnten Halbleitersystemen

Tietze, T.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Low-dimensional Fe on vicinal Ir(997): Growth and magnetic properties

Kawwam, M.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Micromagnetic simulations of switching processes and the role of thermal fluctuations

Macke, S.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Physisorption von Wasserstoff in neuen Materialien mit gro\sser spezifischer Oberfläche

Schmitz, B.

Universität Bonn, Bonn, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Towards spin injection into silicon

Dash, S. P.

Universität Stuttgart, Stuttgart, 2007 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Bestimmung der kritischen Schichtdicken ferromagnetischer Plättchen für Eindomänenverhalten

Soehnle, S.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Zeitaufgelöste Röntgenmikroskopie an magnetischen Mikrostrukturen

Puzic, A.

Universität Stuttgart, Stuttgart, 2007 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Vortex dynamics studied by time-resolved X-ray microscopy

Chou, K. W.

Universität Stuttgart, Stuttgart, 2007 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Resonante magnetische Reflektometrie an Ferromagnet/Paramagnet Heterostrukturen

Ferreras Paz, V.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Herstellung und Charakterisierung dünner Niob-Schichten auf verschiedenen Substraten

Mayer, M. W. R.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Formation of hard magnetic L10-FePt/FePd monolayers from elemental multilayers

Goo, N. H.

Universität Stuttgart, Stuttgart, 2007 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Zur ab-initio Elektronentheorie stark nichtkollinearer Spinsysteme

Köberle, I.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Theorie der Kernspektroskopie mit zirkular polarisierter Gammastrahlung

Engelhart, W.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Untersuchung der Adsorption von Wasserstoff in porösen Materialien

Hönes, K.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Untersuchung der mechanischen Eigenschaften dünner Chromschichten

Jüllig, P.

Universität Stuttgart, Stuttgart, 2007 (mastersthesis)

mms

[BibTex]

[BibTex]

2004


no image
Investigation of oxide layers in tunnel junctions

Amaladass, E. P.

University of Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

2004


[BibTex]


no image
Untersuchung der Desorptionskinetik von Metallhydriden in Bezug auf technische Anwendungen

von Zeppelin, F.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Dynamik von Wasserstoff in nanokristallinen Systemen

Stanik, E.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Inselwachstum auf Festkörperoberflächen unter Ionenbestrahlung

Frank, A.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

link (url) [BibTex]

link (url) [BibTex]


no image
Flusslinienverankerung in HTSL-Schichten mit kontrollierter Defektstruktur im Nanometerbereich

Leonhardt, S.

Universität Stuttgart, Stuttgart, 2004 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Investigation of the stability of metals on polymers

Amoako, G.

University of Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Flusslinienverankerung in Hochtemperatursupraleitern auf nanostrukturierten Substraten

Brück, S.

Universität Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Ionenstreuung mit Monolagen-Tiefenauflösung

Olliges, S.

Universität Stuttgart, Stuttgart, 2004 (mastersthesis)

mms

[BibTex]

[BibTex]


no image
Untersuchungen zum Magnetismus von Clustern und Nanopartikeln und zum Einfluss der Wechselwirkung mit ihrer Umgebung

Fauth, Kai

Julius-Maximilians-Universität Würzburg, Würzburg, 2004 (phdthesis)

mms

[BibTex]

[BibTex]

2002


no image
Untersuchungen zur Spindynamik in nanostrukturierten ferromagnetischen Schichtsystemen

Puzic, A.

Universität Stuttgart, Stuttgart, 2002 (mastersthesis)

mms

[BibTex]

2002


[BibTex]


no image
Magnetic Imaging of Nanostructured Systems with Transmission X-Ray Microscopy

Eimüller, T.

Bayrische Julius-Maximilians-Universität Würzburg, Würzburg, 2002 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Ab-initio Berechnung der Spinwellenspektren von Eisen, Kobalt und Nickel

Grotheer, O.

Universität Stuttgart, Stuttgart, 2002 (phdthesis)

mms

[BibTex]

[BibTex]


no image
Kernspinresonanzuntersuchungen zur Diffusion von Wasserstoff in kubischen Lavesphasen

Eberle, U.

Universität Stuttgart, Stuttgart, 2002 (phdthesis)

mms

[BibTex]

[BibTex]