Header logo is


2018


Thumb xl publication alife 2018
Systematic self-exploration of behaviors for robots in a dynamical systems framework

Pinneri, C., Martius, G.

In Proc. Artificial Life XI, pages: 319-326, MIT Press, Cambridge, MA, 2018 (inproceedings)

Abstract
One of the challenges of this century is to understand the neural mechanisms behind cognitive control and learning. Recent investigations propose biologically plausible synaptic mechanisms for self-organizing controllers, in the spirit of Hebbian learning. In particular, differential extrinsic plasticity (DEP) [Der and Martius, PNAS 2015], has proven to enable embodied agents to self-organize their individual sensorimotor development, and generate highly coordinated behaviors during their interaction with the environment. These behaviors are attractors of a dynamical system. In this paper, we use the DEP rule to generate attractors and we combine it with a “repelling potential” which allows the system to actively explore all its attractor behaviors in a systematic way. With a view to a self-determined exploration of goal-free behaviors, our framework enables switching between different motion patterns in an autonomous and sequential fashion. Our algorithm is able to recover all the attractor behaviors in a toy system and it is also effective in two simulated environments. A spherical robot discovers all its major rolling modes and a hexapod robot learns to locomote in 50 different ways in 30min.

al

link (url) DOI Project Page [BibTex]

2018


link (url) DOI Project Page [BibTex]


no image
Incorporation of Terbium into a Microalga Leads to Magnetotactic Swimmers

Santomauro, G., Singh, A., Park, B. W., Mohammadrahimi, M., Erkoc, P., Goering, E., Schütz, G., Sitti, M., Bill, J.

Advanced Biosystems, 2(12):1800039, 2018 (article)

mms pi

[BibTex]

[BibTex]


no image
Endo-VMFuseNet: A Deep Visual-Magnetic Sensor Fusion Approach for Endoscopic Capsule Robots

Turan, M., Almalioglu, Y., Gilbert, H. B., Sari, A. E., Soylu, U., Sitti, M.

In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages: 1-7, 2018 (inproceedings)

pi

[BibTex]

[BibTex]


Thumb xl picture8
Morphological intelligence counters foot slipping in the desert locust and dynamic robots

Woodward, M. A., Sitti, M.

Proceedings of the National Academy of Sciences, 115, pages: E8358-E8367, 2018 (article)

Abstract
During dynamic terrestrial locomotion, animals use complex multifunctional feet to extract friction from the environment. However, whether roboticists assume sufficient surface friction for locomotion or actively compensate for slipping, they use relatively simple point-contact feet. We seek to understand and extract the morphological adaptations of animal feet that contribute to enhancing friction on diverse surfaces, such as the desert locust (Schistocerca gregaria) [Bennet-Clark HC (1975) J Exp Biol 63:53–83], which has both wet adhesive pads and spines. A buckling region in their knee to accommodate slipping [Bayley TG, Sutton GP, Burrows M (2012) J Exp Biol 215:1151–1161], slow nerve conduction velocity (0.5–3 m/s) [Pearson KG, Stein RB, Malhotra SK (1970) J Exp Biol 53:299–316], and an ecological pressure to enhance jumping performance for survival [Hawlena D, Kress H, Dufresne ER, Schmitz OJ (2011) Funct Ecol 25:279–288] further suggest that the locust operates near the limits of its surface friction, but without sufficient time to actively control its feet. Therefore, all surface adaptation must be through passive mechanics (morphological intelligence), which are unknown. Here, we report the slipping behavior, dynamic attachment, passive mechanics, and interplay between the spines and adhesive pads, studied through both biological and robotic experiments, which contribute to the locust’s ability to jump robustly from diverse surfaces. We found slipping to be surface-dependent and common (e.g., wood 1.32 ± 1.19 slips per jump), yet the morphological intelligence of the feet produces a significant chance to reengage the surface (e.g., wood 1.10 ± 1.13 reengagements per jump). Additionally, a discovered noncontact-type jump, further studied robotically, broadens the applicability of the morphological adaptations to both static and dynamic attachment.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Endosensorfusion: Particle filtering-based multi-sensory data fusion with switching state-space model for endoscopic capsule robots

Turan, M., Almalioglu, Y., Gilbert, H., Araujo, H., Cemgil, T., Sitti, M.

In 2018 IEEE International Conference on Robotics and Automation (ICRA), pages: 1-8, 2018 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Three‐dimensional patterning in biomedicine: Importance and applications in neuropharmacology

Singh, A. V., Gharat, T., Batuwangala, M., Park, B. W., Endlein, T., Sitti, M.

Journal of Biomedical Materials Research Part B: Applied Biomaterials, 106(3):1369-1382, 2018 (article)

pi

[BibTex]

[BibTex]


no image
3D nanoprinted plastic kinoform x-ray optics

Sanli, U. T., Ceylan, H., Bykova, I., Weigand, M., Sitti, M., Schütz, G., Keskinbora, K.

{Advanced Materials}, 30(36), Wiley-VCH, Weinheim, 2018 (article)

mms pi

DOI [BibTex]

DOI [BibTex]


Thumb xl stutz
Learning 3D Shape Completion under Weak Supervision

Stutz, D., Geiger, A.

International Journal of Computer Vision (IJCV), 2018, 2018 (article)

Abstract
We address the problem of 3D shape completion from sparse and noisy point clouds, a fundamental problem in computer vision and robotics. Recent approaches are either data-driven or learning-based: Data-driven approaches rely on a shape model whose parameters are optimized to fit the observations; Learning-based approaches, in contrast, avoid the expensive optimization step by learning to directly predict complete shapes from incomplete observations in a fully-supervised setting. However, full supervision is often not available in practice. In this work, we propose a weakly-supervised learning-based approach to 3D shape completion which neither requires slow optimization nor direct supervision. While we also learn a shape prior on synthetic data, we amortize, i.e., learn, maximum likelihood fitting using deep neural networks resulting in efficient shape completion without sacrificing accuracy. On synthetic benchmarks based on ShapeNet and ModelNet as well as on real robotics data from KITTI and Kinect, we demonstrate that the proposed amortized maximum likelihood approach is able to compete with a fully supervised baseline and outperforms the data-driven approach of Engelmann et al., while requiring less supervision and being significantly faster.

avg

pdf Project Page [BibTex]

pdf Project Page [BibTex]


Thumb xl benvisapp
Learning Transformation Invariant Representations with Weak Supervision

Coors, B., Condurache, A., Mertins, A., Geiger, A.

In International Conference on Computer Vision Theory and Applications, International Conference on Computer Vision Theory and Applications, 2018 (inproceedings)

Abstract
Deep convolutional neural networks are the current state-of-the-art solution to many computer vision tasks. However, their ability to handle large global and local image transformations is limited. Consequently, extensive data augmentation is often utilized to incorporate prior knowledge about desired invariances to geometric transformations such as rotations or scale changes. In this work, we combine data augmentation with an unsupervised loss which enforces similarity between the predictions of augmented copies of an input sample. Our loss acts as an effective regularizer which facilitates the learning of transformation invariant representations. We investigate the effectiveness of the proposed similarity loss on rotated MNIST and the German Traffic Sign Recognition Benchmark (GTSRB) in the context of different classification models including ladder networks. Our experiments demonstrate improvements with respect to the standard data augmentation approach for supervised and semi-supervised learning tasks, in particular in the presence of little annotated data. In addition, we analyze the performance of the proposed approach with respect to its hyperparameters, including the strength of the regularization as well as the layer where representation similarity is enforced.

avg

pdf [BibTex]

pdf [BibTex]


Thumb xl featured pic
Learning equations for extrapolation and control

Sahoo, S. S., Lampert, C. H., Martius, G.

In Proc. 35th International Conference on Machine Learning, ICML 2018, Stockholm, Sweden, 2018, 80, pages: 4442-4450, http://proceedings.mlr.press/v80/sahoo18a/sahoo18a.pdf, (Editors: Dy, Jennifer and Krause, Andreas), PMLR, 2018 (inproceedings)

Abstract
We present an approach to identify concise equations from data using a shallow neural network approach. In contrast to ordinary black-box regression, this approach allows understanding functional relations and generalizing them from observed data to unseen parts of the parameter space. We show how to extend the class of learnable equations for a recently proposed equation learning network to include divisions, and we improve the learning and model selection strategy to be useful for challenging real-world data. For systems governed by analytical expressions, our method can in many cases identify the true underlying equation and extrapolate to unseen domains. We demonstrate its effectiveness by experiments on a cart-pendulum system, where only 2 random rollouts are required to learn the forward dynamics and successfully achieve the swing-up task.

al

Code Arxiv Poster Slides link (url) Project Page [BibTex]

Code Arxiv Poster Slides link (url) Project Page [BibTex]


Thumb xl sab
Robust Affordable 3D Haptic Sensation via Learning Deformation Patterns

Sun, H., Martius, G.

Proceedings International Conference on Humanoid Robots, pages: 846-853, IEEE, New York, NY, USA, 2018 IEEE-RAS International Conference on Humanoid Robots, 2018, Oral Presentation (conference)

Abstract
Haptic sensation is an important modality for interacting with the real world. This paper proposes a general framework of inferring haptic forces on the surface of a 3D structure from internal deformations using a small number of physical sensors instead of employing dense sensor arrays. Using machine learning techniques, we optimize the sensor number and their placement and are able to obtain high-precision force inference for a robotic limb using as few as 9 sensors. For the optimal and sparse placement of the measurement units (strain gauges), we employ data-driven methods based on data obtained by finite element simulation. We compare data-driven approaches with model-based methods relying on geometric distance and information criteria such as Entropy and Mutual Information. We validate our approach on a modified limb of the “Poppy” robot [1] and obtain 8 mm localization precision.

al

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl objectflow
Object Scene Flow

Menze, M., Heipke, C., Geiger, A.

ISPRS Journal of Photogrammetry and Remote Sensing, 2018 (article)

Abstract
This work investigates the estimation of dense three-dimensional motion fields, commonly referred to as scene flow. While great progress has been made in recent years, large displacements and adverse imaging conditions as observed in natural outdoor environments are still very challenging for current approaches to reconstruction and motion estimation. In this paper, we propose a unified random field model which reasons jointly about 3D scene flow as well as the location, shape and motion of vehicles in the observed scene. We formulate the problem as the task of decomposing the scene into a small number of rigidly moving objects sharing the same motion parameters. Thus, our formulation effectively introduces long-range spatial dependencies which commonly employed local rigidity priors are lacking. Our inference algorithm then estimates the association of image segments and object hypotheses together with their three-dimensional shape and motion. We demonstrate the potential of the proposed approach by introducing a novel challenging scene flow benchmark which allows for a thorough comparison of the proposed scene flow approach with respect to various baseline models. In contrast to previous benchmarks, our evaluation is the first to provide stereo and optical flow ground truth for dynamic real-world urban scenes at large scale. Our experiments reveal that rigid motion segmentation can be utilized as an effective regularizer for the scene flow problem, improving upon existing two-frame scene flow methods. At the same time, our method yields plausible object segmentations without requiring an explicitly trained recognition model for a specific object class.

avg

Project Page [BibTex]

Project Page [BibTex]


no image
Controllable switching between planar and helical flagellar swimming of a soft robotic sperm

Khalil, I. S. M., Tabak, A. F., Seif, M. A., Klingner, A., Sitti, M.

PloS One, 13(11):e0206456, 2018 (article)

pi

[BibTex]

[BibTex]


no image
Kinetics of orbitally shaken particles constrained to two dimensions

Ipparthi, D., Hageman, T. A. G., Cambier, N., Sitti, M., Dorigo, M., Abelmann, L., Mastrangeli, M.

Physical Review E, 98(4):042137, 2018 (article)

pi

[BibTex]

[BibTex]


no image
Seed-mediated synthesis of plasmonic gold nanoribbons using cancer cells for hyperthermia applications

Singh, A. V., Alapan, Y., Jahnke, T., Laux, P., Luch, A., Aghakhani, A., Kharratian, S., Onbasli, M. C., Bill, J., Sitti, M.

Journal of Materials Chemistry B, 6(46):7573-7581, 2018 (article)

pi

[BibTex]

[BibTex]

2012


no image
Methods, apparatuses, and systems for micromanipulation with adhesive fibrillar structures

Sitti, M., Mengüç, Y.

December 2012, US Patent App. 14/368,079 (misc)

pi

[BibTex]

2012



no image
Dry adhesive structures

Sitti, M., Murphy, M., Aksak, B.

December 2012, US Patent App. 13/533,386 (misc)

pi

[BibTex]

[BibTex]


no image
Methods of making dry adhesives

Sitti, M., Murphy, M., Aksak, B.

June 2012, US Patent 8,206,631 (misc)

pi

[BibTex]

[BibTex]


no image
Dry adhesives and methods for making dry adhesives

Sitti, M., Murphy, M., Aksak, B.

March 2012, US Patent App. 13/429,621 (misc)

pi

[BibTex]

[BibTex]


no image
Automated Tip-Based 2-D Mechanical Assembly of Micro/Nanoparticles

Onal, C. D., Ozcan, O., Sitti, M.

In Feedback Control of MEMS to Atoms, pages: 69-108, Springer US, 2012 (incollection)

pi

[BibTex]

[BibTex]


no image
Topological optimization for continuum compliant mechanisms via morphological evolution of traditional mechanisms

Lum, GZ, Yeo, SH, Yang, GL, Teo, TJ, Sitti, M

In 4th International Conference on Computational Methods, pages: 8, 2012 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Two-dimensional autonomous microparticle manipulation strategies for magnetic microrobots in fluidic environments

Pawashe, C., Floyd, S., Diller, E., Sitti, M.

IEEE Transactions on Robotics, 28(2):467-477, IEEE, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Variants of guided self-organization for robot control

Martius, G., Herrmann, J.

Theory in Biosci., 131(3):129-137, Springer Berlin / Heidelberg, 2012 (article)

al

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Three-dimensional microfiber devices that mimic physiological environments to probe cell mechanics and signaling

Ruder, W. C., Pratt, E. D., Bakhru, S., Sitti, M., Zappe, S., Cheng, C., Antaki, J. F., LeDuc, P. R.

Lab on a Chip, 12(10):1775-1779, Royal Society of Chemistry, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Active visual search in unknown environments using uncertain semantics

Aydemir, Alper, Pronobis, Andrzej, Jensfelt, Patric, Sj, Kristoffer, Aydemir, Alper, Jensfelt, Patric, Aydemir, A, Jensfelt, P, Aydemir, A, Jensfelt, P, others

Transactions, 1, pages: 2329-2335, IEEE, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Modelling of conductive atomic force microscope probes for scanning tunnelling microscope operation

Ozcan, O, Sitti, M

IET Micro \& Nano Letters, 7(4):329-333, IET, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Shape memory polymer-based flexure stiffness control in a miniature flapping-wing robot

Hines, L., Arabagi, V., Sitti, M.

IEEE Transactions on Robotics, 28(4):987-990, IEEE, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Micro-manipulation using rotational fluid flows induced by remote magnetic micro-manipulators

Ye, Z., Diller, E., Sitti, M.

Journal of Applied Physics, 112(6):064912, AIP, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Remotely addressable magnetic composite micropumps

Diller, E., Miyashita, S., Sitti, M.

Rsc Advances, 2(9):3850-3856, Royal Society of Chemistry, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Flapping Wings with DC-Motors via Direct, Elastic Transmissions

Azhar, M., Campolo, D., Lau, G., Sitti, M.

In Proceedings of International Conference on Intelligent Unmanned Systems, 8, 2012 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Investigation of bioinspired gecko fibers to improve adhesion of HeartLander surgical robot

Tortora, G., Glass, P., Wood, N., Aksak, B., Menciassi, A., Sitti, M., Riviere, C.

In Engineering in Medicine and Biology Society (EMBC), 2012 Annual International Conference of the IEEE, pages: 908-911, 2012 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Magnetic hysteresis for multi-state addressable magnetic microrobotic control

Diller, E., Miyashita, S., Sitti, M.

In Intelligent Robots and Systems (IROS), 2012 IEEE/RSJ International Conference on, pages: 2325-2331, 2012 (inproceedings)

pi

[BibTex]

[BibTex]


no image
The Playful Machine - Theoretical Foundation and Practical Realization of Self-Organizing Robots

Der, R., Martius, G.

Springer, Berlin Heidelberg, 2012 (book)

Abstract
Autonomous robots may become our closest companions in the near future. While the technology for physically building such machines is already available today, a problem lies in the generation of the behavior for such complex machines. Nature proposes a solution: young children and higher animals learn to master their complex brain-body systems by playing. Can this be an option for robots? How can a machine be playful? The book provides answers by developing a general principle---homeokinesis, the dynamical symbiosis between brain, body, and environment---that is shown to drive robots to self-determined, individual development in a playful and obviously embodiment-related way: a dog-like robot starts playing with a barrier, eventually jumping or climbing over it; a snakebot develops coiling and jumping modes; humanoids develop climbing behaviors when fallen into a pit, or engage in wrestling-like scenarios when encountering an opponent. The book also develops guided self-organization, a new method that helps to make the playful machines fit for fulfilling tasks in the real world.

al

link (url) [BibTex]


no image
Shape-Programmable Soft Capsule Robots for Semi-Implantable Drug Delivery

Yim, S., Sitti, M.

Mechatronics, IEEE/ASME Transactions on, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Control of multiple heterogeneous magnetic microrobots in two dimensions on nonspecialized surfaces

Diller, E., Floyd, S., Pawashe, C., Sitti, M.

IEEE Transactions on Robotics, 28(1):172-182, IEEE, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Gecko-Inspired Controllable Adhesive Structures Applied to Micromanipulation

Mengüç, Y., Yang, S. Y., Kim, S., Rogers, J. A., Sitti, M.

Advanced Functional Materials, 22(6):1245-1245, WILEY-VCH Verlag, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Elastomer surfaces with directionally dependent adhesion strength and their use in transfer printing with continuous roll-to-roll applications

Yang, S. Y., Carlson, A., Cheng, H., Yu, Q., Ahmed, N., Wu, J., Kim, S., Sitti, M., Ferreira, P. M., Huang, Y., others,

Advanced Materials, 24(16):2117-2122, WILEY-VCH Verlag, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Effect of retraction speed on adhesion of elastomer fibrillar structures

Abusomwan, U., Sitti, M.

Applied Physics Letters, 101(21):211907, AIP, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Impact and Surface Tension in Water: a Study of Landing Bodies

Shih, B., Laham, L., Lee, K. J., Krasnoff, N., Diller, E., Sitti, M.

Bio-inspired Robotics Final Project, Carnegie Mellon University, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Design and rolling locomotion of a magnetically actuated soft capsule endoscope

Yim, S., Sitti, M.

IEEE Transactions on Robotics, 28(1):183-194, IEEE, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Design and manufacturing of a controllable miniature flapping wing robotic platform

Arabagi, V., Hines, L., Sitti, M.

The International Journal of Robotics Research, 31(6):785-800, SAGE Publications Sage UK: London, England, 2012 (article)

pi

[BibTex]

[BibTex]


no image
Chemotactic steering of bacteria propelled microbeads

Kim, D., Liu, A., Diller, E., Sitti, M.

Biomedical microdevices, 14(6):1009-1017, Springer US, 2012 (article)

pi

Project Page [BibTex]

Project Page [BibTex]

2010


no image
Gait planning based on kinematics for a quadruped gecko model with redundancy

Son, D., Jeon, D., Nam, W. C., Chang, D., Seo, T., Kim, J.

Robotics and Autonomous Systems, 58, 2010 (article)

pi

[BibTex]

2010


[BibTex]


no image
Flat dry elastomer adhesives as attachment materials for climbing robots

Unver, O., Sitti, M.

IEEE transactions on robotics, 26(1):131-141, IEEE, 2010 (article)

pi

[BibTex]

[BibTex]


no image
Adhesion recovery and passive peeling in a wall climbing robot using adhesives

Kute, C., Murphy, M. P., Mengüç, Y., Sitti, M.

In Robotics and Automation (ICRA), 2010 IEEE International Conference on, pages: 2797-2802, 2010 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Nanohandling robot cells

Fatikow, Sergej, Wich, Thomas, Dahmen, Christian, Jasper, Daniel, Stolle, Christian, Eichhorn, Volkmar, Hagemann, Saskia, Weigel-Jech, Michael

In Handbook of Nanophysics: Nanomedicine and Nanorobotics, pages: 1-31, CRC Press, 2010 (incollection)

pi

[BibTex]

[BibTex]


no image
Goal-Oriented Control of Self-Organizing Behavior in Autonomous Robots

Martius, G.

Georg-August-Universität Göttingen, 2010 (phdthesis)

al

link (url) [BibTex]


no image
\textscLpzRobots: A free and powerful robot simulator

Martius, G., Hesse, F., Güttler, F., Der, R.

\urlhttp://robot.informatik.uni-leipzig.de/software, 2010 (misc)

al

[BibTex]

[BibTex]