Header logo is


2016


Thumb xl nonlinear approximate vs exact
A New Perspective and Extension of the Gaussian Filter

Wüthrich, M., Trimpe, S., Garcia Cifuentes, C., Kappler, D., Schaal, S.

The International Journal of Robotics Research, 35(14):1731-1749, December 2016 (article)

Abstract
The Gaussian Filter (GF) is one of the most widely used filtering algorithms; instances are the Extended Kalman Filter, the Unscented Kalman Filter and the Divided Difference Filter. The GF represents the belief of the current state by a Gaussian distribution, whose mean is an affine function of the measurement. We show that this representation can be too restrictive to accurately capture the dependences in systems with nonlinear observation models, and we investigate how the GF can be generalized to alleviate this problem. To this end, we view the GF as the solution to a constrained optimization problem. From this new perspective, the GF is seen as a special case of a much broader class of filters, obtained by relaxing the constraint on the form of the approximate posterior. On this basis, we outline some conditions which potential generalizations have to satisfy in order to maintain the computational efficiency of the GF. We propose one concrete generalization which corresponds to the standard GF using a pseudo measurement instead of the actual measurement. Extending an existing GF implementation in this manner is trivial. Nevertheless, we show that this small change can have a major impact on the estimation accuracy.

am ics

PDF DOI Project Page [BibTex]

2016


PDF DOI Project Page [BibTex]


no image
Predictive and Self Triggering for Event-based State Estimation

Trimpe, S.

In Proceedings of the 55th IEEE Conference on Decision and Control (CDC), pages: 3098-3105, Las Vegas, NV, USA, December 2016 (inproceedings)

am ics

arXiv PDF DOI Project Page [BibTex]

arXiv PDF DOI Project Page [BibTex]


Thumb xl 1 00000
Bioengineered and biohybrid bacteria-based systems for drug delivery

Hosseinidoust, Z., Mostaghaci, B., Yasa, O., Park, B., Singh, A. V., Sitti, M.

Advanced Drug Delivery Reviews, 106, pages: 27-44, Elsevier, November 2016 (article)

Abstract
The use of bacterial cells as agents of medical therapy has a long history. Research that was ignited over a century ago with the accidental infection of cancer patients has matured into a platform technology that offers the promise of opening up new potential frontiers in medical treatment. Bacterial cells exhibit unique characteristics that make them well-suited as smart drug delivery agents. Our ability to genetically manipulate the molecular machinery of these cells enables the customization of their therapeutic action as well as its precise tuning and spatio-temporal control, allowing for the design of unique, complex therapeutic functions, unmatched by current drug delivery systems. Early results have been promising, but there are still many important challenges that must be addressed. We present a review of promises and challenges of employing bioengineered bacteria in drug delivery systems and introduce the biohybrid design concept as a new additional paradigm in bacteria-based drug delivery.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


no image
Using Probabilistic Movement Primitives for Striking Movements

Gomez-Gonzalez, S., Neumann, G., Schölkopf, B., Peters, J.

16th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pages: 502-508, November 2016 (conference)

am ei

link (url) DOI Project Page [BibTex]

link (url) DOI Project Page [BibTex]


Thumb xl screen shot 2019 01 07 at 11.54.16
Jointly Learning Trajectory Generation and Hitting Point Prediction in Robot Table Tennis

Huang, Y., Büchler, D., Koc, O., Schölkopf, B., Peters, J.

16th IEEE-RAS International Conference on Humanoid Robots (Humanoids), pages: 650-655, November 2016 (conference)

am ei

final link (url) DOI Project Page [BibTex]

final link (url) DOI Project Page [BibTex]


no image
The Role of Measurement Uncertainty in Optimal Control for Contact Interactions
Workshop on the Algorithmic Foundations of Robotics, pages: 22, November 2016 (conference)

Abstract
Stochastic Optimal Control (SOC) typically considers noise only in the process model, i.e. unknown disturbances. However, in many robotic applications that involve interaction with the environment, such as locomotion and manipulation, uncertainty also comes from lack of pre- cise knowledge of the world, which is not an actual disturbance. We de- velop a computationally efficient SOC algorithm, based on risk-sensitive control, that takes into account uncertainty in the measurements. We include the dynamics of an observer in such a way that the control law explicitly depends on the current measurement uncertainty. We show that high measurement uncertainty leads to low impedance behaviors, a result in contrast with the effects of process noise variance that creates stiff behaviors. Simulation results on a simple 2D manipulator show that our controller can create better interaction with the environment under uncertain contact locations than traditional SOC approaches.

am

arXiv [BibTex]

arXiv [BibTex]


Thumb xl 07759726
Steering control of a water-running robot using an active tail

Kim, H., Jeong, K., Sitti, M., Seo, T.

In Intelligent Robots and Systems (IROS), 2016 IEEE/RSJ International Conference on, pages: 4945-4950, October 2016 (inproceedings)

Abstract
Many highly dynamic novel mobile robots have been developed being inspired by animals. In this study, we are inspired by a basilisk lizard's ability to run and steer on water surface for a hexapedal robot. The robot has an active tail with a circular plate, which the robot rotates to steer on water. We dynamically modeled the platform and conducted simulations and experiments on steering locomotion with a bang-bang controller. The robot can steer on water by rotating the tail, and the controlled steering locomotion is stable. The dynamic modelling approximates the robot's steering locomotion and the trends of the simulations and experiments are similar, although there are errors between the desired and actual angles. The robot's maneuverability on water can be improved through further research.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl 07293677
A 5-D localization method for a magnetically manipulated untethered robot using a 2-D array of Hall-effect sensors

Son, D., Yim, S., Sitti, M.

IEEE/ASME Transactions on Mechatronics, 21(2):708-716, IEEE, October 2016 (article)

Abstract
This paper introduces a new five-dimensional localization method for an untethered meso-scale magnetic robot, which is manipulated by a computer-controlled electromagnetic system. The developed magnetic localization setup is a two-dimensional array of mono-axial Hall-effect sensors, which measure the perpendicular magnetic fields at their given positions. We introduce two steps for localizing a magnetic robot more accurately. First, the dipole modeled magnetic field of the electromagnet is subtracted from the measured data in order to determine the robot's magnetic field. Secondly, the subtracted magnetic field is twice differentiated in the perpendicular direction of the array, so that the effect of the electromagnetic field in the localization process is minimized. Five variables regarding the position and orientation of the robot are determined by minimizing the error between the measured magnetic field and the modeled magnetic field in an optimization method. The resulting position error is 2.1±0.8 mm and angular error is 6.7±4.3° within the applicable range (5 cm) of magnetic field sensors at 200 Hz. The proposed localization method would be used for the position feedback control of untethered magnetic devices or robots for medical applications in the future.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl nn 2016 05545f 0007
High-Performance Multiresponsive Paper Actuators

Amjadi, M., Sitti, M.

ACS Nano, 10(11):10202-10210, American Chemical Society, October 2016 (article)

Abstract
There is an increasing demand for soft actuators because of their importance in soft robotics, artificial muscles, biomimetic devices, and beyond. However, the development of soft actuators capable of low-voltage operation, powerful actuation, and programmable shape-changing is still challenging. In this work, we propose programmable bilayer actuators that operate based on the large hygroscopic contraction of the copy paper and simultaneously large thermal expansion of the polypropylene film upon increasing the temperature. The electrothermally activated bending actuators can function with low voltages (≤ 8 V), low input electric power per area (P ≤ 0.14 W cm–2), and low temperature changes (≤ 35 °C). They exhibit reversible shape-changing behavior with curvature radii up to 1.07 cm–1 and bending angle of 360°, accompanied by powerful actuation. Besides the electrical activation, they can be powered by humidity or light irradiation. We finally demonstrate the use of our paper actuators as a soft gripper robot and a lightweight paper wing for aerial robotics.

pi

DOI Project Page Project Page [BibTex]

DOI Project Page Project Page [BibTex]


Thumb xl publications toc
Programmable assembly of heterogeneous microparts by an untethered mobile capillary microgripper

Giltinan, J., Diller, E., Sitti, M.

Lab on a Chip, 16(22):4445-4457, Royal Society of Chemistry, October 2016 (article)

Abstract
At the sub-millimeter scale, capillary forces enable robust and reversible adhesion between biological organisms and varied substrates. Current human-engineered mobile untethered micromanipulation systems rely on forces which scale poorly or utilize gripper-part designs that promote manipulation. Capillary forces, alternatively, are dependent upon the surface chemistry (which is scale independent) and contact perimeter, which conforms to the part surface. We report a mobile capillary microgripper that is able to pick and place parts of various materials and geometries, and is thus ideal for microassembly tasks that cannot be accomplished by large tethered manipulators. We achieve the programmable assembly of sub-millimeter parts in an enclosed three-dimensional aqueous environment by creating a capillary bridge between the targeted part and a synthetic, untethered, mobile body. The parts include both hydrophilic and hydrophobic components: hydrogel, kapton, human hair, and biological tissue. The 200 μm untethered system can be controlled with five-degrees-of-freedom and advances progress towards autonomous desktop manufacturing for tissue engineering, complex micromachines, microfluidic devices, and meta-materials.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl img
Learning Where to Search Using Visual Attention

Kloss, A., Kappler, D., Lensch, H. P. A., Butz, M. V., Schaal, S., Bohg, J.

Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems, IEEE, IROS, October 2016 (conference)

Abstract
One of the central tasks for a household robot is searching for specific objects. It does not only require localizing the target object but also identifying promising search locations in the scene if the target is not immediately visible. As computation time and hardware resources are usually limited in robotics, it is desirable to avoid expensive visual processing steps that are exhaustively applied over the entire image. The human visual system can quickly select those image locations that have to be processed in detail for a given task. This allows us to cope with huge amounts of information and to efficiently deploy the limited capacities of our visual system. In this paper, we therefore propose to use human fixation data to train a top-down saliency model that predicts relevant image locations when searching for specific objects. We show that the learned model can successfully prune bounding box proposals without rejecting the ground truth object locations. In this aspect, the proposed model outperforms a model that is trained only on the ground truth segmentations of the target object instead of fixation data.

am

Project Page [BibTex]

PDF Project Page [BibTex]


Thumb xl oxfordlight
Parameter Learning for Improving Binary Descriptor Matching

Sankaran, B., Ramalingam, S., Taguchi, Y.

In International Conference on Intelligent Robots and Systems (IROS) 2016, IEEE/RSJ International Conference on Intelligent Robots and Systems, October 2016 (inproceedings)

Abstract
Binary descriptors allow fast detection and matching algorithms in computer vision problems. Though binary descriptors can be computed at almost two orders of magnitude faster than traditional gradient based descriptors, they suffer from poor matching accuracy in challenging conditions. In this paper we propose three improvements for binary descriptors in their computation and matching that enhance their performance in comparison to traditional binary and non-binary descriptors without compromising their speed. This is achieved by learning some weights and threshold parameters that allow customized matching under some variations such as lighting and viewpoint. Our suggested improvements can be easily applied to any binary descriptor. We demonstrate our approach on the ORB (Oriented FAST and Rotated BRIEF) descriptor and compare its performance with the traditional ORB and SIFT descriptors on a wide variety of datasets. In all instances, our enhancements outperform standard ORB and is comparable to SIFT.

am

[BibTex]

[BibTex]


no image
A New Trajectory Generation Framework in Robotic Table Tennis

Koc, O., Maeda, G., Peters, J.

Proceedings of the IEEE/RSJ Conference on Intelligent Robots and Systems (IROS), pages: 3750-3756, October 2016 (conference)

am ei

link (url) DOI [BibTex]

link (url) DOI [BibTex]


Thumb xl gadde
Superpixel Convolutional Networks using Bilateral Inceptions

Gadde, R., Jampani, V., Kiefel, M., Kappler, D., Gehler, P.

In European Conference on Computer Vision (ECCV), Lecture Notes in Computer Science, Springer, 14th European Conference on Computer Vision, October 2016 (inproceedings)

Abstract
In this paper we propose a CNN architecture for semantic image segmentation. We introduce a new “bilateral inception” module that can be inserted in existing CNN architectures and performs bilateral filtering, at multiple feature-scales, between superpixels in an image. The feature spaces for bilateral filtering and other parameters of the module are learned end-to-end using standard backpropagation techniques. The bilateral inception module addresses two issues that arise with general CNN segmentation architectures. First, this module propagates information between (super) pixels while respecting image edges, thus using the structured information of the problem for improved results. Second, the layer recovers a full resolution segmentation result from the lower resolution solution of a CNN. In the experiments, we modify several existing CNN architectures by inserting our inception modules between the last CNN (1 × 1 convolution) layers. Empirical results on three different datasets show reliable improvements not only in comparison to the baseline networks, but also in comparison to several dense-pixel prediction techniques such as CRFs, while being competitive in time.

am ps

pdf supplementary poster Project Page Project Page [BibTex]

pdf supplementary poster Project Page Project Page [BibTex]


Thumb xl thumb
Barrista - Caffe Well-Served

Lassner, C., Kappler, D., Kiefel, M., Gehler, P.

In ACM Multimedia Open Source Software Competition, ACM OSSC16, October 2016 (inproceedings)

Abstract
The caffe framework is one of the leading deep learning toolboxes in the machine learning and computer vision community. While it offers efficiency and configurability, it falls short of a full interface to Python. With increasingly involved procedures for training deep networks and reaching depths of hundreds of layers, creating configuration files and keeping them consistent becomes an error prone process. We introduce the barrista framework, offering full, pythonic control over caffe. It separates responsibilities and offers code to solve frequently occurring tasks for pre-processing, training and model inspection. It is compatible to all caffe versions since mid 2015 and can import and export .prototxt files. Examples are included, e.g., a deep residual network implemented in only 172 lines (for arbitrary depths), comparing to 2320 lines in the official implementation for the equivalent model.

am ps

pdf link (url) DOI Project Page [BibTex]

pdf link (url) DOI Project Page [BibTex]


Thumb xl 5fc6a94719a2ed61820a6fd031f53c39682a1f157b1c10c35d5d4c88d087d90e
Composition-dependent underwater adhesion of catechol-bearing hydrogels

Wu, H., Sariola, V., Zhao, J., Ding, H., Sitti, M., Bettinger, C. J.

Polymer International, 65(11):1355-1359, John Wiley & Sons, Ltd, September 2016 (article)

Abstract
Interfacial adhesion-mediated transfer printing processes can integrate functional electronic microstructures with polymeric substrates that are bendable and stretchable. Transfer printing has also been extended to catechol-bearing adhesive hydrogels. This study presents indentation adhesion tests between catechol-bearing hydrogel substrates with catechol concentrations varying from 0 to 10% (mol/mol) and thin-film materials commonly used in microelectronic fabrication including polymers, noble metals and oxides. The results indicate that the interfacial adhesion of catechol-bearing hydrogels is positively correlated with the concentration of catechol-bearing monomers as well as the retraction velocity during transfer printing. This study can inform transfer printing processes for microfabricated structures to compliant hydrated substrates such as hygroscopic monomers, mesoporous polymer networks and hydrogels. © 2016 Society of Chemical Industry

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl singh et al 2016 advanced healthcare materials
Bacteria-Driven Particles: Patterned and Specific Attachment of Bacteria on Biohybrid Bacteria-Driven Microswimmers (Adv. Healthcare Mater. 18/2016)

Singh, A. V., Sitti, M.

Advanced Healthcare Materials, 5(18):2306-2306, September 2016 (article)

Abstract
On page 2325, Ajay Vikram Singh and Metin Sitti propose a facile surface patterning technique and a specific, strong biotin–streptavidin bonding of bacteria on patterned surfaces to fabricate Janus particles that are propelled by the attached bacteria. Such bacteria-driven Janus microswimmers could be used for future medicine in targeted drug delivery and environmental remediation.

pi

DOI Project Page [BibTex]


Thumb xl publications toc
The effect of temperature and humidity on adhesion of a gecko-inspired adhesive: implications for the natural system

Stark, A. Y., Klittich, M. R., Sitti, M., Niewiarowski, P. H., Dhinojwala, A.

Scientific Reports, 6, pages: 30936, Nature Publishing Group, August 2016 (article)

Abstract
The adhesive system of geckos has inspired hundreds of synthetic adhesives. While this system has been used relentlessly as a source of inspiration, less work has been done in reverse, where synthetics are used to test questions and hypotheses about the natural system. Here we take such an approach. We tested shear adhesion of a mushroom-tipped synthetic gecko adhesive under conditions that produced perplexing results in the natural adhesive system. Synthetic samples were tested at two temperatures (12 °C and 32 °C) and four different humidity levels (30%, 55%, 70%, and 80% RH). Surprisingly, adhesive performance of the synthetic samples matched that of living geckos, suggesting that uncontrolled parameters in the natural system, such as surface chemistry and material changes, may not be as influential in whole-animal performance as previously thought. There was one difference, however, when comparing natural and synthetic adhesive performance. At 12 °C and 80% RH, adhesion of the synthetic structures was lower than expected based on the natural system’s performance. Our approach highlights a unique opportunity for both biologists and material scientists, where new questions and hypotheses can be fueled by joint comparisons of the natural and synthetic systems, ultimately improving knowledge of both.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl 07523675
Targeting of cell mockups using sperm-shaped microrobots in vitro

Khalil, I. S., Tabak, A. F., Hosney, A., Klingner, A., Shalaby, M., Abdel-Kader, R. M., Serry, M., Sitti, M.

In Biomedical Robotics and Biomechatronics (BioRob), 2016 6th IEEE International Conference on, pages: 495-501, July 2016 (inproceedings)

Abstract
Sperm-shaped microrobots are controlled under the influence of weak oscillating magnetic fields (milliTesla range) to selectively target cell mockups (i.e., gas bubbles with average diameter of 200 μm). The sperm-shaped microrobots are fabricated by electrospinning using a solution of polystyrene, dimethylformamide, and iron oxide nanoparticles. These nanoparticles are concentrated within the head of the microrobot, and hence enable directional control along external magnetic fields. The magnetic dipole moment of the microrobot is characterized (using the flip-time technique) to be 1.4×10-11 A.m2, at magnetic field of 28 mT. In addition, the morphology of the microrobot is characterized using Scanning Electron Microscopy images. The characterized parameters and morphology are used in the simulation of the locomotion mechanism of the microrobot to prove that its motion depends on breaking the time-reversal symmetry, rather than pulling with the magnetic field gradient. We experimentally demonstrate that the microrobot can controllably follow S-shaped, U-shaped, and square paths, and selectively target the cell mockups using image guidance and under the influence of the oscillating magnetic fields.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl image toc
Analysis of the magnetic torque on a tilted permanent magnet for drug delivery in capsule robots

Munoz, F., Alici, G., Zhou, H., Li, W., Sitti, M.

In Advanced Intelligent Mechatronics (AIM), 2016 IEEE International Conference on, pages: 1386-1391, July 2016 (inproceedings)

Abstract
In this paper, we present the analysis of the torque transmitted to a tilted permanent magnet that is to be embedded in a capsule robot to achieve targeted drug delivery. This analysis is carried out by using an analytical model and experimental results for a small cubic permanent magnet that is driven by an external magnetic system made of an array of arc-shaped permanent magnets (ASMs). Our experimental results, which are in agreement with the analytical results, show that the cubic permanent magnet can safely be actuated for inclinations lower than 75° without having to make positional adjustments in the external magnetic system. We have found that with further inclinations, the cubic permanent magnet to be embedded in a drug delivery mechanism may stall. When it stalls, the external magnetic system's position and orientation would have to be adjusted to actuate the cubic permanent magnet and the drug release mechanism. This analysis of the transmitted torque is helpful for the development of real-time control strategies for magnetically articulated devices.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl imagetoc
Magnetic propulsion of robotic sperms at low-Reynolds number

Khalil, I. S., Fatih Tabak, A., Klingner, A., Sitti, M.

Applied Physics Letters, 109(3):033701, AIP Publishing, July 2016 (article)

Abstract
We investigate the microswimming behaviour of robotic sperms in viscous fluids. These robotic sperms are fabricated from polystyrene dissolved in dimethyl formamide and iron-oxide nanoparticles. This composition allows the nanoparticles to be concentrated within the bead of the robotic sperm and provide magnetic dipole, whereas the flexibility of the ultra-thin tail enables flagellated locomotion using magnetic fields in millitesla range. We show that these robotic sperms have similar morphology and swimming behaviour to those of sperm cells. Moreover, we show experimentally that our robotic sperms swim controllably at an average speed of approximately one body length per second (around 125 μm s−1), and they are relatively faster than the microswimmers that depend on planar wave propulsion in low-Reynolds number fluids.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl screen shot 2015 12 04 at 15.11.43
Robust Gaussian Filtering using a Pseudo Measurement

Wüthrich, M., Garcia Cifuentes, C., Trimpe, S., Meier, F., Bohg, J., Issac, J., Schaal, S.

In Proceedings of the American Control Conference (ACC), Boston, MA, USA, July 2016 (inproceedings)

Abstract
Most widely-used state estimation algorithms, such as the Extended Kalman Filter and the Unscented Kalman Filter, belong to the family of Gaussian Filters (GF). Unfortunately, GFs fail if the measurement process is modelled by a fat-tailed distribution. This is a severe limitation, because thin-tailed measurement models, such as the analytically-convenient and therefore widely-used Gaussian distribution, are sensitive to outliers. In this paper, we show that mapping the measurements into a specific feature space enables any existing GF algorithm to work with fat-tailed measurement models. We find a feature function which is optimal under certain conditions. Simulation results show that the proposed method allows for robust filtering in both linear and nonlinear systems with measurements contaminated by fat-tailed noise.

am ics

Web link (url) DOI Project Page [BibTex]

Web link (url) DOI Project Page [BibTex]


Thumb xl 0278364915583539
Six-degree-of-freedom magnetic actuation for wireless microrobotics

Diller, E., Giltinan, J., Lum, G. Z., Ye, Z., Sitti, M.

The International Journal of Robotics Research, 35(1-3):114-128, SAGE Publications Sage UK: London, England, June 2016 (article)

Abstract
Existing remotely actuated magnetic microrobots exhibit a maximum of only five-degree-of-freedom (DOF) actuation, as creation of a driving torque about the microrobot magnetization axis is not achievable. This lack of full orientation control limits the effectiveness of existing microrobots for precision tasks of object manipulation and orientation for advanced medical, biological and micromanufacturing applications. This paper presents a magnetic actuation method that allows remotely powered microrobots to achieve full six-DOF actuation by considering the case of a non-uniform magnetization profile within the microrobot body. This non-uniform magnetization allows for additional rigid-body torques to be induced from magnetic forces via a moment arm. A general analytical model presents the working principle for continuous and discrete magnetization profiles, which is applied to permanent or non-permanent (soft) magnet bodies. Several discrete-magnetization designs are also presented which possess reduced coupling between magnetic forces and induced rigid-body torques. Design guidelines are introduced which can be followed to ensure that a magnetic microrobot design is capable of six-DOF actuation. A simple permanent-magnet prototype is fabricated and used to quantitatively demonstrate the accuracy of the analytical model in a constrained-DOF environment and qualitatively for free motion in a viscous liquid three-dimensional environment. Results show that desired forces and torques can be created with high precision and limited parasitic actuation, allowing for full six-DOF actuation using limited feedback control

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image patent
System and method to magnetically actuate a capsule endoscopic robot for diagnosis and treatment

Sitti, M., Yim, S.

May 2016, US Patent 9,445,711 (patent)

Abstract
Present invention describes a swallowable device with a soft, compliant exterior, whose shape can be changed through the use of magnetic fields, and which can be locomoted in a rolling motion through magnetic control from the exterior of the patient. The present invention could be used for a variety of medical applications inside the GI tract including but not limited to drug delivery, biopsy, heat cauterization, pH sensing, biochemical sensing, micro-surgery, and active imaging.

pi

link (url) [BibTex]


Thumb xl ye et al 2016 advanced materials
Gallium Adhesion: Phase Change of Gallium Enables Highly Reversible and Switchable Adhesion (Adv. Mater. 25/2016)

Ye, Z., Lum, G. Z., Song, S., Rich, S., Sitti, M.

Advanced Materials, 28(25):5087-5087, May 2016 (article)

Abstract
Gallium exhibits highly reversible and switchable adhesion when it undergoes a solid–liquid phase transition. The robustness of gallium is notable as it exhibits strong performance on a wide range of smooth and rough surfaces, under both dry and wet conditions. Gallium may therefore find numerous applications in transfer printing, robotics, electronic packaging, and biomedicine.

pi

DOI [BibTex]


Thumb xl singh et al 2016 advanced healthcare materials
Patterned and Specific Attachment of Bacteria on Biohybrid Bacteria-Driven Microswimmers

Singh, A. V., Sitti, M.

Advanced Healthcare Materials, 5(18):2325-2331, May 2016 (article)

Abstract
A surface patterning technique and a specific and strong biotin–streptavidin bonding of bacteria on patterned surfaces are proposed to fabricate Janus particles that are propelled by the attached bacteria. Bacteria-driven Janus microswimmers with diameters larger than 3 μm show enhanced mean propulsion speed. Such microswimmers could be used for future applications such as targeted drug delivery and environmental remediation.

pi

DOI [BibTex]


Thumb xl pnas 2016 lum 1608193113 2
Shape-programmable magnetic soft matter

Lum, G. Z., Ye, Z., Dong, X., Marvi, H., Erin, O., Hu, W., Sitti, M.

Proceedings of the National Academy of Sciences, 113(41):E6007–E6015, National Acad Sciences, May 2016 (article)

Abstract
Shape-programmable matter is a class of active materials whose geometry can be controlled to potentially achieve mechanical functionalities beyond those of traditional machines. Among these materials, magnetically actuated matter is particularly promising for achieving complex time-varying shapes at small scale (overall dimensions smaller than 1 cm). However, previous work can only program these materials for limited applications, as they rely solely on human intuition to approximate the required magnetization profile and actuating magnetic fields for their materials. Here, we propose a universal programming methodology that can automatically generate the required magnetization profile and actuating fields for soft matter to achieve new time-varying shapes. The universality of the proposed method can therefore inspire a vast number of miniature soft devices that are critical in robotics, smart engineering surfaces and materials, and biomedical devices. Our proposed method includes theoretical formulations, computational strategies, and fabrication procedures for programming magnetic soft matter. The presented theory and computational method are universal for programming 2D or 3D time-varying shapes, whereas the fabrication technique is generic only for creating planar beams. Based on the proposed programming method, we created a jellyfish-like robot, a spermatozoid-like undulating swimmer, and an artificial cilium that could mimic the complex beating patterns of its biological counterpart.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl pic for website small
Robot Arm Pose Estimation by Pixel-wise Regression of Joint Angles

Widmaier, F., Kappler, D., Schaal, S., Bohg, J.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2016, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
To achieve accurate vision-based control with a robotic arm, a good hand-eye coordination is required. However, knowing the current configuration of the arm can be very difficult due to noisy readings from joint encoders or an inaccurate hand-eye calibration. We propose an approach for robot arm pose estimation that uses depth images of the arm as input to directly estimate angular joint positions. This is a frame-by-frame method which does not rely on good initialisation of the solution from the previous frames or knowledge from the joint encoders. For estimation, we employ a random regression forest which is trained on synthetically generated data. We compare different training objectives of the forest and also analyse the influence of prior segmentation of the arms on accuracy. We show that this approach improves previous work both in terms of computational complexity and accuracy. Despite being trained on synthetic data only, we demonstrate that the estimation also works on real depth images.

am

pdf DOI Project Page [BibTex]

pdf DOI Project Page [BibTex]


Thumb xl ranking top 1
Optimizing for what matters: the Top Grasp Hypothesis

Kappler, D., Schaal, S., Bohg, J.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2016, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
In this paper, we consider the problem of robotic grasping of objects when only partial and noisy sensor data of the environment is available. We are specifically interested in the problem of reliably selecting the best hypothesis from a whole set. This is commonly the case when trying to grasp an object for which we can only observe a partial point cloud from one viewpoint through noisy sensors. There will be many possible ways to successfully grasp this object, and even more which will fail. We propose a supervised learning method that is trained with a ranking loss. This explicitly encourages that the top-ranked training grasp in a hypothesis set is also positively labeled. We show how we adapt the standard ranking loss to work with data that has binary labels and explain the benefits of this formulation. Additionally, we show how we can efficiently optimize this loss with stochastic gradient descent. In quantitative experiments, we show that we can outperform previous models by a large margin.

am

pdf DOI Project Page [BibTex]

pdf DOI Project Page [BibTex]


Thumb xl retrieved templates 3
Exemplar-based Prediction of Object Properties from Local Shape Similarity

Bohg, J., Kappler, D., Schaal, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2016, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
We propose a novel method that enables a robot to identify a graspable object part of an unknown object given only noisy and partial information that is obtained from an RGB-D camera. Our method combines the benefits of local with the advantages of global methods. It learns a classifier that takes a local shape representation as input and outputs the probability that a grasp applied at this location will be successful. Given a query data point that is classified in this way, we can retrieve all the locally similar training data points and use them to predict latent global object shape. This information may help to further prune positively labeled grasp hypotheses based on, e.g. relation to the predicted average global shape or suitability for a specific task. This prediction can also guide scene exploration to prune object shape hypotheses. To learn the function that maps local shape to grasp stability we use a Random Forest Classifier. We show that our method reaches the same classification performance as the current state-of-the-art on this dataset which uses a Convolutional Neural Network. Additionally, we exploit the natural ability of the Random Forest to cluster similar data. For a positively predicted query data point, we retrieve all the locally similar training data points that are associated with the same leaf nodes of the Random Forest. The main insight from this work is that local object shape that affords a grasp is also a good predictor of global object shape. We empirically support this claim with quantitative experiments. Additionally, we demonstrate the predictive capability of the method on some real data examples.

am

pdf DOI Project Page [BibTex]

pdf DOI Project Page [BibTex]


Thumb xl screen shot 2016 01 19 at 14.48.37
Automatic LQR Tuning Based on Gaussian Process Global Optimization

Marco, A., Hennig, P., Bohg, J., Schaal, S., Trimpe, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pages: 270-277, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
This paper proposes an automatic controller tuning framework based on linear optimal control combined with Bayesian optimization. With this framework, an initial set of controller gains is automatically improved according to a pre-defined performance objective evaluated from experimental data. The underlying Bayesian optimization algorithm is Entropy Search, which represents the latent objective as a Gaussian process and constructs an explicit belief over the location of the objective minimum. This is used to maximize the information gain from each experimental evaluation. Thus, this framework shall yield improved controllers with fewer evaluations compared to alternative approaches. A seven-degree- of-freedom robot arm balancing an inverted pole is used as the experimental demonstrator. Results of a two- and four- dimensional tuning problems highlight the method’s potential for automatic controller tuning on robotic platforms.

am ics pn

Video PDF DOI Project Page [BibTex]

Video PDF DOI Project Page [BibTex]


Thumb xl screen shot 2016 01 19 at 14.56.20
Depth-based Object Tracking Using a Robust Gaussian Filter

Issac, J., Wüthrich, M., Garcia Cifuentes, C., Bohg, J., Trimpe, S., Schaal, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2016, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

Abstract
We consider the problem of model-based 3D- tracking of objects given dense depth images as input. Two difficulties preclude the application of a standard Gaussian filter to this problem. First of all, depth sensors are characterized by fat-tailed measurement noise. To address this issue, we show how a recently published robustification method for Gaussian filters can be applied to the problem at hand. Thereby, we avoid using heuristic outlier detection methods that simply reject measurements if they do not match the model. Secondly, the computational cost of the standard Gaussian filter is prohibitive due to the high-dimensional measurement, i.e. the depth image. To address this problem, we propose an approximation to reduce the computational complexity of the filter. In quantitative experiments on real data we show how our method clearly outperforms the standard Gaussian filter. Furthermore, we compare its performance to a particle-filter-based tracking method, and observe comparable computational efficiency and improved accuracy and smoothness of the estimates.

am ics

Video Bayesian Object Tracking Library Bayesian Filtering Framework Object Tracking Dataset link (url) DOI Project Page [BibTex]

Video Bayesian Object Tracking Library Bayesian Filtering Framework Object Tracking Dataset link (url) DOI Project Page [BibTex]


Thumb xl 07487340
Sperm-shaped magnetic microrobots: Fabrication using electrospinning, modeling, and characterization

Khalil, I. S., Tabak, A. F., Hosney, A., Mohamed, A., Klingner, A., Ghoneima, M., Sitti, M.

In Robotics and Automation (ICRA), 2016 IEEE International Conference on, pages: 1939-1944, May 2016 (inproceedings)

Abstract
We use electrospinning to fabricate sperm-shaped magnetic microrobots with a range of diameters from 50 μm to 500 μm. The variables of the electrospinning operation (voltage, concentration of the solution, dynamic viscosity, and distance between the syringe needle and collector) to achieve beading effect are determined. This beading effect allows us to fabricate microrobots with similar morphology to that of sperm cells. The bead and the ultra-fine fiber resemble the morphology of the head and tail of the sperm cell, respectively. We incorporate iron oxide nanoparticles to the head of the sperm-shaped microrobot to provide a magnetic dipole moment. This dipole enables directional control under the influence of external magnetic fields. We also apply weak (less than 2 mT) oscillating magnetic fields to exert a magnetic torque on the magnetic head, and generate planar flagellar waves and flagellated swim. The average speed of the sperm-shaped microrobot is calculated to be 0.5 body lengths per second and 1 body lengths per second at frequencies of 5 Hz and 10 Hz, respectively. We also develop a model of the microrobot using elastohydrodynamics approach and Timoshenko-Rayleigh beam theory, and find good agreement with the experimental results.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl screen shot 2016 06 27 at 09.38.59
Implications of Action-Oriented Paradigm Shifts in Cognitive Science

Dominey, P. F., Prescott, T. J., Bohg, J., Engel, A. K., Gallagher, S., Heed, T., Hoffmann, M., Knoblich, G., Prinz, W., Schwartz, A.

In The Pragmatic Turn - Toward Action-Oriented Views in Cognitive Science, 18, pages: 333-356, 20, Strüngmann Forum Reports, vol. 18, J. Lupp, series editor, (Editors: Andreas K. Engel and Karl J. Friston and Danica Kragic), The MIT Press, 18th Ernst Strüngmann Forum, May 2016 (incollection) In press

Abstract
An action-oriented perspective changes the role of an individual from a passive observer to an actively engaged agent interacting in a closed loop with the world as well as with others. Cognition exists to serve action within a landscape that contains both. This chapter surveys this landscape and addresses the status of the pragmatic turn. Its potential influence on science and the study of cognition are considered (including perception, social cognition, social interaction, sensorimotor entrainment, and language acquisition) and its impact on how neuroscience is studied is also investigated (with the notion that brains do not passively build models, but instead support the guidance of action). A review of its implications in robotics and engineering includes a discussion of the application of enactive control principles to couple action and perception in robotics as well as the conceptualization of system design in a more holistic, less modular manner. Practical applications that can impact the human condition are reviewed (e.g. educational applications, treatment possibilities for developmental and psychopathological disorders, the development of neural prostheses). All of this foreshadows the potential societal implications of the pragmatic turn. The chapter concludes that an action-oriented approach emphasizes a continuum of interaction between technical aspects of cognitive systems and robotics, biology, psychology, the social sciences, and the humanities, where the individual is part of a grounded cultural system.

am

The Pragmatic Turn - Toward Action-Oriented Views in Cognitive Science 18th Ernst Strüngmann Forum Bibliography Chapter link (url) [BibTex]

The Pragmatic Turn - Toward Action-Oriented Views in Cognitive Science 18th Ernst Strüngmann Forum Bibliography Chapter link (url) [BibTex]


no image
Communication Rate Analysis for Event-based State Estimation

(Best student paper finalist)

Ebner, S., Trimpe, S.

In Proceedings of the 13th International Workshop on Discrete Event Systems, May 2016 (inproceedings)

am ics

PDF DOI [BibTex]

PDF DOI [BibTex]


Thumb xl 2pamcompressed
A Lightweight Robotic Arm with Pneumatic Muscles for Robot Learning

Büchler, D., Ott, H., Peters, J.

Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), pages: 4086-4092, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (conference)

am ei

ICRA16final DOI Project Page [BibTex]

ICRA16final DOI Project Page [BibTex]


no image
Drifting Gaussian Processes with Varying Neighborhood Sizes for Online Model Learning

Meier, F., Schaal, S.

In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA) 2016, IEEE, IEEE International Conference on Robotics and Automation, May 2016 (inproceedings)

am

[BibTex]

[BibTex]


Thumb xl looplearning
Learning Action-Perception Cycles in Robotics: A Question of Representations and Embodiment

Bohg, J., Kragic, D.

In The Pragmatic Turn - Toward Action-Oriented Views in Cognitive Science, 18, pages: 309-320, 18, Strüngmann Forum Reports, vol. 18, J. Lupp, series editor, (Editors: Andreas K. Engel and Karl J. Friston and Danica Kragic), The MIT Press, 18th Ernst Strüngmann Forum, May 2016 (incollection) In press

Abstract
Since the 1950s, robotics research has sought to build a general-purpose agent capable of autonomous, open-ended interaction with realistic, unconstrained environments. Cognition is perceived to be at the core of this process, yet understanding has been challenged because cognition is referred to differently within and across research areas, and is not clearly defined. The classic robotics approach is decomposition into functional modules which perform planning, reasoning, and problem-solving or provide input to these mechanisms. Although advancements have been made and numerous success stories reported in specific niches, this systems-engineering approach has not succeeded in building such a cognitive agent. The emergence of an action-oriented paradigm offers a new approach: action and perception are no longer separable into functional modules but must be considered in a complete loop. This chapter reviews work on different mechanisms for action- perception learning and discusses the role of embodiment in the design of the underlying representations and learning. It discusses the evaluation of agents and suggests the development of a new embodied Turing Test. Appropriate scenarios need to be devised in addition to current competitions, so that abilities can be tested over long time periods.

am

18th Ernst Strüngmann Forum The Pragmatic Turn- Toward Action-Oriented Views in Cognitive Science Bibliography Chapter link (url) [BibTex]

18th Ernst Strüngmann Forum The Pragmatic Turn- Toward Action-Oriented Views in Cognitive Science Bibliography Chapter link (url) [BibTex]


no image
Distinct adaptation to abrupt and gradual torque perturbations with a multi-joint exoskeleton robot

Oh, Y., Sutanto, G., Mistry, M., Schweighofer, N., Schaal, S.

Abstracts of Neural Control of Movement Conference (NCM 2016), Montego Bay, Jamaica, April 2016 (poster)

am

[BibTex]

[BibTex]


Thumb xl inflateble robots
Inflated soft actuators with reversible stable deformations

Hines, L., Petersen, K., Sitti, M.

Advanced Materials, 28(19):3690-3696, March 2016 (article)

Abstract
Most soft robotic systems are currently dependent on bulky compressors or pumps. A soft actuation method is presented combining hyperelastic membranes and dielectric elastomer actuators to switch between stable deformations of sealed chambers. This method is capable of large repeatable deformations, and has a number of stable states proportional to the number of actuatable membranes in the chamber.

pi

DOI Project Page [BibTex]


Thumb xl publications toc
Chemotaxis of bio-hybrid multiple bacteria-driven microswimmers

Zhuang, J., Sitti, M.

Scientific reports, 6, pages: 32135, Nature Publishing Group, March 2016 (article)

Abstract
In this study, in a bio-hybrid microswimmer system driven by multiple Serratia marcescens bacteria, we quantify the chemotactic drift of a large number of microswimmers towards L-serine and elucidate the associated collective chemotaxis behavior by statistical analysis of over a thousand swimming trajectories of the microswimmers. The results show that the microswimmers have a strong heading preference for moving up the L-serine gradient, while their speed does not change considerably when moving up and down the gradient; therefore, the heading bias constitutes the major factor that produces the chemotactic drift. The heading direction of a microswimmer is found to be significantly more persistent when it moves up the L-serine gradient than when it travels down the gradient; this effect causes the apparent heading preference of the microswimmers and is the crucial reason that enables the seemingly cooperative chemotaxis of multiple bacteria on a microswimmer. In addition, we find that their chemotactic drift velocity increases superquadratically with their mean swimming speed, suggesting that chemotaxis of bio-hybrid microsystems can be enhanced by designing and building faster microswimmers. Such bio-hybrid microswimmers with chemotactic steering capability may find future applications in targeted drug delivery, bioengineering, and lab-on-a-chip devices.

pi

DOI Project Page [BibTex]

DOI Project Page [BibTex]


Thumb xl publications toc
Targeted drug delivery and imaging using mobile milli/microrobots: A promising future towards theranostic pharmaceutical design

Vikram Singh, A., Sitti, M.

Current Pharmaceutical Design, 22(11):1418-1428, Bentham Science Publishers, March 2016 (article)

Abstract
Miniature untethered medical robots have been receiving growing attention due to technological advances in microactuation, microsensors, and microfabrication and have significant potential to reduce the invasiveness and improve the accessibility of medical devices into unprecedented small spaces inside the human body. In this review, we discuss therapeutic and diagnostic applications of untethered medical microrobots. Wirelessly controlled milli/microrobots with integrated sensors are revolutionizing micromanipulation based medical interventions and are enabling doctors to perform minimally invasive procedures not possible before. 3D fabrication technologies enabling milli/microrobot fabrication at the single cell scale are empowering high-resolution visual imaging and in vivo manipulation capabilities. Swallowable millirobots and injectabale ocular microrobots allow the gastric ulcer imaging, and performance of vitreoretinal microsurgery at previously inaccessible ocular sites. Many invasive excision and incision based diagnostic biopsy, prostrate, and nephrolgical procedures can be performed minimally or almost noninvasively due to recent advancements in microrobotic technology. Advances in biohybrid microrobot systems are pushing microrobotic systems even smaller, using biological cells as on-board microactuators and microsensors using the chemical energy. Such microrobotic systems could be used for local targeted delivery of imaging contrast agents, drugs, genes, and mRNA, minimally invasive surgery, and cell micromanipulation in the near future.

pi

link (url) [BibTex]


Thumb xl publications toc
Parallel microcracks-based ultrasensitive and highly stretchable strain sensors

Amjadi, M., Turan, M., Clementson, C. P., Sitti, M.

ACS Applied Materials \& Interfaces, 8(8):5618-5626, American Chemical Society, Febuary 2016 (article)

Abstract
There is an increasing demand for flexible, skin-attachable, and wearable strain sensors due to their various potential applications. However, achieving strain sensors with both high sensitivity and high stretchability is still a grand challenge. Here, we propose highly sensitive and stretchable strain sensors based on the reversible microcrack formation in composite thin films. Controllable parallel microcracks are generated in graphite thin films coated on elastomer films. Sensors made of graphite thin films with short microcracks possess high gauge factors (maximum value of 522.6) and stretchability (ε ≥ 50%), whereas sensors with long microcracks show ultrahigh sensitivity (maximum value of 11 344) with limited stretchability (ε ≤ 50%). We demonstrate the high performance strain sensing of our sensors in both small and large strain sensing applications such as human physiological activity recognition, human body large motion capturing, vibration detection, pressure sensing, and soft robotics.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl amjadi et al 2016 advanced functional materials
Stretchable, Skin-Mountable, and Wearable Strain Sensors and Their Potential Applications: A Review

Amjadi, M., Kyung, K., Park, I., Sitti, M.

Advanced Functional Materials, 26, pages: 1678-1698, Febuary 2016 (article)

Abstract
There is a growing demand for flexible and soft electronic devices. In particular, stretchable, skin-mountable, and wearable strain sensors are needed for several potential applications including personalized health-monitoring, human motion detection, human-machine interfaces, soft robotics, and so forth. This Feature Article presents recent advancements in the development of flexible and stretchable strain sensors. The article shows that highly stretchable strain sensors are successfully being developed by new mechanisms such as disconnection between overlapped nanomaterials, crack propagation in thin films, and tunneling effect, different from traditional strain sensing mechanisms. Strain sensing performances of recently reported strain sensors are comprehensively studied and discussed, showing that appropriate choice of composite structures as well as suitable interaction between functional nanomaterials and polymers are essential for the high performance strain sensing. Next, simulation results of piezoresistivity of stretchable strain sensors by computational models are reported. Finally, potential applications of flexible strain sensors are described. This survey reveals that flexible, skin-mountable, and wearable strain sensors have potential in diverse applications while several grand challenges have to be still overcome.

pi

DOI [BibTex]

DOI [BibTex]


Thumb xl toc image patent
Remotely addressable magnetic composite micro-actuators

Sitti, M., Diller, E., Miyashita, S.

Febuary 2016, US Patent App. 15/018,008 (patent)

Abstract
The present invention describes methods to fabricate actuators that can be remotely controlled in an addressable manner, and methods to provide remote control such micro-actuators. The actuators are composites of two permanent magnet materials, one of which is has high coercivity, and the other of which switches magnetization direction by applied fields. By switching the second material's magnetization direction, the two magnets either work together or cancel each other, resulting in distinct “on” and “off” behavior of the devices. The device can be switched “on” or “off” remotely using a field pulse of short duration.

pi

[BibTex]

[BibTex]


Thumb xl toc image patent
Remotely addressable magnetic composite micro-actuators

Sitti, M., Diller, E., Miyashita, S.

Febuary 2016, US Patent 9,281,112 (patent)

Abstract
The present invention describes methods to fabricate actuators that can be remotely controlled in an addressable manner, and methods to provide remote control such micro-actuators. The actuators are composites of two permanent magnet materials, one of which is has high coercivity, and the other of which switches magnetization direction by applied fields. By switching the second material's magnetization direction, the two magnets either work together or cancel each other, resulting in distinct “on” and “off” behavior of the devices. The device can be switched “on” or “off” remotely using a field pulse of short duration.

pi

link (url) [BibTex]

link (url) [BibTex]


Thumb xl b 07384529
Size optimization of a magnetic system for drug delivery with capsule robots

Munoz, F., Alici, G., Li, W., Sitti, M.

IEEE Transactions on Magnetics, 52(5):1-11, IEEE, January 2016 (article)

Abstract
In this paper, we present a methodology for the size optimization of an external magnetic system made of arc-shaped permanent magnets (ASMs). This magnetic system is able to remotely actuate a drug-release module embedded in a prototype of a capsule robot. The optimization of the magnetic system is carried out by using an accurate analytical model that is valid for any arbitrary dimensions of the ASMs. By using this analytical model, we perform parametric studies and conduct a statistical analysis [analysis of variance (ANOVA)] to investigate efficient ways to distribute the volume of the ASMs so that the dimensions and volume of the magnetic system are minimized while optimal flux densities and magnetic torques are obtained to actuate the drug delivery system (DDS). The ANOVA results, at 5% significance level, indicate that changes in the angular width followed by changes in the length of the ASMs have the highest impact on the magnetic linkage. Furthermore, our experimental results, which are in agreement with the analytical results, show that the size optimization of the magnetic system is effective for the actuation of the DDS in capsule robots.

pi

DOI [BibTex]

DOI [BibTex]


no image
Supplemental material for ’Communication Rate Analysis for Event-based State Estimation’

Ebner, S., Trimpe, S.

Max Planck Institute for Intelligent Systems, January 2016 (techreport)

am ics

PDF [BibTex]

PDF [BibTex]