Header logo is


2020


Learning of sub-optimal gait controllers for magnetic walking soft millirobots
Learning of sub-optimal gait controllers for magnetic walking soft millirobots

Culha, U., Demir, S. O., Trimpe, S., Sitti, M.

In Proceedings of Robotics: Science and Systems, 2020 (inproceedings)

Abstract
Untethered small-scale soft robots have promising applications in minimally invasive surgery, targeted drug delivery, and bioengineering applications as they can access confined spaces in the human body. However, due to highly nonlinear soft continuum deformation kinematics, inherent stochastic variability during fabrication at the small scale, and lack of accurate models, the conventional control methods cannot be easily applied. Adaptivity of robot control is additionally crucial for medical operations, as operation environments show large variability, and robot materials may degrade or change over time,which would have deteriorating effects on the robot motion and task performance. Therefore, we propose using a probabilistic learning approach for millimeter-scale magnetic walking soft robots using Bayesian optimization (BO) and Gaussian processes (GPs). Our approach provides a data-efficient learning scheme to find controller parameters while optimizing the stride length performance of the walking soft millirobot robot within a small number of physical experiments. We demonstrate adaptation to fabrication variabilities in three different robots and to walking surfaces with different roughness. We also show an improvement in the learning performance by transferring the learning results of one robot to the others as prior information.

pi ics

link (url) DOI [BibTex]


no image
Where Does It End? - Reasoning About Hidden Surfaces by Object Intersection Constraints

Strecke, M., Stückler, J.

In Proceedings IEEE/CVF Conf. on Computer Vision and Pattern Recognition (CVPR), IEEE/CVF International Conference on Computer Vision and Pattern Recognition (CVPR) 2020, June 2020 (inproceedings)

ev

preprint project page [BibTex]

preprint project page [BibTex]


Towards 5-DoF Control of an Untethered Magnetic Millirobot via MRI Gradient Coils
Towards 5-DoF Control of an Untethered Magnetic Millirobot via MRI Gradient Coils

Onder Erin, D. A. M. E. T., Sitti, M.

In 2020 IEEE International Conference on Robotics and Automation (ICRA), pages: 6551-6557, 2020 (inproceedings)

pi

DOI [BibTex]

DOI [BibTex]


no image
A Real-Robot Dataset for Assessing Transferability of Learned Dynamics Models

Agudelo-España, D., Zadaianchuk, A., Wenk, P., Garg, A., Akpo, J., Grimminger, F., Viereck, J., Naveau, M., Righetti, L., Martius, G., Krause, A., Schölkopf, B., Bauer, S., Wüthrich, M.

IEEE International Conference on Robotics and Automation (ICRA), 2020 (conference) Accepted

am al ei mg

Project Page PDF [BibTex]

Project Page PDF [BibTex]


no image
Learning to Identify Physical Parameters from Video Using Differentiable Physics

Kandukuri, R., Achterhold, J., Moeller, M., Stueckler, J.

Accepted for publication at the 42th German Conference on Pattern Recognition (GCPR), 2020, GCPR 2020 Honorable Mention (conference) Accepted

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Planning from Images with Deep Latent Gaussian Process Dynamics

Bosch, N., Achterhold, J., Leal-Taixe, L., Stückler, J.

Proceedings of the 2nd Conference on Learning for Dynamics and Control (L4DC), 120, pages: 640-650, Proceedings of Machine Learning Research (PMLR), (Editors: Alexandre M. Bayen and Ali Jadbabaie and George Pappas and Pablo A. Parrilo and Benjamin Recht and Claire Tomlin and Melanie Zeilinger), 2020, arXiv:2005.03770 (conference)

ev

preprint project page poster [BibTex]

preprint project page poster [BibTex]


no image
DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation

Wang, R., Yang, N., Stückler, J., Cremers, D.

In Proceedings of the IEEE international Conference on Robotics and Automation (ICRA), 2020, arXiv:1904.10097 (inproceedings)

ev

[BibTex]

[BibTex]


no image
Learning to Adapt Multi-View Stereo by Self-Supervision

Mallick, A., Stückler, J., Lensch, H.

Proceedings of the British Machine Vision Conference (BMVC), 2020, to appear (conference) To be published

ev

link (url) [BibTex]

link (url) [BibTex]

2014


Geckogripper: A soft, inflatable robotic gripper using gecko-inspired elastomer micro-fiber adhesives
Geckogripper: A soft, inflatable robotic gripper using gecko-inspired elastomer micro-fiber adhesives

Song, S., Majidi, C., Sitti, M.

In Intelligent Robots and Systems (IROS 2014), 2014 IEEE/RSJ International Conference on, pages: 4624-4629, September 2014 (inproceedings)

Abstract
This paper proposes GeckoGripper, a novel soft, inflatable gripper based on the controllable adhesion mechanism of gecko-inspired micro-fiber adhesives, to pick-and-place complex and fragile non-planar or planar parts serially or in parallel. Unlike previous fibrillar structures that use peel angle to control the manipulation of parts, we developed an elastomer micro-fiber adhesive that is fabricated on a soft, flexible membrane, increasing the adaptability to non-planar three-dimensional (3D) geometries and controllability in adhesion. The adhesive switching ratio (the ratio between the maximum and minimum adhesive forces) of the developed gripper was measured to be around 204, which is superior to previous works based on peel angle-based release control methods. Adhesion control mechanism based on the stretch of the membrane and superior adaptability to non-planar 3D geometries enable the micro-fibers to pick-and-place various 3D parts as shown in demonstrations.

pi

DOI [BibTex]

2014


DOI [BibTex]


no image
Adaptive Tool-Use Strategies for Anthropomorphic Service Robots

Stueckler, J., Behnke, S.

In Proc. of the 14th IEEE-RAS International Conference on Humanoid Robots (Humanoids), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Local Multi-Resolution Surfel Grids for MAV Motion Estimation and 3D Mapping

Droeschel, D., Stueckler, J., Behnke, S.

In Proc. of the 13th International Conference on Intelligent Autonomous Systems (IAS), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Combining the Strengths of Sparse Interest Point and Dense Image Registration for RGB-D Odometry

Stueckler, J., Gutt, A., Behnke, S.

In Proc. of the Joint 45th International Symposium on Robotics (ISR) and 8th German Conference on Robotics (ROBOTIK), 2014 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Mobile Teleoperation Interfaces with Adjustable Autonomy for Personal Service Robots

Schwarz, M., Stueckler, J., Behnke, S.

In Proceedings of the 2014 ACM/IEEE International Conference on Human-robot Interaction, pages: 288-289, HRI ’14, ACM, 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Three-dimensional robotic manipulation and transport of micro-scale objects by a magnetically driven capillary micro-gripper

Giltinan, J., Diller, E., Mayda, C., Sitti, M.

In Robotics and Automation (ICRA), 2014 IEEE International Conference on, pages: 2077-2082, 2014 (inproceedings)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Liquid-metal reconfigurable RF components and antennas

Dang, J. H., Morishita, A. M., Gough, R. C., Hu, W., Ohta, A. T., Shiroma, W. A.

In Radio Science Meeting (USNC-URSI NRSM), 2014 United States National Committee of URSI National, pages: 1-1, 2014 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Dual Execution of Optimized Contact Interaction Trajectories

Toussaint, M., Ratliff, N., Bohg, J., Righetti, L., Englert, P., Schaal, S.

In 2014 IEEE/RSJ Conference on Intelligent Robots and Systems, pages: 47-54, IEEE, Chicago, USA, 2014 (inproceedings)

Abstract
Efficient manipulation requires contact to reduce uncertainty. The manipulation literature refers to this as funneling: a methodology for increasing reliability and robustness by leveraging haptic feedback and control of environmental interaction. However, there is a fundamental gap between traditional approaches to trajectory optimization and this concept of robustness by funneling: traditional trajectory optimizers do not discover force feedback strategies. From a POMDP perspective, these behaviors could be regarded as explicit observation actions planned to sufficiently reduce uncertainty thereby enabling a task. While we are sympathetic to the full POMDP view, solving full continuous-space POMDPs in high-dimensions is hard. In this paper, we propose an alternative approach in which trajectory optimization objectives are augmented with new terms that reward uncertainty reduction through contacts, explicitly promoting funneling. This augmentation shifts the responsibility of robustness toward the actual execution of the optimized trajectories. Directly tracing trajectories through configuration space would lose all robustness-dual execution achieves robustness by devising force controllers to reproduce the temporal interaction profile encoded in the dual solution of the optimization problem. This work introduces dual execution in depth and analyze its performance through robustness experiments in both simulation and on a real-world robotic platform.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Robotic assembly of hydrogels for tissue engineering and regenerative medicine

Tasoglu, S, Diller, E, Guven, S, Sitti, M, Demirci, U

In Journal of Tissue Engineering and Regenerative Medicine, 8, pages: 181-182, 2014 (inproceedings)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Molecular delivery and transfection by laser-induced oscillating microbubbles

Fan, Q., Hu, W., Ohta, A. T.

In Nano/Micro Engineered and Molecular Systems (NEMS), 2014 9th IEEE International Conference on, pages: 302-305, 2014 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Versatile non-contact micro-manipulation method using rotational flows locally induced by magnetic microrobots

Ye, Z., Edington, C., Russell, A. J., Sitti, M.

In Advanced Intelligent Mechatronics (AIM), 2014 IEEE/ASME International Conference on, pages: 26-31, 2014 (inproceedings)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Efficient deformable registration of multi-resolution surfel maps for object manipulation skill transfer

Stueckler, J., Behnke, S.

In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages: 994-1001, May 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Balancing experiments on a torque-controlled humanoid with hierarchical inverse dynamics

Herzog, A., Righetti, L., Grimminger, F., Pastor, P., Schaal, S.

In 2014 IEEE/RSJ Conference on Intelligent Robots and Systems, pages: 981-988, IEEE, Chicago, USA, 2014 (inproceedings)

Abstract
Recently several hierarchical inverse dynamics controllers based on cascades of quadratic programs have been proposed for application on torque controlled robots. They have important theoretical benefits but have never been implemented on a torque controlled robot where model inaccuracies and real-time computation requirements can be problematic. In this contribution we present an experimental evaluation of these algorithms in the context of balance control for a humanoid robot. The presented experiments demonstrate the applicability of the approach under real robot conditions (i.e. model uncertainty, estimation errors, etc). We propose a simplification of the optimization problem that allows us to decrease computation time enough to implement it in a fast torque control loop. We implement a momentum-based balance controller which shows robust performance in face of unknown disturbances, even when the robot is standing on only one foot. In a second experiment, a tracking task is evaluated to demonstrate the performance of the controller with more complicated hierarchies. Our results show that hierarchical inverse dynamics controllers can be used for feedback control of humanoid robots and that momentum-based balance control can be efficiently implemented on a real robot.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Full Dynamics LQR Control of a Humanoid Robot: An Experimental Study on Balancing and Squatting

Mason, S., Righetti, L., Schaal, S.

In 2014 IEEE-RAS International Conference on Humanoid Robots, pages: 374-379, IEEE, Madrid, Spain, 2014 (inproceedings)

Abstract
Humanoid robots operating in human environments require whole-body controllers that can offer precise tracking and well-defined disturbance rejection behavior. In this contribution, we propose an experimental evaluation of a linear quadratic regulator (LQR) using a linearization of the full robot dynamics together with the contact constraints. The advantage of the controller is that it explicitly takes into account the coupling between the different joints to create optimal feedback controllers for whole-body control. We also propose a method to explicitly regulate other tasks of interest, such as the regulation of the center of mass of the robot or its angular momentum. In order to evaluate the performance of linear optimal control designs in a real-world scenario (model uncertainty, sensor noise, imperfect state estimation, etc), we test the controllers in a variety of tracking and balancing experiments on a torque controlled humanoid (e.g. balancing, split plane balancing, squatting, pushes while squatting, and balancing on a wheeled platform). The proposed control framework shows a reliable push recovery behavior competitive with more sophisticated balance controllers, rejecting impulses up to 11.7 Ns with peak forces of 650 N, with the added advantage of great computational simplicity. Furthermore, the controller is able to track squatting trajectories up to 1 Hz without relinearization, suggesting that the linearized dynamics is sufficient for significant ranges of motion.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Structural optimization method towards synthesis of small scale flexure-based mobile grippers

Lum, G. Z., Diller, E., Sitti, M.

In Robotics and Automation (ICRA), 2014 IEEE International Conference on, pages: 2339-2344, 2014 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Six-Degrees-of-Freedom Remote Actuation of Magnetic Microrobots.

Diller, E. D., Giltinan, J., Lum, G. Z., Ye, Z., Sitti, M.

In Robotics: Science and Systems, 2014 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Local multi-resolution representation for 6D motion estimation and mapping with a continuously rotating 3D laser scanner

Droeschel, D., Stueckler, J., Behnke, S.

In Proc. of the IEEE Int. Conf. on Robotics and Automation (ICRA), pages: 5221-5226, May 2014 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
State Estimation for a Humanoid Robot

Rotella, N., Bloesch, M., Righetti, L., Schaal, S.

In 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems, pages: 952-958, IEEE, Chicago, USA, 2014 (inproceedings)

Abstract
This paper introduces a framework for state estimation on a humanoid robot platform using only common proprioceptive sensors and knowledge of leg kinematics. The presented approach extends that detailed in prior work on a point-foot quadruped platform by adding the rotational constraints imposed by the humanoid's flat feet. As in previous work, the proposed Extended Kalman Filter accommodates contact switching and makes no assumptions about gait or terrain, making it applicable on any humanoid platform for use in any task. A nonlinear observability analysis is performed on both the point-foot and flat-foot filters and it is concluded that the addition of rotational constraints significantly simplifies singular cases and improves the observability characteristics of the system. Results on a simulated walking dataset demonstrate the performance gain of the flat-foot filter as well as confirm the results of the presented observability analysis.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2013


no image
AGILITY – Dynamic Full Body Locomotion and Manipulation with Autonomous Legged Robots

Hutter, M., Bloesch, M., Buchli, J., Semini, C., Bazeille, S., Righetti, L., Bohg, J.

In 2013 IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pages: 1-4, IEEE, Linköping, Sweden, 2013 (inproceedings)

mg

link (url) DOI [BibTex]

2013


link (url) DOI [BibTex]


no image
Efficient Dense 3D Rigid-Body Motion Segmentation in RGB-D Video

Stueckler, J., Behnke, S.

In Proc. of the British Machine Vision Conference (BMVC), 2013 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Mobile bin picking with an anthropomorphic service robot

Nieuwenhuisen, M., Droeschel, D., Holz, D., Stueckler, J., Berner, A., Li, J., Klein, R., Behnke, S.

In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), pages: 2327-2334, May 2013 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Learning Objective Functions for Manipulation

Kalakrishnan, M., Pastor, P., Righetti, L., Schaal, S.

In 2013 IEEE International Conference on Robotics and Automation, IEEE, Karlsruhe, Germany, 2013 (inproceedings)

Abstract
We present an approach to learning objective functions for robotic manipulation based on inverse reinforcement learning. Our path integral inverse reinforcement learning algorithm can deal with high-dimensional continuous state-action spaces, and only requires local optimality of demonstrated trajectories. We use L 1 regularization in order to achieve feature selection, and propose an efficient algorithm to minimize the resulting convex objective function. We demonstrate our approach by applying it to two core problems in robotic manipulation. First, we learn a cost function for redundancy resolution in inverse kinematics. Second, we use our method to learn a cost function over trajectories, which is then used in optimization-based motion planning for grasping and manipulation tasks. Experimental results show that our method outperforms previous algorithms in high-dimensional settings.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Angular Motion Control Using a Closed-Loop CPG for a Water-Running Robot

Thatte, N., Khoramshahi, M., Ijspeert, A., Sitti, M.

In Dynamic Walking 2013, (EPFL-CONF-199763), 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Light-induced microbubble poration of localized cells

Fan, Qihui, Hu, Wenqi, Ohta, Aaron T

In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pages: 4482-4485, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Multi-resolution surfel mapping and real-time pose tracking using a continuously rotating 2D laser scanner

Schadler, M., Stueckler, J., Behnke, S.

In Proc. of the IEEE International Symposium on Safety, Security, and Rescue Robotics (SSRR), pages: 1-6, October 2013 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
Joint detection and pose tracking of multi-resolution surfel models in RGB-D

McElhone, M., Stueckler, J., Behnke, S.

In Proc. of the European Conference on Mobile Robots (ECMR), pages: 131-137, IEEE, 2013 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
A hybrid topological and structural optimization method to design a 3-DOF planar motion compliant mechanism

Lum, G. Z., Teo, T. J., Yang, G., Yeo, S. H., Sitti, M.

In Advanced Intelligent Mechatronics (AIM), 2013 IEEE/ASME International Conference on, pages: 247-254, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
SoftCubes: towards a soft modular matter

Yim, S., Sitti, M.

In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages: 530-536, 2013 (inproceedings)

pi

Project Page [BibTex]

Project Page [BibTex]


no image
Bubble-driven light-absorbing hydrogel microrobot for the assembly of bio-objects

Hu, W., Fan, Q., Tonaki, W., Ohta, A. T.

In Engineering in Medicine and Biology Society (EMBC), 2013 35th Annual International Conference of the IEEE, pages: 5303-5306, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Assembly of cell-laden microgels by an optically controlled bubble manipulator

Hu, W., Fan, Q., Ohta, A.

In International Conference on Miniaturized Systems for Chemistry and Life Sciences, Freiburg, Germany, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Distinctive 3D surface entropy features for place recognition.

Fiolka, T., Stueckler, J., Klein, D. A., Schulz, D., Behnke, S.

In Proc. of the European Conference on Mobile Robots (ECMR), pages: 204-209, IEEE, 2013 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Flapping wings via direct-driving by DC motors

Azhar, M., Campolo, D., Lau, G., Hines, L., Sitti, M.

In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages: 1397-1402, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Three dimensional independent control of multiple magnetic microrobots

Diller, E., Giltinan, J., Jena, P., Sitti, M.

In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages: 2576-2581, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
A reconfigurable, liquid-metal-based low-pass filter with reversible tuning

Tonaki, W. G., Hu, W., Ohta, A. T., Shiroma, W. A.

In Wireless Symposium (IWS), 2013 IEEE International, pages: 1-3, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Combining contour and shape primitives for object detection and pose estimation of prefabricated parts

Berner, A., Li, J., Holz, D., Stueckler, J., Behnke, S., Klein, R.

In Proc. of the 20th IEEE International Conference on Image Processing (ICIP), pages: 3326-3330, sep 2013 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]


no image
A Perching Mechanism for Flying Robots Using a Fibre-Based Adhesive

Daler, L., Klaptocz, A., Briod, A., Sitti, M., Floreano, D.

In Robotics and Automation (ICRA), 2013 IEEE International Conference on, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Bonding methods for modular micro-robotic assemblies

Diller, E., Zhang, N., Sitti, M.

In Robotics and Automation (ICRA), 2013 IEEE International Conference on, pages: 2588-2593, 2013 (inproceedings)

pi

[BibTex]

[BibTex]


no image
Hierarchical Object Discovery and Dense Modelling From Motion Cues in RGB-D Video

Stueckler, J., Behnke, S.

In Proc. of the 23rd International Joint Conference on Artificial Intelligence (IJCAI), IJCAI/AAAI, 2013 (inproceedings)

ev

link (url) [BibTex]

link (url) [BibTex]


no image
Learning Task Error Models for Manipulation

Pastor, P., Kalakrishnan, M., Binney, J., Kelly, J., Righetti, L., Sukhatme, G. S., Schaal, S.

In 2013 IEEE Conference on Robotics and Automation, IEEE, Karlsruhe, Germany, 2013 (inproceedings)

Abstract
Precise kinematic forward models are important for robots to successfully perform dexterous grasping and manipulation tasks, especially when visual servoing is rendered infeasible due to occlusions. A lot of research has been conducted to estimate geometric and non-geometric parameters of kinematic chains to minimize reconstruction errors. However, kinematic chains can include non-linearities, e.g. due to cable stretch and motor-side encoders, that result in significantly different errors for different parts of the state space. Previous work either does not consider such non-linearities or proposes to estimate non-geometric parameters of carefully engineered models that are robot specific. We propose a data-driven approach that learns task error models that account for such unmodeled non-linearities. We argue that in the context of grasping and manipulation, it is sufficient to achieve high accuracy in the task relevant state space. We identify this relevant state space using previously executed joint configurations and learn error corrections for those. Therefore, our system is developed to generate subsequent executions that are similar to previous ones. The experiments show that our method successfully captures the non-linearities in the head kinematic chain (due to a counterbalancing spring) and the arm kinematic chains (due to cable stretch) of the considered experimental platform, see Fig. 1. The feasibility of the presented error learning approach has also been evaluated in independent DARPA ARM-S testing contributing to successfully complete 67 out of 72 grasping and manipulation tasks.

am mg

link (url) DOI [BibTex]

link (url) DOI [BibTex]

2011


no image
Micro-assembly using optically controlled bubbles

Hu, W., Ishii, K. S., Ohta, A. T.

In Optical MEMS and Nanophotonics (OMN), 2011 International Conference on, pages: 53-54, 2011 (inproceedings)

pi

[BibTex]

2011


[BibTex]


no image
Following human guidance to cooperatively carry a large object

Stueckler, J., Behnke, S.

In Proc. of the 11th IEEE-RAS Int. Conf. on Humanoid Robots (Humanoids), pages: 218-223, October 2011 (inproceedings)

ev

link (url) DOI [BibTex]

link (url) DOI [BibTex]