Publications | Max Planck Institute for Intelligent Systems

1431 results (View BibTeX file of all listed publications)

2018

Independent Actuation of Two-Tailed Microrobots

Khalil, I. S. M., Tabak, A. F., Hamed, Y., Tawakol, M., Klingner, A., Gohary, N. E., Mizaikoff, B., Sitti, M.

IEEE Robotics and Automation Letters, 3(3):1703-1710, Febuary 2018 (article)

Abstract

A soft two-tailed microrobot in low Reynolds number fluids does not achieve forward locomotion by identical tails regardless to its wiggling frequency. If the tails are nonidentical, zero forward locomotion is also observed at specific oscillation frequencies (which we refer to as the reversal frequencies), as the propulsive forces imparted to the fluid by each tail are almost equal in magnitude and opposite in direction. We find distinct reversal frequencies for the two-tailed microrobots based on their tail length ratio. At these frequencies, the microrobot achieves negligible net displacement under the influence of a periodic magnetic field. This observation allows us to fabricate groups of microrobots with tail length ratio of 1.24 ± 0.11, 1.48 ± 0.08, and 1.71 ± 0.09. We demonstrate selective actuation of microrobots based on prior characterization of their reversal frequencies. We also implement simultaneous flagellar propulsion of two microrobots and show that they can be controlled to swim along the same direction and opposite to each other using common periodic magnetic fields. In addition, independent motion control of two microrobots is achieved toward two different reference positions with average steady-state error of 110.1 ± 91.8 μm and 146.9 ± 105.9 μm.

link (url) DOI [BibTex]

2018

pi Khalil, I. S. M., Tabak, A. F., Hamed, Y., Tawakol, M., Klingner, A., Gohary, N. E., Mizaikoff, B., Sitti, M. Independent Actuation of Two-Tailed Microrobots IEEE Robotics and Automation Letters, 3(3):1703-1710, Febuary 2018 (article)

link (url) DOI [BibTex]

Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation

Kim, J., Tabibian, B., Oh, A., Schölkopf, B., Gomez Rodriguez, M.

Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM), pages: 324-332, (Editors: Yi Chang, Chengxiang Zhai, Yan Liu, and Yoelle Maarek), ACM, Febuary 2018 (conference)

DOI Project Page Project Page [BibTex]

ei Kim, J., Tabibian, B., Oh, A., Schölkopf, B., Gomez Rodriguez, M. Leveraging the Crowd to Detect and Reduce the Spread of Fake News and Misinformation Proceedings of the 11th ACM International Conference on Web Search and Data Mining (WSDM), pages: 324-332, (Editors: Yi Chang, Chengxiang Zhai, Yan Liu, and Yoelle Maarek), ACM, Febuary 2018 (conference)

DOI Project Page Project Page [BibTex]

Robotic Motion Learning Framework to Promote Social Engagement

Burns, R., Jeon, M., Park, C. H.

Applied Sciences, 8(2):241, Febuary 2018, Special Issue "Social Robotics" (article)

Abstract

Imitation is a powerful component of communication between people, and it poses an important implication in improving the quality of interaction in the field of human–robot interaction (HRI). This paper discusses a novel framework designed to improve human–robot interaction through robotic imitation of a participant’s gestures. In our experiment, a humanoid robotic agent socializes with and plays games with a participant. For the experimental group, the robot additionally imitates one of the participant’s novel gestures during a play session. We hypothesize that the robot’s use of imitation will increase the participant’s openness towards engaging with the robot. Experimental results from a user study of 12 subjects show that post-imitation, experimental subjects displayed a more positive emotional state, had higher instances of mood contagion towards the robot, and interpreted the robot to have a higher level of autonomy than their control group counterparts did. These results point to an increased participant interest in engagement fueled by personalized imitation during interaction.

link (url) DOI [BibTex]

hi Burns, R., Jeon, M., Park, C. H. Robotic Motion Learning Framework to Promote Social Engagement Applied Sciences, 8(2):241, Febuary 2018, Special Issue "Social Robotics" (article)

link (url) DOI [BibTex]

Co-Registration – Simultaneous Alignment and Modeling of Articulated 3D Shapes

Black, M., Hirshberg, D., Loper, M., Rachlin, E., Weiss, A.

Febuary 2018, U.S.~Patent 9,898,848 (misc)

Abstract

Present application refers to a method, a model generation unit and a computer program (product) for generating trained models (M) of moving persons, based on physically measured person scan data (S). The approach is based on a common template (T) for the respective person and on the measured person scan data (S) in different shapes and different poses. Scan data are measured with a 3D laser scanner. A generic personal model is used for co-registering a set of person scan data (S) aligning the template (T) to the set of person scans (S) while simultaneously training the generic personal model to become a trained person model (M) by constraining the generic person model to be scan-specific, person-specific and pose-specific and providing the trained model (M), based on the co registering of the measured object scan data (S).

text [BibTex]

ps Black, M., Hirshberg, D., Loper, M., Rachlin, E., Weiss, A. Co-Registration – Simultaneous Alignment and Modeling of Articulated 3D Shapes Febuary 2018, U.S.~Patent 9,898,848 (misc)

text [BibTex]

Recent Advances in Wearable Transdermal Delivery Systems

Amjadi, M., Sheykhansari, S., Nelson, B. J., Sitti, M.

Advanced Materials, 30(7):1704530, January 2018 (article)

Abstract

Abstract Wearable transdermal delivery systems have recently received tremendous attention due to their noninvasive, convenient, and prolonged administration of pharmacological agents. Here, the material prospects, fabrication processes, and drug‐release mechanisms of these types of therapeutic delivery systems are critically reviewed. The latest progress in the development of multifunctional wearable devices capable of closed‐loop sensation and drug delivery is also discussed. This survey reveals that wearable transdermal delivery has already made an impact in diverse healthcare applications, while several grand challenges remain.

link (url) DOI [BibTex]

pi Amjadi, M., Sheykhansari, S., Nelson, B. J., Sitti, M. Recent Advances in Wearable Transdermal Delivery Systems Advanced Materials, 30(7):1704530, January 2018 (article)

link (url) DOI [BibTex]

Acoustic Fabrication via the Assembly and Fusion of Particles

Melde, K., Choi, E., Wu, Z., Palagi, S., Qiu, T., Fischer, P.

Advanced Materials, 30(3):1704507, January 2018 (article)

Abstract

Acoustic assembly promises a route toward rapid parallel fabrication of whole objects directly from solution. This study reports the contact-free and maskless assembly, and fixing of silicone particles into arbitrary 2D shapes using ultrasound fields. Ultrasound passes through an acoustic hologram to form a target image. The particles assemble from a suspension along lines of high pressure in the image due to acoustic radiation forces and are then fixed (crosslinked) in a UV-triggered reaction. For this, the particles are loaded with a photoinitiator by solvent-induced swelling. This localizes the reaction and allows the bulk suspension to be reused. The final fabricated parts are mechanically stable and self-supporting.

link (url) DOI Project Page [BibTex]

pf Melde, K., Choi, E., Wu, Z., Palagi, S., Qiu, T., Fischer, P. Acoustic Fabrication via the Assembly and Fusion of Particles Advanced Materials, 30(3):1704507, January 2018 (article)

link (url) DOI Project Page [BibTex]

Deep EndoVO: A recurrent convolutional neural network (RCNN) based visual odometry approach for endoscopic capsule robots

Turan, M., Almalioglu, Y., Araujo, H., Konukoglu, E., Sitti, M.

Neurocomputing, 275, pages: 1861 - 1870, January 2018 (article)

Abstract

Ingestible wireless capsule endoscopy is an emerging minimally invasive diagnostic technology for inspection of the GI tract and diagnosis of a wide range of diseases and pathologies. Medical device companies and many research groups have recently made substantial progresses in converting passive capsule endoscopes to active capsule robots, enabling more accurate, precise, and intuitive detection of the location and size of the diseased areas. Since a reliable real time pose estimation functionality is crucial for actively controlled endoscopic capsule robots, in this study, we propose a monocular visual odometry (VO) method for endoscopic capsule robot operations. Our method lies on the application of the deep recurrent convolutional neural networks (RCNNs) for the visual odometry task, where convolutional neural networks (CNNs) and recurrent neural networks (RNNs) are used for the feature extraction and inference of dynamics across the frames, respectively. Detailed analyses and evaluations made on a real pig stomach dataset proves that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.

link (url) DOI [BibTex]

pi Turan, M., Almalioglu, Y., Araujo, H., Konukoglu, E., Sitti, M. Deep EndoVO: A recurrent convolutional neural network (RCNN) based visual odometry approach for endoscopic capsule robots Neurocomputing, 275, pages: 1861 - 1870, January 2018 (article)

link (url) DOI [BibTex]

Small-scale soft-bodied robot with multimodal locomotion

Hu, W., Lum, G. Z., Mastrangeli, M., Sitti, M.

Nature, 554, pages: 81-85, Nature, January 2018 (article)

Abstract

Untethered small-scale (from several millimetres down to a few micrometres in all dimensions) robots that can non-invasively access confined, enclosed spaces may enable applications in microfactories such as the construction of tissue scaffolds by robotic assembly1, in bioengineering such as single-cell manipulation and biosensing2, and in healthcare3,4,5,6 such as targeted drug delivery4 and minimally invasive surgery3,5. Existing small-scale robots, however, have very limited mobility because they are unable to negotiate obstacles and changes in texture or material in unstructured environments7,8,9,10,11,12,13. Of these small-scale robots, soft robots have greater potential to realize high mobility via multimodal locomotion, because such machines have higher degrees of freedom than their rigid counterparts14,15,16. Here we demonstrate magneto-elastic soft millimetre-scale robots that can swim inside and on the surface of liquids, climb liquid menisci, roll and walk on solid surfaces, jump over obstacles, and crawl within narrow tunnels. These robots can transit reversibly between different liquid and solid terrains, as well as switch between locomotive modes. They can additionally execute pick-and-place and cargo-release tasks. We also present theoretical models to explain how the robots move. Like the large-scale robots that can be used to study locomotion17, these soft small-scale robots could be used to study soft-bodied locomotion produced by small organisms.

link (url) DOI Project Page [BibTex]

pi Hu, W., Lum, G. Z., Mastrangeli, M., Sitti, M. Small-scale soft-bodied robot with multimodal locomotion Nature, 554, pages: 81-85, Nature, January 2018 (article)

link (url) DOI Project Page [BibTex]

Light‐Driven Janus Hollow Mesoporous TiO2–Au Microswimmers

Sridhar, V., Park, B., Sitti, M.

Advanced Functional Materials, 28(5):1704902, January 2018 (article)

Abstract

Abstract Light‐driven microswimmers have garnered attention for their potential use in various applications, such as environmental remediation, hydrogen evolution, and targeted drug delivery. Janus hollow mesoporous TiO2/Au (JHP–TiO2–Au) microswimmers with enhanced swimming speeds under low‐intensity ultraviolet (UV) light are presented. The swimmers show enhanced swimming speeds both in presence and absence of H2O2. The microswimmers move due to self‐electrophoresis when UV light is incident on them. There is a threefold increase in speed of JHP–TiO2–Au microswimmers in comparison with Janus solid TiO2/Au (JS–TiO2–Au) microswimmers. This increase in their speed is due to the increase in surface area of the porous swimmers and their hollow structure. These microswimmers are also made steerable by using a thin Co magnetic layer. They can be used in potential environmental applications for active photocatalytic degradation of methylene blue and targeted active drug delivery of an anticancer drug (doxurobicin) in vitro in H2O2 solution. Their increased speed from the presence of a hollow mesoporous structure is beneficial for future potential applications, such as hydrogen evolution, selective heterogeneous photocatalysis, and targeted cargo delivery.

link (url) DOI Project Page [BibTex]

pi Sridhar, V., Park, B., Sitti, M. Light‐Driven Janus Hollow Mesoporous TiO2–Au Microswimmers Advanced Functional Materials, 28(5):1704902, January 2018 (article)

link (url) DOI Project Page [BibTex]

Mechanical Rubbing of Blood Clots Using Helical Robots Under Ultrasound Guidance

Khalil, I. S. M., Mahdy, D., Sharkawy, A. E., Moustafa, R. R., Tabak, A. F., Mitwally, M. E., Hesham, S., Hamdi, N., Klingner, A., Mohamed, A., Sitti, M.

IEEE Robotics and Automation Letters, 3(2):1112-1119, January 2018 (article)

Abstract

A simple way to mitigate the potential negative sideeffects associated with chemical lysis of a blood clot is to tear its fibrin network via mechanical rubbing using a helical robot. Here, we achieve mechanical rubbing of blood clots under ultrasound guidance and using external magnetic actuation. Position of the helical robot is determined using ultrasound feedback and used to control its motion toward the clot, whereas the volume of the clots is estimated simultaneously using visual feedback. We characterize the shear modulus and ultimate shear strength of the blood clots to predict their removal rate during rubbing. Our in vitro experiments show the ability to move the helical robot controllably toward clots using ultrasound feedback with average and maximum errors of 0.84 ± 0.41 and 2.15 mm, respectively, and achieve removal rate of -0.614 ± 0.303 mm3/min at room temperature (25 °C) and -0.482 ± 0.23 mm3/min at body temperature (37 °C), under the influence of two rotating dipole fields at frequency of 35 Hz. We also validate the effectiveness of mechanical rubbing by measuring the number of red blood cells and platelets past the clot. Our measurements show that rubbing achieves cell count of (46 ± 10.9) × 104 cell/ml, whereas the count in the absence of rubbing is (2 ± 1.41) × 104 cell/ml, after 40 min.

link (url) DOI [BibTex]

pi Khalil, I. S. M., Mahdy, D., Sharkawy, A. E., Moustafa, R. R., Tabak, A. F., Mitwally, M. E., Hesham, S., Hamdi, N., Klingner, A., Mohamed, A., Sitti, M. Mechanical Rubbing of Blood Clots Using Helical Robots Under Ultrasound Guidance IEEE Robotics and Automation Letters, 3(2):1112-1119, January 2018 (article)

link (url) DOI [BibTex]

Distributed Event-Based State Estimation for Networked Systems: An LMI Approach

Muehlebach, M., Trimpe, S.

IEEE Transactions on Automatic Control, 63(1):269-276, January 2018 (article)

am ics

arXiv (extended version) DOI Project Page [BibTex]

am ics Muehlebach, M., Trimpe, S. Distributed Event-Based State Estimation for Networked Systems: An LMI Approach IEEE Transactions on Automatic Control, 63(1):269-276, January 2018 (article)

arXiv (extended version) DOI Project Page [BibTex]

Method and device for reversibly attaching a phase changing metal to an object

Zhou Ye, G. Z. L. M. S.

US Patent Application US 2018/0021892 A1, January 2018 (patent)

Abstract

A method for reversibly attaching a phase changing metal to an object, the method comprising the steps of: providing a substrate having at least one surface at which the phase changing metal is attached, heating the phase changing metal above a phase changing temperature at which the phase changing metal changes its phase from solid to liquid, bringing the phase changing metal, when the phase changing metal is in the liquid phase or before the phase changing metal is brought into the liquid phase, into contact with the object, permitting the phase changing metal to cool below the phase changing temperature, whereby the phase changing metal becomes solid and the object and the phase changing metal become attached to each other, reheating the phase changing metal above the phase changing temperature to liquefy the phase changing metal, and removing the substrate from the object, with the phase changing metal separating from the object and remaining with the substrate.

US Patent Application Database US Patent Application (PDF) [BibTex]

pi Zhou Ye, G. Z. L. M. S. Method and device for reversibly attaching a phase changing metal to an object US Patent Application US 2018/0021892 A1, January 2018 (patent)

US Patent Application Database US Patent Application (PDF) [BibTex]

Approximate Value Iteration Based on Numerical Quadrature

Vinogradska, J., Bischoff, B., Peters, J.

IEEE Robotics and Automation Letters, 3(2):1330-1337, January 2018 (article)

DOI Project Page [BibTex]

ei Vinogradska, J., Bischoff, B., Peters, J. Approximate Value Iteration Based on Numerical Quadrature IEEE Robotics and Automation Letters, 3(2):1330-1337, January 2018 (article)

DOI Project Page [BibTex]

Biomimetic Tactile Sensors and Signal Processing with Spike Trains: A Review

Yi, Z., Zhang, Y., Peters, J.

Sensors and Actuators A: Physical, 269, pages: 41-52, January 2018 (article)

DOI Project Page [BibTex]

ei Yi, Z., Zhang, Y., Peters, J. Biomimetic Tactile Sensors and Signal Processing with Spike Trains: A Review Sensors and Actuators A: Physical, 269, pages: 41-52, January 2018 (article)

DOI Project Page [BibTex]

Measurement of Spectral Functions of Ultracold Atoms in Disordered Potentials

Volchkov, V., Pasek, M., Denechaud, V., Mukhtar, M., Aspect, A., Delande, D., Josse, V.

Physical Review Letters, 120, pages: 060404, American Physical Society (APS), January 2018 (article)

Abstract

We report on the measurement of the spectral functions of noninteracting ultracold atoms in a three-dimensional disordered potential resulting from an optical speckle field. Varying the disorder strength by 2 orders of magnitude, we observe the crossover from the “quantum” perturbative regime of low disorder to the “classical” regime at higher disorder strength, and find an excellent agreement with numerical simulations. The method relies on the use of state-dependent disorder and the controlled transfer of atoms to create well-defined energy states. This opens new avenues for experimental investigations of three-dimensional Anderson localization.

DOI [BibTex]

sf Volchkov, V., Pasek, M., Denechaud, V., Mukhtar, M., Aspect, A., Delande, D., Josse, V. Measurement of Spectral Functions of Ultracold Atoms in Disordered Potentials Physical Review Letters, 120, pages: 060404, American Physical Society (APS), January 2018 (article)

DOI [BibTex]

Method of fabricating a shape-changeable magentic member, method of producing a shape changeable magnetic member and shape changeable magnetic member

Guo Zhan Lum, Z. Y. M. S.

US Patent Application US 2018/0012693 A1, January 2018 (patent)

Abstract

The present invention relates to a method of fabricating a shape-changeable magnetic member comprising a plurality of segments with each segment being able to be magnetized with a desired magnitude and orientation of magnetization, to a method of producing a shape changeable magnetic member composed of a plurality of segments and to a shape changeable magnetic member.

US Patent Application Database US Patent Application (PDF) [BibTex]

pi Guo Zhan Lum, Z. Y. M. S. Method of fabricating a shape-changeable magentic member, method of producing a shape changeable magnetic member and shape changeable magnetic member US Patent Application US 2018/0012693 A1, January 2018 (patent)

US Patent Application Database US Patent Application (PDF) [BibTex]

Memristor-enhanced humanoid robot control system–Part I: theory behind the novel memcomputing paradigm

Ascoli, A., Baumann, D., Tetzlaff, R., Chua, L. O., Hild, M.

International Journal of Circuit Theory and Applications, 46(1):155-183, 2018 (article)

DOI [BibTex]

am Ascoli, A., Baumann, D., Tetzlaff, R., Chua, L. O., Hild, M. Memristor-enhanced humanoid robot control system–Part I: theory behind the novel memcomputing paradigm International Journal of Circuit Theory and Applications, 46(1):155-183, 2018 (article)

DOI [BibTex]

Impact of the AIF Recording Method on Kinetic Parameters in Small Animal PET

Napieczynska, H., Kolb, A., Katiyar, P., Tonietto, M., Ud-Dean, M., Stumm, R., Herfert, K., Calaminus, C., Pichler, B.

Journal of Nuclear Medicine, 2018 (article)

DOI [BibTex]

ei Napieczynska, H., Kolb, A., Katiyar, P., Tonietto, M., Ud-Dean, M., Stumm, R., Herfert, K., Calaminus, C., Pichler, B. Impact of the AIF Recording Method on Kinetic Parameters in Small Animal PET Journal of Nuclear Medicine, 2018 (article)

DOI [BibTex]

RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials

Paschalidou, D., Ulusoy, A. O., Schmitt, C., Gool, L., Geiger, A.

In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2018, 2018 (inproceedings)

Abstract

In this paper, we consider the problem of reconstructing a dense 3D model using images captured from different views. Recent methods based on convolutional neural networks (CNN) allow learning the entire task from data. However, they do not incorporate the physics of image formation such as perspective geometry and occlusion. Instead, classical approaches based on Markov Random Fields (MRF) with ray-potentials explicitly model these physical processes, but they cannot cope with large surface appearance variations across different viewpoints. In this paper, we propose RayNet, which combines the strengths of both frameworks. RayNet integrates a CNN that learns view-invariant feature representations with an MRF that explicitly encodes the physics of perspective projection and occlusion. We train RayNet end-to-end using empirical risk minimization. We thoroughly evaluate our approach on challenging real-world datasets and demonstrate its benefits over a piece-wise trained baseline, hand-crafted models as well as other learning-based approaches.

avg

pdf suppmat Video Project Page code Poster Project Page [BibTex]

avg Paschalidou, D., Ulusoy, A. O., Schmitt, C., Gool, L., Geiger, A. RayNet: Learning Volumetric 3D Reconstruction with Ray Potentials In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2018, 2018 (inproceedings)

pdf suppmat Video Project Page code Poster Project Page [BibTex]

End-to-end Recovery of Human Shape and Pose

Kanazawa, A., Black, M. J., Jacobs, D. W., Malik, J.

Abstract

We describe Human Mesh Recovery (HMR), an end-to-end framework for reconstructing a full 3D mesh of a human body from a single RGB image. In contrast to most current methods that compute 2D or 3D joint locations, we produce a richer and more useful mesh representation that is parameterized by shape and 3D joint angles. The main objective is to minimize the reprojection loss of keypoints, which allows our model to be trained using in-the-wild images that only have ground truth 2D annotations. However, the reprojection loss alone is highly underconstrained. In this work we address this problem by introducing an adversary trained to tell whether human body shape and pose parameters are real or not using a large database of 3D human meshes. We show that HMR can be trained with and without using any paired 2D-to-3D supervision. We do not rely on intermediate 2D keypoint detections and infer 3D pose and shape parameters directly from image pixels. Our model runs in real-time given a bounding box containing the person. We demonstrate our approach on various images in-the-wild and out-perform previous optimization-based methods that output 3D meshes and show competitive results on tasks such as 3D joint location estimation and part segmentation.

pdf code project video Project Page [BibTex]

ps Kanazawa, A., Black, M. J., Jacobs, D. W., Malik, J. End-to-end Recovery of Human Shape and Pose In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), IEEE Computer Society, IEEE International Conference on Computer Vision and Pattern Recognition (CVPR) 2018, 2018 (inproceedings)

pdf code project video Project Page [BibTex]

The TUM VI Benchmark for Evaluating Visual-Inertial Odometry

Schubert, D., Goll, T., Demmel, N., Usenko, V., Stueckler, J., Cremers, D.

In IEEE International Conference on Intelligent Robots and Systems (IROS), 2018, arXiv:1804.06120 (inproceedings)

MPI Papers

Departments

Research Groups

Publication Type

Year

2018

2018

Latest News

Links

Contact Us