Publications

DEPARTMENTS

Emperical Interference

Haptic Intelligence

Modern Magnetic Systems

Perceiving Systems

Physical Intelligence

Robotic Materials

Social Foundations of Computation


Research Groups

Autonomous Vision

Autonomous Learning

Bioinspired Autonomous Miniature Robots

Dynamic Locomotion

Embodied Vision

Human Aspects of Machine Learning

Intelligent Control Systems

Learning and Dynamical Systems

Locomotion in Biorobotic and Somatic Systems

Micro, Nano, and Molecular Systems

Movement Generation and Control

Neural Capture and Synthesis

Physics for Inference and Optimization

Organizational Leadership and Diversity

Probabilistic Learning Group


Topics

Robot Learning

Conference Paper

2022

Autonomous Learning

Robotics

AI

Career

Award


Physical Intelligence Intelligent Control Systems Conference Paper Learning of sub-optimal gait controllers for magnetic walking soft millirobots Culha, U., Demir, S. O., Trimpe, S., Sitti, M. In Robotics: Science and Systems XVI, P070, (Editors: Toussaint, Marc and Bicchi, Antonio and Hermans, Tucker), RSS Foundation, Robotics: Science and Systems 2020 (RSS 2020), July 2020 (Published)
Untethered small-scale soft robots have promising applications in minimally invasive surgery, targeted drug delivery, and bioengineering applications as they can access confined spaces in the human body. However, due to highly nonlinear soft continuum deformation kinematics, inherent stochastic variability during fabrication at the small scale, and lack of accurate models, the conventional control methods cannot be easily applied. Adaptivity of robot control is additionally crucial for medical operations, as operation environments show large variability, and robot materials may degrade or change over time,which would have deteriorating effects on the robot motion and task performance. Therefore, we propose using a probabilistic learning approach for millimeter-scale magnetic walking soft robots using Bayesian optimization (BO) and Gaussian processes (GPs). Our approach provides a data-efficient learning scheme to find controller parameters while optimizing the stride length performance of the walking soft millirobot robot within a small number of physical experiments. We demonstrate adaptation to fabrication variabilities in three different robots and to walking surfaces with different roughness. We also show an improvement in the learning performance by transferring the learning results of one robot to the others as prior information.
DOI URL BibTeX

Physical Intelligence Miscellaneous Simultaneous calibration method for magnetic locialization and actuation systems Sitti, M., Son, D., Dong, X. June 2020, US Patent App. 16/696,605
The invention relates to a method of simultaneously calibrating magnetic actuation and sensing systems for a workspace, wherein the actuation system comprises a plurality of magnetic actuators and the sensing system comprises a plurality of magnetic sensors, wherein all the measured data is fed into a calibration model, wherein the calibration model is based on a sensor measurement model and a magnetic actuation model, and wherein a solution of the model parameters is found via a numerical solver order to calibrate both the actuation and sensing systems at the same time.
BibTeX

Physical Intelligence Article Statistical reprogramming of macroscopic self-assembly with dynamic boundaries Culha, U., Davidson, Z. S., Mastrangeli, M., Sitti, M. Proceedings of the National Academy of Sciences, 117(21):11306-11313, May 2020 (Published)
Self-assembly is a ubiquitous process that can generate complex and functional structures via local interactions among a large set of simpler components. The ability to program the self-assembly pathway of component sets elucidates fundamental physics and enables alternative competitive fabrication technologies. Reprogrammability offers further opportunities for tuning structural and material properties but requires reversible selection from multistable self-assembling patterns, which remains a challenge. Here, we show statistical reprogramming of two-dimensional (2D), noncompact self-assembled structures by the dynamic confinement of orbitally shaken and magnetically repulsive millimeter-scale particles. Under a constant shaking regime, we control the rate of radius change of an assembly arena via moving hard boundaries and select among a finite set of self-assembled patterns repeatably and reversibly. By temporarily trapping particles in topologically identified stable states, we also demonstrate 2D reprogrammable stiffness and three-dimensional (3D) magnetic clutching of the self-assembled structures. Our reprogrammable system has prospective implications for the design of granular materials in a multitude of physical scales where out-of-equilibrium self-assembly can be realized with different numbers or types of particles. Our dynamic boundary regulation may also enable robust bottom-up control strategies for novel robotic assembly applications by designing more complex spatiotemporal interactions using mobile robots.
DOI BibTeX

Physical Intelligence Patent Gripping apparatus and method of producing a gripping apparatus Song, S., Sitti, M., Drotlef, D., Majidi, C. Google Patents, February 2020, US Patent App. 16/610,209
The present invention relates to a gripping apparatus comprising a membrane; a flexible housing; with said membrane being fixedly connected to a periphery of the housing. The invention further relates to a method of producing a gripping apparatus.
BibTeX

Physical Intelligence Patent Method and device for reversibly attaching a phase changing metal to an object Zhou Ye, G. Z. L. M. S. US Patent Application 10675718, January 2020
A method for reversibly attaching a phase changing metal to an object, the method comprising the steps of: providing a substrate having at least one surface at which the phase changing metal is attached, heating the phase changing metal above a phase changing temperature at which the phase changing metal changes its phase from solid to liquid, bringing the phase changing metal, when the phase changing metal is in the liquid phase or before the phase changing metal is brought into the liquid phase, into contact with the object, permitting the phase changing metal to cool below the phase changing temperature, whereby the phase changing metal becomes solid and the object and the phase changing metal become attached to each other, reheating the phase changing metal above the phase changing temperature to liquefy the phase changing metal, and removing the substrate from the object, with the phase changing metal separating from the object and remaining with the substrate.
US Patent Application Database US Patent Application (PDF) URL BibTeX

Physical Intelligence Bioinspired Autonomous Miniature Robots Patent Method of actuating a shape changeable member, shape changeable member and actuating system Hu, W., Lum, G. Z., Mastrangeli, M., Sitti, M. Google Patents, January 2020, US Patent App. 16/477,593
The present invention relates to a method of actuating a shape changeable member of actuatable material. The invention further relates to a shape changeable member and to a system comprising such a shape changeable member and a magnetic field apparatus.
BibTeX

Physical Intelligence Patent Method of fabricating a shape-changeable magentic member, method of producing a shape changeable magnetic member and shape changeable magnetic member Guo Zhan Lum, Z. Y. M. S. US Patent Application 16845646, January 2020
The present invention relates to a method of fabricating a shape-changeable magnetic member comprising a plurality of segments with each segment being able to be magnetized with a desired magnitude and orientation of magnetization, to a method of producing a shape changeable magnetic member composed of a plurality of segments and to a shape changeable magnetic member.
US Patent Application Database US Patent Application (PDF) BibTeX

Physical Intelligence Article Acoustically powered surface-slipping mobile microrobots Aghakhani, A., Yasa, O., Wrede, P., Sitti, M. Proceedings of the National Academy of Sciences, 117(7):3469-3477, 2020
Untethered synthetic microrobots have significant potential to revolutionize minimally invasive medical interventions in the future. However, their relatively slow speed and low controllability near surfaces typically are some of the barriers standing in the way of their medical applications. Here, we introduce acoustically powered microrobots with a fast, unidirectional surface-slipping locomotion on both flat and curved surfaces. The proposed three-dimensionally printed, bullet-shaped microrobot contains a spherical air bubble trapped inside its internal body cavity, where the bubble is resonated using acoustic waves. The net fluidic flow due to the bubble oscillation orients the microrobot's axisymmetric axis perpendicular to the wall and then propels it laterally at very high speeds (up to 90 body lengths per second with a body length of 25 µm) while inducing an attractive force toward the wall. To achieve unidirectional locomotion, a small fin is added to the microrobot’s cylindrical body surface, which biases the propulsion direction. For motion direction control, the microrobots are coated anisotropically with a soft magnetic nanofilm layer, allowing steering under a uniform magnetic field. Finally, surface locomotion capability of the microrobots is demonstrated inside a three-dimensional circular cross-sectional microchannel under acoustic actuation. Overall, the combination of acoustic powering and magnetic steering can be effectively utilized to actuate and navigate these microrobots in confined and hard-to-reach body location areas in a minimally invasive fashion.
DOI BibTeX

Physical Intelligence Article Additive manufacturing of cellulose-based materials with continuous, multidirectional stiffness gradients Giachini, P. A. G. S., Gupta, S. S., Wang, W., Wood, D., Yunusa, M., Baharlou, E., Sitti, M., Menges, A. Science Advances, 6(8):eaay0929, 2020
Functionally graded materials (FGMs) enable applications in fields such as biomedicine and architecture, but their fabrication suffers from shortcomings in gradient continuity, interfacial bonding, and directional freedom. In addition, most commercial design software fail to incorporate property gradient data, hindering explorations of the design space of FGMs. Here, we leveraged a combined approach of materials engineering and digital processing to enable extrusion-based multimaterial additive manufacturing of cellulose-based tunable viscoelastic materials with continuous, high-contrast, and multidirectional stiffness gradients. A method to engineer sets of cellulose-based materials with similar compositions, yet distinct mechanical and rheological properties, was established. In parallel, a digital workflow was developed to embed gradient information into design models with integrated fabrication path planning. The payoff of integrating these physical and digital tools is the ability to achieve the same stiffness gradient in multiple ways, opening design possibilities previously limited by the rigid coupling of material and geometry.
DOI BibTeX

Physical Intelligence Article Bioinspired underwater locomotion of light-driven liquid crystal gels Shahsavan, H., Aghakhani, A., Zeng, H., Guo, Y., Davidson, Z. S., Priimagi, A., Sitti, M. Proceedings of the National Academy of Sciences, 117(10):5125-5133, 2020
Untethered dynamic shape programming and control of soft materials have significant applications in technologies such as soft robots, medical devices, organ-on-a-chip, and optical devices. Here, we present a solution to remotely actuate and move soft materials underwater in a fast, efficient, and controlled manner using photoresponsive liquid crystal gels (LCGs). LCG constructs with engineered molecular alignment show a low and sharp phase-transition temperature and experience considerable density reduction by light exposure, thereby allowing rapid and reversible shape changes. We demonstrate different modes of underwater locomotion, such as crawling, walking, jumping, and swimming, by localized and time-varying illumination of LCGs. The diverse locomotion modes of smart LCGs can provide a new toolbox for designing efficient light-fueled soft robots in fluid-immersed media.
DOI BibTeX

Physical Intelligence Article Carbon nitride-based light-driven microswimmers with intrinsic photocharging ability Sridhar, V., Podjaski, F., Kröger, J., Jiménez-Solano, A., Park, B., Lotsch, B. V., Sitti, M. Proceedings of the National Academy of Sciences, 117(40):24748-24756, 2020 DOI URL BibTeX

Physical Intelligence Article Controlling two-dimensional collective formation and cooperative behavior of magnetic microrobot swarms Dong, X., Sitti, M. The International Journal of Robotics Research, 39(5):617-638, 2020
Magnetically actuated mobile microrobots can access distant, enclosed, and small spaces, such as inside microfluidic channels and the human body, making them appealing for minimally invasive tasks. Despite their simplicity when scaling down, creating collective microrobots that can work closely and cooperatively, as well as reconfigure their formations for different tasks, would significantly enhance their capabilities such as manipulation of objects. However, a challenge of realizing such cooperative magnetic microrobots is to program and reconfigure their formations and collective motions with under-actuated control signals. This article presents a method of controlling 2D static and time-varying formations among collective self-repelling ferromagnetic microrobots (100 μm to 350 μm in diameter, up to 260 in number) by spatially and temporally programming an external magnetic potential energy distribution at the air–water interface or on solid surfaces. A general design method is introduced to program external magnetic potential energy using ferromagnets. A predictive model of the collective system is also presented to predict the formation and guide the design procedure. With the proposed method, versatile complex static formations are experimentally demonstrated and the programmability and scaling effects of formations are analyzed. We also demonstrate the collective mobility of these magnetic microrobots by controlling them to exhibit bio-inspired collective behaviors such as aggregation, directional motion with arbitrary swarm headings, and rotational swarming motion. Finally, the functions of the produced microrobotic swarm are demonstrated by controlling them to navigate through cluttered environments and complete reconfigurable cooperative manipulation tasks.
DOI BibTeX

Physical Intelligence Conference Paper Design and Development of a Lorentz Force-Based MRI-Driven Neuroendoscope Phelan III, M. F., Dogan, N. O., Lazovic, J., Sitti, M. In 2022 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 9534-9541, 2020 DOI BibTeX

Physical Intelligence Article Emerging paradigm against global antimicrobial resistance via bioprospecting of mushroom into novel nanotherapeutics development Pandey, A. T., Pandey, I., Hachenberger, Y., Krause, B., Haidar, R., Laux, P., Luch, A., Singh, M. P., Singh, A. V. Trends in Food Science \& Technology, 106:333-344, 2020 DOI BibTeX

Physical Intelligence Article Introducing progress in biomedical engineering; issue 2 vol 2 Sitti, M. Progress in Biomedical Engineering, 2(2):020201, IOP Publishing, 2020 DOI URL BibTeX

Physical Intelligence Article Magnetic resonance imaging system-driven medical robotics Erin, O., Boyvat, M., Tiryaki, M. E., Phelan, M., Sitti, M. Advanced Intelligent Systems, 2(2):1900110, 2020
Magnetic resonance imaging (MRI) system–driven medical robotics is an emerging field that aims to use clinical MRI systems not only for medical imaging but also for actuation, localization, and control of medical robots. Submillimeter scale resolution of MR images for soft tissues combined with the electromagnetic gradient coil–based magnetic actuation available inside MR scanners can enable theranostic applications of medical robots for precise image‐guided minimally invasive interventions. MRI‐driven robotics typically does not introduce new MRI instrumentation for actuation but instead focuses on converting already available instrumentation for robotic purposes. To use the advantages of this technology, various medical devices such as untethered mobile magnetic robots and tethered active catheters have been designed to be powered magnetically inside MRI systems. Herein, the state‐of‐the‐art progress, challenges, and future directions of MRI‐driven medical robotic systems are reviewed.
DOI BibTeX

Physical Intelligence Article Microribbons composed of directionally self-assembled nanoflakes as highly stretchable ionic neural electrodes Zhang, M., Guo, R., Chen, K., Wang, Y., Niu, J., Guo, Y., Zhang, Y., Yin, Z., Xia, K., Zhou, B., Wang, H., He, W., Liu, J., Sitti, M., Zhang, Y. Proceedings of the National Academy of Sciences, 117(26):14667-14675, 2020 DOI URL BibTeX

Physical Intelligence Article Modal analysis of finite-size piezoelectric metamaterial plates Aghakhani, A., Murat Gozum, M., Basdogan, I. Journal of Physics D: Applied Physics, 53(50):505304, 2020 DOI URL BibTeX

Physical Intelligence Article Multiwavelength-steerable visible-light-driven magnetic CoO-TiO2 microswimmers Sridhar, V., Park, B., Guo, S., van Aken, P. A., Sitti, M. ACS Applied Materials & Interfaces, 12(21):24149-24155, 2020 DOI BibTeX

Physical Intelligence Article Paper-based microchip electrophoresis for point-of-care hemoglobin testing Hasan, M. N., Fraiwan, A., An, R., Alapan, Y., Ung, R., Akkus, A., Xu, J. Z., Rezac, A. J., Kocmich, N. J., Creary, M. S., Oginni, T., Olanipekun, G. M., Hassan-Hanga, F., Jibir, B. W., Gambo, S., Verma, A. K., Bharti, P. K., Riolueang, S., Ngimhung, T., Suksangpleng, T., et al. The Analyst, 145(7):2525-2542, 2020
We present a versatile, mass-producible, paper-based microchip electrophoresis platform that enables rapid, affordable, decentralized hemoglobin testing at the point-of-care. , Nearly 7\% of the world's population live with a hemoglobin variant. Hemoglobins S, C, and E are the most common and significant hemoglobin variants worldwide. Sickle cell disease, caused by hemoglobin S, is highly prevalent in sub-Saharan Africa and in tribal populations of Central India. Hemoglobin C is common in West Africa, and hemoglobin E is common in Southeast Asia. Screening for significant hemoglobin disorders is not currently feasible in many low-income countries with the high disease burden. Lack of early diagnosis leads to preventable high morbidity and mortality in children born with hemoglobin variants in low-resource settings. Here, we describe HemeChip, the first miniaturized, paper-based, microchip electrophoresis platform for identifying the most common hemoglobin variants easily and affordably at the point-of-care in low-resource settings. HemeChip test works with a drop of blood. HemeChip system guides the user step-by-step through the test procedure with animated on-screen instructions. Hemoglobin identification and quantification is automatically performed, and hemoglobin types and percentages are displayed in an easily understandable, objective way. We show the feasibility and high accuracy of HemeChip via testing 768 subjects by clinical sites in the United States, Central India, sub-Saharan Africa, and Southeast Asia. Validation studies include hemoglobin E testing in Bangkok, Thailand, and hemoglobin S testing in Chhattisgarh, India, and in Kano, Nigeria, where the sickle cell disease burden is the highest in the world. Tests were performed by local users, including healthcare workers and clinical laboratory personnel. Study design, methods, and results are presented according to the Standards for Reporting Diagnostic Accuracy (STARD). HemeChip correctly identified all subjects with hemoglobin S, C, and E variants with 100\% sensitivity, and displayed an overall diagnostic accuracy of 98.4\% in comparison to reference standard methods. HemeChip is a versatile, mass-producible microchip electrophoresis platform that addresses a major unmet need of decentralized hemoglobin analysis in resource-limited settings.
DOI URL BibTeX

Physical Intelligence Article Poly(ethylene glycol)–poly(beta-amino ester)-based nanoparticles for suicide gene therapy enhance brain penetration and extend survival in a preclinical human glioblastoma orthotopic xenograft model Kim, J., Mondal, S. K., Tzeng, S. Y., Rui, Y., Al-kharboosh, R., Kozielski, K. K., Bhargav, A. G., Garcia, C. A., Quiñones-Hinojosa, A., Green, J. J. ACS Biomaterials Science & Engineering, 6(5):2943-2955, 2020 DOI URL BibTeX

Physical Intelligence Article Pros and cons: magnetic versus optical microrobots Sitti, M., Wiersma, D. S. Advanced Materials, 32(20):1906766, 2020
Mobile microrobotics has emerged as a new robotics field within the last decade to create untethered tiny robots that can access and operate in unprecedented, dangerous, or hard‐to‐reach small spaces noninvasively toward disruptive medical, biotechnology, desktop manufacturing, environmental remediation, and other potential applications. Magnetic and optical actuation methods are the most widely used actuation methods in mobile microrobotics currently, in addition to acoustic and biological (cell‐driven) actuation approaches. The pros and cons of these actuation methods are reported here, depending on the given context. They can both enable long‐range, fast, and precise actuation of single or a large number of microrobots in diverse environments. Magnetic actuation has unique potential for medical applications of microrobots inside nontransparent tissues at high penetration depths, while optical actuation is suitable for more biotechnology, lab‐/organ‐on‐a‐chip, and desktop manufacturing types of applications with much less surface penetration depth requirements or with transparent environments. Combining both methods in new robot designs can have a strong potential of combining the pros of both methods. There is still much progress needed in both actuation methods to realize the potential disruptive applications of mobile microrobots in real‐world conditions.
DOI BibTeX

Physical Intelligence Article Recent advances in plant nanobionics and nanobiosensors for toxicology applications Ansari, M. H., Lavhale, S., Kalunke, R. M., Srivastava, P. L., Pandit, V., Gade, S., Yadav, S., Laux, P., Luch, A., Gemmati, D., others, Current Nanoscience, 16(1):27-41, 2020 DOI BibTeX

Physical Intelligence Article Reconfigurable multifunctional ferrofluid droplet robots Fan, X., Dong, X., Karacakol, A. C., Xie, H., Sitti, M. Proceedings of the National Academy of Sciences, 117(45):27916-27926, 2020 DOI URL BibTeX

Physical Intelligence Article Selection for function: from chemically synthesized prototypes to 3D-printed microdevices Bachmann, F., Giltinan, J., Codutti, A., Klumpp, S., Sitti, M., Faivre, D. Advanced Intelligent Systems, 2(10):2000078, 2020 DOI BibTeX

Physical Intelligence Article Selectively controlled magnetic microrobots with opposing helices Giltinan, J., Katsamba, P., Wang, W., Lauga, E., Sitti, M. Applied Physics Letters, 116(13):134101, 2020 (Published) DOI BibTeX

Physical Intelligence Article Sperm Cell Driven Microrobots-Emerging Opportunities and Challenges for Biologically Inspired Robotic Design Singh, A. V., Ansari, M. H. D., Mahajan, M., Srivastava, S., Kashyap, S., Dwivedi, P., Pandit, V., Katha, U. Micromachines, 11(4):448, 2020 DOI BibTeX