Physical Intelligence Article 2017

EndoSensorFusion: Particle Filtering-Based Multi-sensory Data Fusion with Switching State-Space Model for Endoscopic Capsule Robots

Thumb ticker sm mehmet
Physical Intelligence
  • Postdoctoral Researcher
Thumb ticker sm josh2
Physical Intelligence
Research Scientist, Fraunhofer USA Center for Experimental Software Engineering, USA
Thumb ticker sm metin eth vertical small
Physical Intelligence
Guest Researcher
Publications toc

A reliable, real time multi-sensor fusion functionality is crucial for localization of actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we propose a novel multi-sensor fusion approach based on a particle filter that incorporates an online estimation of sensor reliability and a non-linear kinematic model learned by a recurrent neural network. Our method sequentially estimates the true robot pose from noisy pose observations delivered by multiple sensors. We experimentally test the method using 5 degree-of-freedom (5-DoF) absolute pose measurement by a magnetic localization system and a 6-DoF relative pose measurement by visual odometry. In addition, the proposed method is capable of detecting and handling sensor failures by ignoring corrupted data, providing the robustness expected of a medical device. Detailed analyses and evaluations are presented using ex-vivo experiments on a porcine stomach model prove that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.

Author(s): Turan, M. and Almalioglu, Y. and Gilbert, H. and Araujo, H. and Cemgil, T. and Sitti, M.
Journal: ArXiv e-prints
Year: 2017
Month: September
Day: 25
Bibtex Type: Article (article)
URL: https://arxiv.org/abs/1709.03401v3
Electronic Archiving: grant_archive

BibTex

@article{2017arXiv170903401T,
  title = {EndoSensorFusion: Particle Filtering-Based Multi-sensory Data Fusion with Switching State-Space Model for Endoscopic Capsule Robots},
  journal = {ArXiv e-prints},
  abstract = {A reliable, real time multi-sensor fusion functionality is crucial for localization of actively controlled capsule endoscopy robots, which are an emerging, minimally invasive diagnostic and therapeutic technology for the gastrointestinal (GI) tract. In this study, we propose a novel multi-sensor fusion approach based on a particle filter that incorporates an online estimation of sensor reliability and a non-linear kinematic model learned by a recurrent neural network. Our method sequentially estimates the true robot pose from noisy pose observations delivered by multiple sensors. We experimentally test the method using 5 degree-of-freedom (5-DoF) absolute pose measurement by a magnetic localization system and a 6-DoF relative pose measurement by visual odometry. In addition, the proposed method is capable of detecting and handling sensor failures by ignoring corrupted data, providing the robustness expected of a medical device. Detailed analyses and evaluations are presented using ex-vivo experiments on a porcine stomach model prove that our system achieves high translational and rotational accuracies for different types of endoscopic capsule robot trajectories.},
  month = sep,
  year = {2017},
  slug = {2017arxiv170903401t},
  author = {Turan, M. and Almalioglu, Y. and Gilbert, H. and Araujo, H. and Cemgil, T. and Sitti, M.},
  url = {https://arxiv.org/abs/1709.03401v3},
  month_numeric = {9}
}