Endo-VMFuseNet: A deep visual-magnetic sensor fusion approach for endoscopic capsule robots
Document Type
Conference Proceeding
Publication Date
9-10-2018
Abstract
In the last decade, researchers and medical device companies have made major advances towards transforming passive capsule endoscopes into active medical robots. One of the major challenges is to endow capsule robots with accurate perception of the environment inside the human body, which will provide necessary information and enable improved medical procedures. We extend the success of deep learning approaches from various research fields to the problem of sensor fusion for endoscopic capsule robots in the case of asynchronous and asymmetric sensor data without any need of calibration between sensors. The results performed on real pig stomach datasets show that our method achieves high precision for both translational and rotational movements and contains various advantages over traditional sensor fusion techniques.
Publication Source (Journal or Book title)
Proceedings - IEEE International Conference on Robotics and Automation
First Page
5386
Last Page
5392
Recommended Citation
Turan, M., Almalioglu, Y., Gilbert, H., Sari, A., Soylu, U., & Sitti, M. (2018). Endo-VMFuseNet: A deep visual-magnetic sensor fusion approach for endoscopic capsule robots. Proceedings - IEEE International Conference on Robotics and Automation, 5386-5392. https://doi.org/10.1109/ICRA.2018.8461129