Shape and motion from image streams under orthography: a factorization method
International Journal of Computer Vision
Multiple view geometry in computer visiond
Multiple view geometry in computer visiond
Computer and Robot Vision
Linear and Incremental Acquisition of Invariant Shape Models From Image Sequences
IEEE Transactions on Pattern Analysis and Machine Intelligence
A Factorization Based Algorithm for Multi-Image Projective Structure and Motion
ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume II - Volume II
Color Edge Detection by Photometric Quasi-Invariants
ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
An Invitation to 3-D Vision: From Images to Geometric Models
An Invitation to 3-D Vision: From Images to Geometric Models
Real-Time Imaging - Special issue on multi-dimensional image processing
International Journal of Robotics Research
Visual tracking of surgical tools for proximity detection in retinal surgery
IPCAI'11 Proceedings of the Second international conference on Information processing in computer-assisted interventions
Feature classification for tracking articulated surgical tools
MICCAI'12 Proceedings of the 15th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part II
Stereoscopic visualization of laparoscope image using depth information from 3D model
Computer Methods and Programs in Biomedicine
| Hi-index | 0.00 |
This paper presents an endoscopic vision framework for model-based 3D guidance of surgical instruments used in robotized laparoscopic surgery. In order to develop such a system, a variety of challenging segmentation, tracking and reconstruction problems must be solved. With this minimally invasive surgical technique, every single instrument has to pass through an insertion point in the abdominal wall and is mounted on the end-effector of a surgical robot which can be controlled by automatic visual feedback. The motion of any laparoscopic instrument is then constrained and the goal of the automated task is to safety bring instruments at desired locations while avoiding undesirable contact with internal organs. For this "eye-to-hands" configuration with a stationary camera, most control strategies require the knowledge of the out-of-field of view insertion points location and we demonstrate it can be achieved in vivo thanks to a sequence of (instrument) motions without markers and without the need of an external measurement device. In so doing, we firstly present a real-time region-based color segmentation which integrates this motion constraint to initiate the search for region seeds. Secondly, a novel pose algorithm for the wide class of cylindrical-shaped instruments is developed which can handle partial occlusions as it is often the case in the abdominal cavity. The foreseen application is a good training ground to evaluate the robustness of segmentation algorithms and positioning techniques since main difficulties came from the scene understanding and its dynamical variations. Experiments in the lab and in real surgical conditions have been conducted. The experimental validation is demonstrated through the 3D positioning of instruments' axes (4 DOFs) which must lead to motionless insertion points disturbed by the breathing motion.