The role of insertion points in the detection and positioning of instruments in laparoscopy for robotic tasks

Authors:
Christophe Doignon;Florent Nageotte;Michel de Mathelin
Affiliations:
Control, Vision and Robotic Team, LSIIT (UMR ULP-CNRS 7005), University of Strasbourg, France;Control, Vision and Robotic Team, LSIIT (UMR ULP-CNRS 7005), University of Strasbourg, France;Control, Vision and Robotic Team, LSIIT (UMR ULP-CNRS 7005), University of Strasbourg, France
Venue:
MICCAI'06 Proceedings of the 9th international conference on Medical Image Computing and Computer-Assisted Intervention - Volume Part I
Year:
2006

Citing 2
Cited 2

Multiple view geometry in computer visiond

Multiple view geometry in computer visiond
Real-time segmentation of surgical instruments inside the abdominal cavity using a joint hue saturation color feature

Real-Time Imaging - Special issue on multi-dimensional image processing

Stitching Planning in Laparoscopic Surgery: Towards Robot-assisted Suturing

International Journal of Robotics Research
Analysis and improvement of image-based insertion point estimation for robot-assisted minimally invasive surgery

ICRA'09 Proceedings of the 2009 IEEE international conference on Robotics and Automation

Quantified Score

Hi-index	0.01

Visualization

Abstract

In robot-assisted laparoscopic surgery, an endoscopic camera is used to control the motion of surgical instruments. With this minimally invasive surgical (MIS) technique, every instrument has to pass through an insertion point in the abdominal wall and is mounted on the end-effector of a surgical robot which can be controlled by visual feedback. To achieve an accurate vision-based positioning of laparoscopic instruments, we introduce the motion constraint in MIS which is based on the location of out-of-field of view insertion points. The knowledge of the (image of the) insertion point location is helpful for real-time image segmentation issues, particularly to initiate the search for region seeds corresponding to the instruments. Moreover, with this ”eye-to-hand” robot vision system, visual servoing is a very convenient technique to automatically guide an instrument but it requires the velocity screw to be expressed in the appropriate frame. Then, the location of the insertion point is seen as the main part of the larger problem of determining the overall transformation between the camera and the robot end-effector frame. This is achieved thanks to a novel algorithm for the pose determination of cylindrical-shaped instruments. With the proposed method, the location of insertion points can be recovered, on-line, with no marker, without any knowledge of robot kinematics and without an external measurement device.