On-line recognition of surgical activity for monitoring in the operating room

  • Authors:
  • N. Padoy;T. Blum;H. Feussner;M-O. Berger;N. Navab

  • Affiliations:
  • Technische Universität München, Fakultät für Informatik, Garching bei München, Germany and LORIA-INRIA Lorraine, Vandoeuvre-lès-Nancy Cedex, France;Technische Universität München, Fakultät für Informatik, Garching bei München, Germany;Klinikum Rechts der Isar, Chirurgische Klinik und Poliklinik, München, Germany;LORIA-INRIA Lorraine, Vandoeuvre-lès-Nancy Cedex, France;Technische Universität München, Fakultät für Informatik, Garching bei München, Germany

  • Venue:
  • IAAI'08 Proceedings of the 20th national conference on Innovative applications of artificial intelligence - Volume 3
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Surgery rooms are complex environments where many interactions take place between staff members and the electronic and mechanical systems. In spite of their inherent complexity, surgeries of the same kind bear numerous similarities and are usually performed with similar workftows. This gives the possibility to design support systems in the Operating Room (OR), whose applicability range from easy tasks such as the activation of OR lights and calling the next patient, to more complex ones such as context-sensitive user interfaces or automatic reporting. An essential feature when designing such systems, is the ability for on-line recognition of what is happening inside the OR, based on recorded signals. In this paper, we present an approach using signals from the OR and Hidden Markov Models to recognize on-line the surgical steps performed by the surgeon during a laparoscopic surgery. We also explain how the system can be deployed in the OR. Experiments are presented using 11 real surgeries performed by different surgeons in several ORs, recorded at our partner hospital. We believe that similar systems will quickly develop in the near future in order to efficiently support surgeons, trainees and the medical staff in general, as well as to improve administrative tasks like scheduling within hospitals.