Non-negative Matrix Factorization for Endoscopic Video Summarization

  • Authors:
  • Spyros Tsevas;Dimitris Iakovidis;Dimitris Maroulis;Emmanuel Pavlakis;Andreas Polydorou

  • Affiliations:
  • Dept. of Informatics and Telecommunications, University of Athens, Panepistimiopolis, Athens, Greece GR-15784;Dept. of Informatics and Telecommunications, University of Athens, Panepistimiopolis, Athens, Greece GR-15784;Dept. of Informatics and Telecommunications, University of Athens, Panepistimiopolis, Athens, Greece GR-15784;Department of Surgery, Aretaieion Hospital, Athens, Greece 115 27;Department of Surgery, Aretaieion Hospital, Athens, Greece 115 27

  • Venue:
  • SETN '08 Proceedings of the 5th Hellenic conference on Artificial Intelligence: Theories, Models and Applications
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

Wireless Capsule Endoscopy (WCE) has been introduced as a non-invasive colour imaging technique for the inspection of the small intestin along with the rest of the gastrointestinal tract. Each WCE examination results in a 50,000-frames video that has to be visually inspected frame-by-frame by the doctor and this may be a highly time-consuming task even for the experienced gastroenterologist. In this paper we propose a novel approach that leads to a summarized version of the original video enabling significant reduction in the video assessment time without losing any critical information. It is based on symmetric non-negative matrix factorisation initialized by the fuzzy c-means algorithm and it is supported by non-negative Lagrangian relaxation to extract a subset of video frames containing the most representative scenes from an entire examination. The experimental evaluation of the proposed approach was performed using previously annotated endoscopic videos from various sites of the small intestine.