Hand segmentation for gesture recognition in EGO-vision

  • Authors:
  • Giuseppe Serra;Marco Camurri;Lorenzo Baraldi;Michela Benedetti;Rita Cucchiara

  • Affiliations:
  • Università degli Studi di Modena e Reggio Emilia, Modena - Italy;Università degli Studi di Modena e Reggio Emilia, Modena - Italy;Università degli Studi di Modena e Reggio Emilia, Modena - Italy;Università degli Studi di Modena e Reggio Emilia, Modena - Italy;Università degli Studi di Modena e Reggio Emilia, Modena - Italy

  • Venue:
  • Proceedings of the 3rd ACM international workshop on Interactive multimedia on mobile & portable devices
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Portable devices for first-person camera views will play a central role in future interactive systems. One necessary step for feasible human-computer guided activities is gesture recognition, preceded by a reliable hand segmentation from egocentric vision. In this work we provide a novel hand segmentation algorithm based on Random Forest superpixel classification that integrates light, time and space consistency. We also propose a gesture recognition method based Exemplar SVMs since it requires a only small set of positive sampels, hence it is well suitable for the egocentric video applications. Furthermore, this method is enhanced by using segmented images instead of full frames during test phase. Experimental results show that our hand segmentation algorithm outperforms the state-of-the-art approaches and improves the gesture recognition accuracy on both the publicly available EDSH dataset and our dataset designed for cultural heritage applications.