A novel approach for gesture control video games based on perceptual features: modelling, tracking and recognition

  • Authors:
  • Gang Hu;Qigang Gao

  • Affiliations:
  • Faculty of Computer Science, Dalhousie University, 6050 University Avenue, Halifax, NS, B3H 1W5, Canada.;Faculty of Computer Science, Dalhousie University, 6050 University Avenue, Halifax, NS, B3H 1W5, Canada

  • Venue:
  • International Journal of Computational Vision and Robotics
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Gesture recognition has been an attractive research area for decades. Recently, the video game industry has become the major driving force for the development of advanced gesture control technologies. Conventional video games are controlled via physical devices. In contrast, the emerging trend is using camera-based human computer interface (HCI) to capture human gestures and control game playing directly. This paper presents a novel approach for facilitating the development of gesture control-based video games. A time-of-flight (TOF) camera is adopted to provide both depth and greyscale image sequences. 3D perceptual gesture features are extracted and grouped into a generic gesture representation for target gesture recognition. The game control parameters are derived from the recognised gestures on the fly. This framework includes five key modules: 1) perceptual feature extraction; 2) object tracking by perceptual grouping; 3) representation and modelling; 4) gesture recognition; 5) game control parameter generation. A proof-of-concept dart game is implemented for demonstration and evaluation.