Combining inertial and visual sensing for human action recognition in tennis

  • Authors:

  • Ciarán Ó Conaire;Damien Connaghan;Philip Kelly;Noel E. O'Connor;Mark Gaffney;John Buckley

  • Affiliations:

  • Clarity: Centre for Sensor Web Technologies, Dublin, Ireland;Clarity: Centre for Sensor Web Technologies, Dublin, Ireland;Clarity: Centre for Sensor Web Technologies, Dublin, Ireland;Clarity: Centre for Sensor Web Technologies, Dublin, Ireland;Tyndall National Institute, Cork, Ireland;Tyndall National Institute, Cork, Ireland

  • Venue:
  • Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a framework for both the automatic extraction of the temporal location of tennis strokes within a match and the subsequent classification of these as being either a serve, forehand or backhand. We employ the use of low-cost visual sensing and low-cost inertial sensing to achieve these aims, whereby a single modality can be used or a fusion of both classification strategies can be adopted if both modalities are available within a given capture scenario. This flexibility allows the framework to be applicable to a variety of user scenarios and hardware infrastructures. Our proposed approach is quantitatively evaluated using data captured from elite tennis players. Results point to the extremely accurate performance of the proposed approach irrespective of input modality configuration