Automated gesture segmentation from dance sequences

  • Authors:
  • Kanav Kahol;Priyamvada Tripathi;Sethuraman Panchanathan

  • Affiliations:
  • Center for Cognitive Ubiquitous Computing, Department of Computer Science and Engineering, Arizona State University, Tempe, Arizona;Center for Cognitive Ubiquitous Computing, Department of Computer Science and Engineering, Arizona State University, Tempe, Arizona;Center for Cognitive Ubiquitous Computing, Department of Computer Science and Engineering, Arizona State University, Tempe, Arizona

  • Venue:
  • FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

Complex human motion (e.g. dance) sequences are typically analyzed by segmenting them into shorter motion sequences, called gestures. However, this segmentation process is subjective, and varies considerably from one choreographer to another. Dance sequences also exhibit a large vocabulary of gestures. In this paper, we propose an algorithm called Hierarchical Activity Segmentation. This algorithm employs a dynamic hierarchical layered structure to represent human anatomy, and uses low-level motion parameters to characterize motion in the various layers of this hierarchy, which correspond to different segments of the human body. This characterization is used with a naïve Bayesian classifier to derive choreographer profiles from empirical data that are used to predict how particular choreographers will segment gestures in other motion sequences. When the predictions were tested with a library of 45 3D motion capture sequences (with 185 distinct gestures) created by 5 different choreographers, they were found to be 93.3% accurate.