Towards rhythmic analysis of human motion using acceleration-onset times

  • Authors:
  • Eric Lee;Urs Enke;Jan Borchers;Leo de Jong

  • Affiliations:
  • RWTH Aachen University, Aachen, Germany;RWTH Aachen University, Aachen, Germany;RWTH Aachen University, Aachen, Germany;MultiPRO, WJ Haarlem, The Netherlands

  • Venue:
  • NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a system for rhythmic analysis of human motion in real-time. Using a combination of both spectral (Fourier) and spatial analysis of onsets, we are able to extract repeating rhythmic patterns from data collected using accelerometers. These extracted rhythmic patterns show the relative magnitudes of accentuated movements and their spacing in time. Inspired by previous work in automatic beat detection of audio recordings, we designed our algorithms to be robust to changes in timing using multiple analysis techniques and methods for sensor fusion, filtering and clustering. We tested our system using a limited set of movements, as well as dance movements collected from a professional, both with promising results.