The design of a vision-based motion performance system

  • Authors:
  • Cheng Ren;Shuai Ye;Xin Wang

  • Affiliations:
  • College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China;College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China;College of Computer Science and Technology, Zhejiang University of Technology, Hangzhou, China

  • Venue:
  • ICIRA'11 Proceedings of the 4th international conference on Intelligent Robotics and Applications - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents the structure of our real time vision-based motion performance system. The system requires user to wear markers with a certain color. Several novel algorithms in the system are introduced including algorithms for feature detection and feature tracking under occlusion. Feature Detection takes advantages of four properties of markers to avoid the interference from non-markers regions. Besides, we propose a simple but effective method to track these features and handle occlusion by estimating velocity of missing features based on prior, smoothness and fitness term. These algorithms are to ensure the accuracy and low computation cost of reconstruction of 3D points of the markers. At run time, the system automatically scans, identifies, tracks and finally reconstructs the markers to 3D points. We test the ability of our system by having user perform walking, running and jumping.