Human motion modeling using multivision

  • Authors:
  • Byoung-Doo Kang;Jae-Seong Eom;Jong-Ho Kim;Chul-Soo Kim;Sang-Ho Ahn;Bum-Joo Shin;Sang-Kyoon Kim

  • Affiliations:
  • Department of Computer Science, Inje University, Kimhae, Korea;Department of Computer Science, Inje University, Kimhae, Korea;Department of Computer Science, Inje University, Kimhae, Korea;Department of Computer Science, Inje University, Kimhae, Korea;Department of Electronics and Intelligent Robotic Engineering, Inje University, Kimhae, Korea;Department of Biosystem Engineering, Pusan National University, Miryang, Korea;Department of Computer Science, Inje University, Kimhae, Korea

  • Venue:
  • HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a gesture modeling system based on computer vision in order to recognize a gesture naturally without any trouble between a system and a user using real-time 3D modeling information on multiple objects. It recognizes a gesture after 3D modeling and analyzing the information pertaining to the user's body shape in stereo views for human movement. In the 3D-modeling step, 2D information is extracted from each view by using an adaptive color difference detector. Potential objects such as faces, hands, and feet are labeled by using the information from 2D detection. We identify reliable objects by comparing the similarities of the potential objects that are obtained from both the views. We acquire information on 2D tracking from the selected objects by using the Kalman filter and reconstruct it as a 3D gesture. A joint of each part of a body is generated in the combined objects. We experimented on ambiguities using occlusion, clutter, and irregular 3D gestures to analyze the efficiency of the proposed system. In this experiment, the proposed gesture modeling system showed a good detection and a processing time of 30 frames per second, which can be used in a real-time.