EM-in-M: analyze and synthesize emotion in motion

  • Authors:
  • Yuichi Kobayashi;Jun Ohya

  • Affiliations:
  • Toppan Printing Co.,ltd., Information Technology Research Laboratory, Tokyo, Japan;Graduate school of GITS, Waseda University, Tokyo, Japan

  • Venue:
  • IWICPAS'06 Proceedings of the 2006 Advances in Machine Vision, Image Processing, and Pattern Analysis international conference on Intelligent Computing in Pattern Analysis/Synthesis
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

We have been researching the relationship between human motion and emotion. In this paper, our purpose is to extract motion features specific to each emotion. We propose a new approach for motion data analysis, which applies the higher order Singular Value Decomposition(HOSVD) direct to the motion data and the wavelet analysis to the synthesized data with SVD. The HOSVD models the mapping between persons and emotions. The model can synthesize a complete data acting with each emotion for a given new person. The wavelet analysis extracts each motion feature from the synthesized data for each emotion. Some experimental results using motion capture data for “gait” action and 6 emotions – “angry, joy, sad and so on” show that our method can synthesize novel gait motions for a person by using the extracted motion elements and can extract some features specific to each emotion.