Analysis on learners' gaze patterns and the instructor's reactions in ballroom dance tutoring

Authors:
Kosuke Kimura;Hung-Hsuan Huang;Kyoji Kawagoe
Affiliations:
Ritsumeikan University, Nojihigashi, Kusatsu City, Shiga, Japan;Ritsumeikan University, Nojihigashi, Kusatsu City, Shiga, Japan;Ritsumeikan University, Nojihigashi, Kusatsu City, Shiga, Japan
Venue:
Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction
Year:
2012

Citing 5
Cited 0

Steve: an animated pedagogical agent for procedural training in virtual environments

ACM SIGART Bulletin
Training for Physical Tasks in Virtual Environments: Tai Chi

VR '03 Proceedings of the IEEE Virtual Reality 2003
Towards a model of face-to-face grounding

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 1
Estimating User's Conversational Engagement Based on Gaze Behaviors

IVA '08 Proceedings of the 8th international conference on Intelligent Virtual Agents
A Virtual Reality Dance Training System Using Motion Capture Technology

IEEE Transactions on Learning Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

The use of virtual conversational agents is awaited in the tutoring of physical skills such as sports or dances. This paper describes about an ongoing project aiming to realize a virtual instructor for ballroom dance. First, a human-human experiment is conducted to collect the interaction corpus between a professional instructor and six learners. The verbal and non-verbal behaviors of the instructor is analyzed and served as the base of a state transition model for ballroom dance tutoring. In order to achieve intuitive and efficient instruction during the multi-modal interaction between the virtual instructor and the learner, the eye gaze patterns of the learner and the reaction from the instructor were analyzed. From the analysis results, it was found that the learner's attitude (confidence and concentration) could be approximated by their gaze patterns, and the instructor's tutoring strategy supported this as well.