Gesture activated mobile edutainment (GAME): intercultural training of nonverbal behavior with mobile phones

Authors:
Matthias Rehm;Karin Leichtenstern;Jörg Plomer;Christian Wiedemann
Affiliations:
Aalborg University, Aalborg, Denmark;Human Centered Multimedia, Augsburg, Germany;Human Centered Multimedia, Augsburg, Germany;Human Centered Multimedia, Augsburg, Germany
Venue:
Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
Year:
2010

Citing 12
Cited 0

Crosscurrents: cultural dimensions and global Web user-interface design

interactions
Human conversation as a system framework: designing embodied conversational agents

Embodied conversational agents
Enabling fast and effortless customisation in accelerometer based gesture interaction

Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia
Accelerometer-based gesture control for a design environment

Personal and Ubiquitous Computing
Simulating scenarios for research on culture & cognition using a commercial role-play game

WSC '05 Proceedings of the 37th conference on Winter simulation
Gesture recognition with a Wii controller

Proceedings of the 2nd international conference on Tangible and embedded interaction
A Computational Model of Culture-Specific Conversational Behavior

IVA '07 Proceedings of the 7th international conference on Intelligent Virtual Agents
Wave like an Egyptian: accelerometer based gesture recognition for culture specific interactions

BCS-HCI '08 Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction - Volume 1
Culture-specific communication management for virtual agents

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
But that was in another country: agents and intercultural empathy

Proceedings of The 8th International Conference on Autonomous Agents and Multiagent Systems - Volume 1
From observation to simulation: generating culture-specific behavior for interactive systems

AI & Society - Special Issue: Enculturating Human-Computer Interaction, Guest Editors: M. Rehm, Y. Nakano, E. André, T. Nishida
Tactical language and culture training systems: using artificial intelligence to teach foreign languages and cultures

IAAI'08 Proceedings of the 20th national conference on Innovative applications of artificial intelligence - Volume 3

Quantified Score

Hi-index	0.00

Visualization

Abstract

An approach to intercultural training of nonverbal behavior is presented that draws from research on role-plays with virtual agents and ideas from situated learning. To this end, a mobile serious game is realized where the user acquires knowledge about German emblematic gestures and tries them out in role-plays with virtual agents. Gesture performance is evaluated making use of build-in acceleration sensors of smart phones. After an account of the theoretical background covering diverse areas like virtual agents, situated learning and intercultural training, the paper presents the GAME approach along with details on the gesture recognition and content authoring. By its experience-based role-plays with virtual characters, GAME brings together ideas from situated learning and intercultural training in an integrated approach and paves the way for new m-learning concepts.