Context aware multimodal interaction model in standard natural classroom

Authors:
Quanfeng Luo;Jiaji Zhou;Fei Wang;Liping Shen
Affiliations:
Computer Science & Engineering Dept., Shanghai Jiao Tong University, Shanghai, China;Computer Science & Engineering Dept., Shanghai Jiao Tong University, Shanghai, China;Computer Science & Engineering Dept., Shanghai Jiao Tong University, Shanghai, China;Computer Science & Engineering Dept., Shanghai Jiao Tong University, Shanghai, China
Venue:
ICHL'09 Proceedings of the Second international conference on Hybrid Learning and Education
Year:
2009

Citing 5
Cited 0

SHOP: Simple Hierarchical Ordered Planner

IJCAI '99 Proceedings of the Sixteenth International Joint Conference on Artificial Intelligence
The Pervasive Learning Platform of a Shanghai Online College --- A Large-Scale Test-Bed for Hybrid Learning

ICHL '08 Proceedings of the 1st international conference on Hybrid Learning and Education
Techniques for Enhancing Pervasive Learning in Standard Natural Classroom

ICHL '08 Proceedings of the 1st international conference on Hybrid Learning and Education
Challenges and Solutions for Hierarchical Task Network Planning in E-Learning

Proceedings of the 2006 conference on STAIRS 2006: Proceedings of the Third Starting AI Researchers' Symposium
A task decomposition scheme for context aggregation in personal smart space

SEUS'07 Proceedings of the 5th IFIP WG 10.2 international conference on Software technologies for embedded and ubiquitous systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

Standard Natural Classroom (SNC) is a real-time classroom based on smart space and e-Learning technologies, which aims at creating face-to-face, interactive and pervasive learning experience for both local and remote students. In this paper, the phrase “interaction” refers to human-computer interaction, teacher-student interaction and student-student interaction in hybrid learning process. The characteristics of these interactions are multimodal and context aware. In this paper, we first draw an outline of SNC and Virtual Interaction Classroom (VIC). Second, we introduce a so called “Context Aware Multimodal Interaction” (CAMI) concept, and the multimodal and context information in SNC. Finally, we describe the implementation of a real-time Context Aware Multimodal Interaction Model (CAMIM) which is universal, extendable and efficient. We will illustrate the architecture of CAMIM, then we will demonstrate the Interaction Task Set (ITS) and CAMI fusion strategy. In particular, automated planning technology Hierarchical Task Network (HTN) is introduced into this model.