A pattern mining method for interpretation of interaction

Authors:
Tomoyuki Morita;Yasushi Hirano;Yasuyuki Sumi;Shoji Kajita;Kenji Mase
Affiliations:
Nagoya University, Nagoya, JAPAN and ATR Media Information Science Laboratories, Nagoya, JAPAN;Nagoya University, Nagoya, JAPAN;Nagoya University, Nagoya, JAPAN and ATR Media Information Science Laboratories, Nagoya, JAPAN;Nagoya University, Nagoya, JAPAN;Kyoto University, Nagoya, JAPAN, ATR Media Information Science Laboratories, Nagoya, JAPAN and ATR Intelligent Robotics and Communication Laboratories, Nagoya, JAPAN
Venue:
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Year:
2005

Citing 6
Cited 5

Discovery of Frequent Episodes in Event Sequences

Data Mining and Knowledge Discovery
Frequent Subgraph Discovery

ICDM '01 Proceedings of the 2001 IEEE International Conference on Data Mining
The Aware Home: A Living Laboratory for Ubiquitous Computing Research

CoBuild '99 Proceedings of the Second International Workshop on Cooperative Buildings, Integrating Information, Organization, and Architecture
The Intelligent Room project

CT '97 Proceedings of the 2nd International Conference on Cognitive Technology (CT '97)
Video Annotation for Content-based Retrieval using Human Behavior Analysis and Domain Knowledge

FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
A layered interpretation of human interactions captured by ubiquitous sensors

Proceedings of the the 1st ACM workshop on Continuous archival and retrieval of personal experiences

Ubiquitous Experience Media

IEEE MultiMedia
Extraction of important interactions in medical interviewsusing nonverbal information

Proceedings of the 9th international conference on Multimodal interfaces
Interaction pattern and motif mining method for doctor-patient multi-modal dialog analysis

Proceedings of the ICMI-MLMI '09 Workshop on Multimodal Sensor-Based Systems and Mobile Phones for Social Computing
A multi-modal dialogue analysis method for medical interviews based on design of interaction corpus

Personal and Ubiquitous Computing
Social interaction mining in small group discussion using a smart meeting system

UIC'11 Proceedings of the 8th international conference on Ubiquitous intelligence and computing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes a novel mining method for multimodal interactions to extract important patterns of group activities. These extracted patterns can be used as machine-readable event indices in developing an interaction corpus based on a huge collection of human interaction data captured by various sensors. The event indices can be used, for example, to summarize a set of events and to search for particular events because they contain various pieces of context information. The proposed method extracts simultaneously occurring patterns of primitive events in interaction, such as gaze and speech, that in combination occur more consistently than randomly. The proposed method provides a statistically plausible definition of interaction events that is not possible through intuitive top-down definitions. We demonstrate the effectiveness of our method for the data captured in an experimental setup of a poster-exhibition scene. Several interesting patterns are extracted by the method, and we examined their interpretations.