Analysis environment of conversational structure with nonverbal multimodal data

Authors:
Yasuyuki Sumi;Masaharu Yano;Toyoaki Nishida
Affiliations:
Kyoto University, Kyoto, Japan;Kyoto University, Kyoto, Japan;Kyoto University, Kyoto, Japan
Venue:
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Year:
2010

Citing 4
Cited 6

Computers in the Human Interaction Loop

Computers in the Human Interaction Loop
The AMI meeting corpus: a pre-announcement

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
VACE multimodal meeting corpus

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
Estimating the lecturer's head pose in seminar scenarios – a multi-view approach

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction

HASC Challenge: gathering large scale human activity corpus for the real-world activity understandings

Proceedings of the 2nd Augmented Human International Conference
Extracting interval distribution of human interactions

PSIVT'11 Proceedings of the 5th Pacific Rim conference on Advances in Image and Video Technology - Volume Part II
Group dynamics and multimodal interaction modeling using a smart digital signage

ECCV'12 Proceedings of the 12th international conference on Computer Vision - Volume Part I
Context-based conversational hand gesture classification in narrative interaction

Proceedings of the 15th ACM on International conference on multimodal interaction
Multi-party human-machine interaction using a smart multimodal digital signage

HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
Detection of division of labor in multiparty collaboration

HCI'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction for learning, culture, collaboration and business - Volume Part III

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper shows the IMADE (Interaction Measurement, Analysis, and Design Environment) project to build a recording and anlyzing environment of human conversational interactions. The IMADE room is designed to record audio/visual, human-motion, eye gazing data for building interaction corpus mainly focusing on understanding of human nonverbal behaviors. In this paper, we show the notion of interaction corpus and iCorpusStudio, software environment for browsing and analyzing the interaction corpus. We also present a preliminary experiment on multiparty conversations.