Interaction pattern and motif mining method for doctor-patient multi-modal dialog analysis

Authors:
Kenji Mase;Yuichi Sawamoto;Yuichi Koyama;Tomio Suzuki;Kimiko Katsuyama
Affiliations:
Nagoya University, Nagoya, Japan;Nagoya University, Nagoya, Japan;Nagoya University, Nagoya, Japan;Nagoya University Hospital, Nagoya, Japan;Osaka Prefecture University, Osaka, Japan
Venue:
Proceedings of the ICMI-MLMI '09 Workshop on Multimodal Sensor-Based Systems and Mobile Phones for Social Computing
Year:
2009

Citing 5
Cited 1

A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A pattern mining method for interpretation of interaction

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Ubiquitous Experience Media

IEEE MultiMedia
Interactive Humanoid Robots for a Science Museum

IEEE Intelligent Systems
Socialmotion: measuring the hidden social life of a building

LoCA'07 Proceedings of the 3rd international conference on Location-and context-awareness

Multimedia data mining: state of the art and challenges

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a bottom-up analysis method of multi-modal dialogue interaction with a pattern and motif mining method to summarize such interviews as between doctors and patients for medical diagnosis. Our aim is to generate a hierarchical model of the interviewing behavior of such kinds as interaction corpora, consisting of primitive, pattern, motif, and pattern clusters from the given dialogue session data. We exploit a Jensen-Shannon Divergence measure to extract important patterns and motifs. Medical interview is chosen as an important application of such analysis because a doctor's multi-modal interviewing technique is essential to establish a reliable relationship and to conclude with a successful diagnosis. An interaction corpus of example simulated medical interviews is constructed by the proposed method. The interviews are captured by a video camera and microphones. Based on the constructed indices in terms of given pattern notations and clusters, the interviews were summarized. Performance evaluation of the indices by a medical doctor was performed to confirm their plausibility and summary descriptions of the results.