Understanding communicative emotions from collective external observations

  • Authors:
  • Shiro Kumano;Kazuhiro Otsuka;Dan Mikami;Masafumi Matsuda;Junji Yamato

  • Affiliations:
  • NTT Communication Science Laboratories, Kanagawa, Japan;NTT Communication Science Laboratories, Kanagawa, Japan;NTT Communication Science Laboratories, Kanagawa, Japan;NTT Communication Science Laboratories, Kanagawa, Japan;NTT Communication Science Laboratories, Kanagawa, Japan

  • Venue:
  • CHI '12 Extended Abstracts on Human Factors in Computing Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a research framework for understanding communicative emotions aroused between people while interacting in conversation. Our advance is to consider how these emotions are perceived by other people, rather than what the target's internal state really is. Because such perception is subjective, we introduce the concept of using a collection of subjective external observations to objectively identify a fact. By treating the difference in perceived state as a probability distribution, we propose a computational model that describes the relationship between the perceived emotion and participants' key nonverbal behaviors, i.e. gaze and facial expressions. We also propose an evaluation method to assess the model by comparing the distributions estimated by using it with those of observers'. This paper describes initial experiments and discusses its potential.