Affective multimodal mirror: sensing and eliciting laughter

  • Authors:
  • Willem A. Melder;Khiet P. Truong;Marten Den Uyl;David A. Van Leeuwen;Mark A. Neerincx;Lodewijk R. Loos;B. Stock Plum

  • Affiliations:
  • TNO Human Factors, Soesterberg, Netherlands;TNO Human Factors, Soesterberg, Netherlands;VicarVision, Amsterdam, Netherlands;TNO Human Factors, Soesterberg, Netherlands;TNO Human Factors, Soesterberg, Netherlands;Waag Society, Amsterdam, Netherlands;V2_ Lab, Rotterdam, Netherlands

  • Venue:
  • Proceedings of the international workshop on Human-centered multimedia
  • Year:
  • 2007

Quantified Score

Hi-index 0.01

Visualization

Abstract

In this paper, we present a multimodal affective mirror that senses and elicits laughter. Currently, the mirror contains a vocal and a facial affect-sensing module, a component that fuses the output of these two modules to achieve a user-state assessment, a user state transition model, and a component to present audiovisual affective feedback that should keep or bring the user in the intended state. Interaction with this intelligent interface involves a full cyclic process of sensing, interpreting, reacting, sensing (of the reaction effects), interpreting & The intention of the mirror is to evoke positive emotions, to make people laugh and to increase the laughter. The first user experiences tests showed that users show cooperative behavior, resulting in mutual user-mirror action-reaction cycles. Most users enjoyed the interaction with the mirror and immersed in an excellent user experience.