Impact of video editing based on participants' gaze in multiparty conversation

  • Authors:
  • Yoshinao Takemae;Kazuhiro Otsuka;Naoki Mukawa

  • Affiliations:
  • NTT Corporation, Kanagawa, Japan;NTT Corporation, Kanagawa, Japan;Tokyo Denki University, Chiba, Japan

  • Venue:
  • CHI '04 Extended Abstracts on Human Factors in Computing Systems
  • Year:
  • 2004

Quantified Score

Hi-index 0.01

Visualization

Abstract

This paper presents a video cut editing rule based on participants' gaze for establishing video editing rules that can accurately and clearly convey the flow of conversation in multiparty conversations to viewers. Demand is growing to be able to effectively archive meetings and teleconferences to facilitate human communication. Conventional systems use fixed-viewpoint cameras and simple camera selection based on participants' utterances etc. However, these systems fail to convey a sufficient amount of nonverbal information about the participants and the flow of conversation. On the basis of participants' gaze behavior in multiparty conversation, we propose a new video cut editing rule; the rule uses majority decision with regard to participants' gaze direction. We then present experiments that compare the proposed method to conventional visual representations. We conclude that the proposed method can more successfully convey 1) who is talking to whom and 2) hearers' response to speakers, which are extremely crucial pieces of information that allow viewers to understand the flow of conversation.