Use of nonverbal communication in dialog system

  • Authors:
  • Jana Kleckova;Pavel Kral;Jana Krutisova

  • Affiliations:
  • Department of Computer Science and Engineering, Faculty of Applied Sciences, University of West Bohemia in Pilsen, Pilsen, Czech Republic;Department of Computer Science and Engineering, Faculty of Applied Sciences, University of West Bohemia in Pilsen, Pilsen, Czech Republic;Department of Computer Science and Engineering, Faculty of Applied Sciences, University of West Bohemia in Pilsen, Pilsen, Czech Republic

  • Venue:
  • ICOSSSE'05 Proceedings of the 4th WSEAS/IASME international conference on System science and simulation in engineering
  • Year:
  • 2005

Quantified Score

Hi-index 0.00

Visualization

Abstract

Understanding human emotions and their nonverbal messages is one of the most necessary and important skills for making the next generation of human-computer interfaces (HCI) easier, more natural and effective. Indeed, the first step toward an automatic emotion sensitive human-computer system having the ability to automatically detect users' nonverbal signals is the development of an accurate and real-time automatic NVC analyzer. Such an analyzer must deal mainly with users' facial expressions and paralanguage. The main goal of this paper is to compare different methods to combine the results of both classifiers. A prototype of the dialog system was developed in the Department of Computer Science. The proposed system is fully automatic, user-independent and real-time working. Several experiments show that the speech recognition quality is increased by using nonverbal information.