Quality of talking heads in different interaction and media contexts

Authors:
Benjamin Weiss;Christine Kühnel;Ina Wechsung;Sascha Fagel;Sebastian Möller
Affiliations:
Quality and Usability Lab, Deutsche Telekom Labs, TU Berlin, Ernst-Reuter-Platz 7, D-10587 Berlin, Germany;Quality and Usability Lab, Deutsche Telekom Labs, TU Berlin, Ernst-Reuter-Platz 7, D-10587 Berlin, Germany;Quality and Usability Lab, Deutsche Telekom Labs, TU Berlin, Ernst-Reuter-Platz 7, D-10587 Berlin, Germany;Institut für Sprache und Kommunikation, TU Berlin, Ernst-Reuter-Platz 7, D-10587 Berlin, Germany;Quality and Usability Lab, Deutsche Telekom Labs, TU Berlin, Ernst-Reuter-Platz 7, D-10587 Berlin, Germany
Venue:
Speech Communication
Year:
2010

Citing 15
Cited 1

Situated facial displays: towards social interaction

CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The representation of agents: anthropomorphism, agency, and intelligence

Conference Companion on Human Factors in Computing Systems
Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The impact of animated interface agents: a review of empirical research

International Journal of Human-Computer Studies
Developing and evaluating conversational agents

Embodied conversational agents
The Persona Effect: How Substantial Is It?

HCI '98 Proceedings of HCI on People and Computers XIII
Manipulation of non-verbal interaction style and demographic embodiment to increase anthropomorphic computer character credibility

International Journal of Human-Computer Studies - Special issue: Subtle expressivity for characters and robots
Evaluating a realistic agent in an advice-giving task

International Journal of Human-Computer Studies
From brows to trust: evaluating embodied conversational agents

From brows to trust: evaluating embodied conversational agents
Evaluation of multimodal behaviour of embodied agents

From brows to trust
A meta-analysis of the impact of the inclusion and realism of human-like faces on user experiences in interfaces

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Empirical studies on embodied conversational agents

Empirical studies on embodied conversational agents
The boundary of racial prejudice: Comparing preferences for computer-synthesized White, Black, and robot characters

Computers in Human Behavior
Evaluating talking heads for smart home systems

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
When the interface is a face

Human-Computer Interaction

Evaluating a synthetic talking head using a dual task: Modality effects on speech understanding and cognitive load

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

We investigate the impact of three different factors on the quality of talking heads as metaphors of a spoken dialogue system in the smart home domain. The main focus lies on the effect of voice and head characteristics on audio and video quality, as well as overall quality. Furthermore, the influence of interactivity and of media context on user perception is analysed. For this purpose two subsequent experiments were conducted: the first was designed as a non-interactive rating test of videos of talking heads, while the second experiment was interactive. Here, the participants had to solve a number of tasks in dialogue with a talking head. To assess the impact of the media context, redundant information was provided via an additional visual output channel to half of the participants. As a secondary effect, the importance of participants' gender is examined. It is shown that perceived quality differences observed in the non-interactive setting are blurred when the interactivity and media contexts provide distraction from the talking head. Furthermore, a simple additional feed-back screen improves the perceived quality of the talking heads. Gender effects are negligible concerning the ratings in interaction, but female and male participants exhibit different behaviour in the experiment. This advocates for more realistic evaluation settings in order to increase the external validity of the obtained quality judgements.