Subjective Evaluation Method for Speech-Based Uni- and Multimodal Applications

Authors:
Benjamin Weiss;Ina Wechsung;Anja Naumann;Sebastian Möller
Affiliations:
Deutsche Telekom Laboratories, TU Berlin, Berlin, Germany 10587;Deutsche Telekom Laboratories, TU Berlin, Berlin, Germany 10587;Deutsche Telekom Laboratories, TU Berlin, Berlin, Germany 10587;Deutsche Telekom Laboratories, TU Berlin, Berlin, Germany 10587
Venue:
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
Year:
2008

Citing 2
Cited 0

Towards a tool for the Subjective Assessment of Speech System Interfaces (SASSI)

Natural Language Engineering
Predicting the quality and usability of spoken dialogue services

Speech Communication

Quantified Score

Hi-index	0.00

Visualization

Abstract

Questionnaires are a widespread method for subjective usability evaluation. Concerning speech-based systems the SASSI questionnaire is probably the most common one. This paper examines SASSI results obtained by different studies in order to evaluate its reliability and validity. Furthermore, it is investigated if SASSI is appropriate also for multimodal systems. The results indicate that some SASSI sub-scales need a revision.