User expectations and user experience with different modalities in a mobile phone controlled home entertainment system

Authors:
Markku Turunen;Aleksi Melto;Juho Hella;Tomi Heimonen;Jaakko Hakulinen;Erno Mäkinen;Tuuli Laivo;Hannu Soronen
Affiliations:
University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;Tampere University of Technology, Tampere
Venue:
Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Year:
2009

Citing 6
Cited 6

The prospects for unrestricted speech input for TV content search

Proceedings of the working conference on Advanced visual interfaces
Designing audio and tactile crossmodal icons for mobile devices

Proceedings of the 9th international conference on Multimodal interfaces
Gesture recognition with a Wii controller

Proceedings of the 2nd international conference on Tangible and embedded interaction
Physical shortcuts for media remote controls

Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment
Evaluation of predictive text and speech inputs in a multimodal mobile route guidance application

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Multimodal dialogue systems: a case study for interactive TV

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience

Multimodal Media Center Interface Based on Speech, Gestures and Haptic Feedback

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Multimodal Interaction with Speech, Gestures and Haptic Feedback in a Media Center Application

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Accessible Multimodal Media Center Application for Blind and Partially Sighted People
Accessible speech-based and multimodal media center interface for users with physical disabilities

COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
A set of recommendations for the control of IPTV-systems via smart phones based on the understanding of users practices and needs

Proceedings of the 10th European conference on Interactive tv and video
Mo!Games: evaluating mobile gestures in the wild

Proceedings of the 15th ACM on International conference on multimodal interaction

Quantified Score

Hi-index	0.01

Visualization

Abstract

Home environment is an exciting application domain for multimodal mobile interfaces. Instead of multiple remote controls, personal mobile devices could be used to operate home entertainment systems. This paper reports a subjective evaluation of multimodal inputs and outputs for controlling a home media center using a mobile phone. A within-subject evaluation with 26 participants revealed significant differences on user expectations on and experiences with different modalities. Speech input was received extremely well, even surpassing expectations in some cases, while gestures and haptic feedback were almost failing to meet the lowest expectations. The results can be applied for designing similar multimodal applications in home environments.