Accessible speech-based and multimodal media center interface for users with physical disabilities

Authors:
Markku Turunen;Jaakko Hakulinen;Aleksi Melto;Juho Hella;Tuuli Laivo;Juha-Pekka Rajaniemi;Erno Mäkinen;Hannu Soronen;Mervi Hansen;Santtu Pakarinen;Tomi Heimonen;Jussi Rantala;Pellervo Valkama;Toni Miettinen;Roope Raisamo
Affiliations:
Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;IHTE, Department of Software Systems, University of Tampere, University of Tampere, Finland;IHTE, Department of Software Systems, University of Tampere, University of Tampere, Finland;IHTE, Department of Software Systems, University of Tampere, University of Tampere, Finland;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH;Department of Computer Sciences, TAUCH
Venue:
COST'09 Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony
Year:
2009

Citing 8
Cited 1

Fisheye menus

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
DateLens: A fisheye calendar interface for PDAs

ACM Transactions on Computer-Human Interaction (TOCHI)
Toolkit Design for Interactive Structured Graphics

IEEE Transactions on Software Engineering
The prospects for unrestricted speech input for TV content search

Proceedings of the working conference on Advanced visual interfaces
The thing and I: understanding the relationship between user and product

Funology
Measurement combination for acoustic source localization in a room environment

EURASIP Journal on Audio, Speech, and Music Processing - Intelligent Audio, Speech, and Music Processing Applications
User expectations and user experience with different modalities in a mobile phone controlled home entertainment system

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Multimodal dialogue systems: a case study for interactive TV

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience

Accessible Multimodal Media Center Application for Blind and Partially Sighted People

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a multimodal media center user interface with a hands-free speech recognition input method for users with physical disabilities. In addition to speech input, the application features a zoomable context + focus graphical user interface and several other modalities, including speech output, haptic feedback, and gesture input. These features have been developed in co-operation with representatives from the target user groups. In this article, we focus on the speech input interface and its evaluations. We discuss the user interface design and results from a long-term pilot study taking place in homes of physically disabled users, and compare the results to a public pilot study and laboratory studies carried out with non-disabled users.