Multimodal interaction with speech and physical touch interface in a media center application

Authors:
Markku Turunen;Aleksi Kallinen;Ivàn Sànchez;Jukka Riekki;Juho Hella;Thomas Olsson;Aleksi Melto;Juha-Pekka Rajaniemi;Jaakko Hakulinen;Erno Mäkinen;Pellervo Valkama;Toni Miettinen;Mikko Pyykkönen;Timo Saloranta;Ekaterina Gilman;Roope Raisamo
Affiliations:
University of Tampere;Tampere University of Technology, Tampere;University of Oulu;University of Oulu;University of Tampere;Tampere University of Technology, Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Tampere;University of Oulu;University of Oulu;University of Oulu;University of Tampere
Venue:
Proceedings of the International Conference on Advances in Computer Enterntainment Technology
Year:
2009

Citing 12
Cited 11

Fisheye menus

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
DateLens: A fisheye calendar interface for PDAs

ACM Transactions on Computer-Human Interaction (TOCHI)
UCPCD: user-centered product concept design

Proceedings of the 2003 conference on Designing for user experiences
Toolkit Design for Interactive Structured Graphics

IEEE Transactions on Software Engineering
The prospects for unrestricted speech input for TV content search

Proceedings of the working conference on Advanced visual interfaces
The thing and I: understanding the relationship between user and product

Funology
Bridging the physical and virtual worlds by local connectivity-based physical selection

Personal and Ubiquitous Computing
Supporting Mobile Service Usage through Physical Mobile Interaction

PERCOM '07 Proceedings of the Fifth IEEE International Conference on Pervasive Computing and Communications
Gesture recognition with a Wii controller

Proceedings of the 2nd international conference on Tangible and embedded interaction
Physical shortcuts for media remote controls

Proceedings of the 2nd international conference on INtelligent TEchnologies for interactive enterTAINment
The interplay of beauty, goodness, and usability in interactive products

Human-Computer Interaction
Multimodal dialogue systems: a case study for interactive TV

ERCIM'02 Proceedings of the User interfaces for all 7th international conference on Universal access: theoretical perspectives, practice, and experience

A comparison of speech and GUI input for navigation in complex visualizations on mobile devices

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Accessible Multimodal Media Center Application for Blind and Partially Sighted People
Old wine in new bottles or novel challenges: a critical analysis of empirical studies of user experience

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
NFC-based interactive learning environments for children

Proceedings of the 10th International Conference on Interaction Design and Children
Multimodal multi-device program guide for smart conferences

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
Un espace de caractérisation de la télécommande dans le contexte de la télévision interactive

23rd French Speaking Conference on Human-Computer Interaction
Distributed interaction: a multi-device, multi-user music experience

Proceedings of the International Working Conference on Advanced Visual Interfaces
The interaction space of a multi-device, multi-user music experience

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
Design guidelines for adaptive multimodal mobile input solutions

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Measurement of momentary user experience in an automotive context

Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Towards interactive smart spaces

Journal of Ambient Intelligence and Smart Environments - Context Awareness

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a multimodal media center interface based on a novel combination of new modalities. The application is based on a combination of a large high-definition display and a mobile phone. Users can interact with the system using speech input (speech recognition), physical touch (touching physical icons with the mobile phone), and gestures. We present the key results from a laboratory experiment where user expectations and actual usage experiences are compared.