Combining speech and pen input for effective interaction in mobile geospatial environments

Authors:
Julie Doyle;Michela Bertolotto
Affiliations:
University College Dublin, Belfield, Dublin, Ireland;University College Dublin, Belfield, Dublin, Ireland
Venue:
Proceedings of the 2006 ACM symposium on Applied computing
Year:
2006

Citing 4
Cited 1

User-Centered Modeling for Spoken Language and Multimodal Interfaces

IEEE MultiMedia
Designing the user interface for pen and speech multimedia applications

CHI '99 Extended Abstracts on Human Factors in Computing Systems
Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction
Delivering personalized context-aware spatial information to mobile devices

W2GIS'05 Proceedings of the 5th international conference on Web and Wireless Geographical Information Systems

A comparison of speech and GUI input for navigation in complex visualizations on mobile devices

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services

Quantified Score

Hi-index	0.00

Visualization

Abstract

Relatively little research has been conducted into designing interfaces that allow GIS users to interact effectively with geospatial data in mobile environments. Users on the move are faced with limited interaction modalities. The standard mode of input on mobile devices is the pen or stylus, which some users may find difficult or too time-consuming to use. Voice commands, combined with pen input, can provide an attractive alternative for interacting with mobile GIS, as speech is a natural form of interaction. However, the idea of combining speech and pen input in mobile GIS is relatively unexplored. To this effect, we have developed a multimodal interface to a mobile GIS, providing users with the ability to freely switch between modalities to suit current tasks or environments.