Multimodal geographic information systems: adding haptic and auditory display

Authors:
Wooseob Jeong;Myke Gluck
Affiliations:
School of Information Studies, University of Wisconsin in Milwaukee, 536 Bolton Hall, P.O. Box 413, Milwaukee, WI;Department of Mathematics and Computer Science, Virginia Military Institute, 411 Mallory Hall, Lexington, VA
Venue:
Journal of the American Society for Information Science and Technology
Year:
2003

Citing 25
Cited 3

The design of auditory interfaces for visually disabled users

CHI '88 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Stereophonic and surface sound generation for exploratory data analysis

CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Debugging parallel programs using sound

PADD '91 Proceedings of the 1991 ACM/ONR workshop on Parallel and distributed debugging
An agenda for human-computer interaction: science and engineering serving human needs

ACM SIGCHI Bulletin
An evaluation of earcons for use in auditory human-computer interfaces

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
The design and evaluation of an auditory-enhanced scrollbar

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Sonic enhancement of map information: experiments using harmonic intervals

Sonic enhancement of map information: experiments using harmonic intervals
Sound and communication in virtual reality

Communication in the age of virtual reality
Designing auditory interactions for PDAs

Proceedings of the 8th annual ACM symposium on User interface and software technology
Transforming graphical interfaces into auditory interfaces

CHI '95 Conference Companion on Human Factors in Computing Systems
Audio GUIs: interacting with graphical applications in an auditory world

CHI '95 Conference Companion on Human Factors in Computing Systems
Combining haptic and braille technologies: design issues and pilot study

Assets '96 Proceedings of the second annual ACM conference on Assistive technologies
What is the sound of a headache? Using digital media to represent inner experiences

MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Design of a virtual rigid surface: haptic/audio registration

CHI '94 Conference Companion on Human Factors in Computing Systems
Designing with auditory icons: how well do we identify auditory cues?

CHI '94 Conference Companion on Human Factors in Computing Systems
Haptic virtual reality for blind computer users

Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Wind and wave auditory icons for monitoring continuous processes

CHI 98 Cconference Summary on Human Factors in Computing Systems
The design of 3D haptic widgets

I3D '99 Proceedings of the 1999 symposium on Interactive 3D graphics
Phantom-Based Haptic Interaction with Virtual Objects

IEEE Computer Graphics and Applications
Exploratory user study of haptic and auditory display for multimodal geographical information systems

CHI '01 Extended Abstracts on Human Factors in Computing Systems
Toward the understanding of user satisfaction: a multiattribute study of user evaluations of computer-based literature searches in medical libraries

Toward the understanding of user satisfaction: a multiattribute study of user evaluations of computer-based literature searches in medical libraries
Semiology of graphics

Semiology of graphics
Transforming graphical interfaces into auditory interfaces for blind users

Human-Computer Interaction
Access to mathematics for visually disabled students through multimodal interaction

Human-Computer Interaction
Toward an information visualization workspace: combining multiple means of expression

Human-Computer Interaction

Touchable online braille generator

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility
Using sound to represent spatial data in ArcGIS

Computers & Geosciences
Attribute correlations between haptic and auditory modalities

EGVE'05 Proceedings of the 11th Eurographics conference on Virtual Environments

Quantified Score

Hi-index	0.00

Visualization

Abstract

The goal of this study was to discover the feasibility of adding haptic and auditory displays to traditional visual geographic information systems (GIS). The experiment was conducted with 51 participants to explore the difference in user performance (task completion time and accuracy) and user satisfaction with a multimodal GIS system, which was implemented with a haptic display, auditory display, and combined display. The experiment consisted of a series of 36 tasks in which the participants were asked to identify the highest or the middle valued state among nine U.S. states on maps. The results showed that haptic displays produce faster and more accurate performance than auditory displays and combined displays for more complex tasks. In terms of user satisfaction, the participants preferred the combined display even though they performed best with the haptic display.