Cognitive systems engineering
GeoSpace: an interactive visualization system for exploring complex information spaces
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal interfaces for dynamic interactive maps
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Ten myths of multimodal interaction
Communications of the ACM
Perceptual user interfaces: multimodal interfaces that process what comes naturally
Communications of the ACM
Something from nothing: augmenting a paper-based work practice via multimodal interaction
DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments
Cognitive Work Analysis: Towards Safe, Productive, and Healthy Computer-Based Work
Cognitive Work Analysis: Towards Safe, Productive, and Healthy Computer-Based Work
Augmenting and Executing SharedPlans for Multimodal Communication
CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Collaborative Geographic Visualization: Enabling Shared Understanding of Environmental Processes
INFOVIS '00 Proceedings of the IEEE Symposium on Information Vizualization 2000
Experimental evaluation of vision and speech based multimodal interfaces
Proceedings of the 2001 workshop on Perceptive user interfaces
A Real-Time Framework for Natural Multimodal Interaction with Large Screen Displays
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Geovisualization for Knowledge Construction and Decision Support
IEEE Computer Graphics and Applications
Exploiting prosodic structuring of coverbal gesticulation
Proceedings of the 6th international conference on Multimodal interfaces
'SlidingMap': introducing and evaluating a new modality for map interaction
Proceedings of the 6th international conference on Multimodal interfaces
Multimodal interaction for distributed collaboration
Proceedings of the 6th international conference on Multimodal interfaces
Multimodal interface platform for geographical information systems (GeoMIP) in crisis management
Proceedings of the 6th international conference on Multimodal interfaces
Multimodal response generation in GIS
Proceedings of the 6th international conference on Multimodal interfaces
Real-time 3D finger pointing for an augmented desk
AUIC '05 Proceedings of the Sixth Australasian conference on User interface - Volume 40
Supporting Community Emergency Management Planning through a Geocollaboration Software Architecture
Computer Supported Cooperative Work
A Wizard of Oz study for an AR multimodal interface
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
A Design Process for the Development of an Interactive and Adaptive GIS
W2GIS '08 Proceedings of the 8th International Symposium on Web and Wireless Geographical Information Systems
Supporting collaborative sensemaking in map-based emergency management and planning
Proceedings of the ACM 2009 international conference on Supporting group work
Usability evaluation of web-based GIS: case study
Proceedings of the 11th International Conference on Information Integration and Web-based Applications & Services
Vision-based hand-gesture applications
Communications of the ACM
EGrid: supporting the control room operation of a utility company with multi-touch tables
ACM International Conference on Interactive Tabletops and Surfaces
SIGES-PERE: a collaborative GIS for radiological disaster management
EGOV'05 Proceedings of the 4th international conference on Electronic Government
Interoperability for GIS document management in environmental planning
Journal on Data Semantics III
Speech augmented multitouch interaction patterns
Proceedings of the 16th European Conference on Pattern Languages of Programs
Locating emergencies in a campus using wi-fi access point association data
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Tangible tabletops for emergency response: an exploratory study
Proceedings of the International Conference on Multimedia, Interaction, Design and Innovation
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Conditions of applications, situations and functions applicable to gesture interface
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
Hi-index | 0.02 |
Geospatial information is critical to effective, collaborative decision-making during emergency management situations; however conventional GIS are not suited for multi-user access and high-level abstract queries. Currently, decision makers do not always have the real time information they need; GIS analysts produce maps at the request of individual decision makers, often leading to overlapping requests with slow delivery times. In order to overcome these limitations, a paradigm shift in interface design for GIS is needed. The research reported upon here attempts to overcome analyst-driven, menu-controlled, keyboard and mouse operated GIS by designing a multimodal, multi-user GIS interface that puts geospatial data directly in the hands of decision makers. A large screen display is used for data visualization, and collaborative, multi-user interactions in emergency management are supported through voice and gesture recognition. Speech and gesture recognition is coupled with a knowledge-based dialogue management system for storing and retrieving geospatial data. This paper describes the first prototype and the insights gained for human-centered multimodal GIS interface design.