Multimodal interface platform for geographical information systems (GeoMIP) in crisis management

Authors:
Pyush Agrawal;Ingmar Rauschert;Keerati Inochanon;Levent Bolelli;Sven Fuhrmann;Isaac Brewer;Guoray Cai;Alan MacEachren;Rajeev Sharma
Affiliations:
Advanced Interfaces, Inc., State College, PA;Advanced Interfaces, Inc., State College, PA and Penn State University, University Park, PA and GeoVISTA Center, University Park, PA;Advanced Interfaces, Inc., State College, PA;Penn State University, University Park, PA and GeoVISTA Center, University Park, PA;GeoVISTA Center, University Park, PA;GeoVISTA Center, University Park, PA;Penn State University, University Park, PA and GeoVISTA Center, University Park, PA;GeoVISTA Center, University Park, PA;Advanced Interfaces, Inc., State College, PA and Penn State University, University Park, PA and GeoVISTA Center, University Park, PA
Venue:
Proceedings of the 6th international conference on Multimodal interfaces
Year:
2004

Citing 1
Cited 4

Designing a human-centered, multimodal GIS interface to support emergency management

Proceedings of the 10th ACM international symposium on Advances in geographic information systems

Multimodal interaction for distributed collaboration

Proceedings of the 6th international conference on Multimodal interfaces
Towards a business continuity information network for rapid disaster recovery

dg.o '08 Proceedings of the 2008 international conference on Digital government research
A multi-agent cooperative model for crisis management system

AIKED'08 Proceedings of the 7th WSEAS International Conference on Artificial intelligence, knowledge engineering and data bases
Map-Mediated geocollaborative crisis management

ISI'05 Proceedings of the 2005 IEEE international conference on Intelligence and Security Informatics

Quantified Score

Hi-index	0.00

Visualization

Abstract

A novel interface system for accessing geospatial data (GeoMIP) has been developed that realizes a user-centered multimodal speech/gesture interface for addressing some of the critical needs in crisis management. In this system we primarily developed vision sensing algorithms, speech integration, multimodality fusion, and rule-based mapping of multimodal user input to GIS database queries. A demo system of this interface has been developed for the Port Authority NJ/NY and is explained here.