Synergistic use of direct manipulation and natural language
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Intelligent multi-media interface technology
Intelligent user interfaces
The dynamic HomeFinder: evaluating dynamic queries in a real-estate information exploration system
SIGIR '92 Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval
Using aggregation and dynamic queries for exploring large data sets
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Visual information seeking: tight coupling of dynamic query filters with starfield displays
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pad++: a zooming graphical interface for exploring alternate interface physics
UIST '94 Proceedings of the 7th annual ACM symposium on User interface software and technology
ISSD-93 Selected papers presented at the international symposium on Spoken dialogue
GeoSpace: an interactive visualization system for exploring complex information spaces
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Enhanced dynamic queries via movable filters
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal interfaces for dynamic interactive maps
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
CommandTalk: a spoken-language interface for battlefield simulations
ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Multi-site data collection for a spoken language corpus
HLT '91 Proceedings of the workshop on Speech and Natural Language
Toward an information visualization workspace: combining multiple means of expression
Human-Computer Interaction
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
Making systems sensitive to the user's time and working memory constraints
IUI '99 Proceedings of the 4th international conference on Intelligent user interfaces
Generating coordinated natural language and 3D animations for complex spatial explanations
AAAI '98/IAAI '98 Proceedings of the fifteenth national/tenth conference on Artificial intelligence/Innovative applications of artificial intelligence
Mutual disambiguation of recognition errors in a multimodel architecture
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Ten myths of multimodal interaction
Communications of the ACM
Perceptual user interfaces: multimodal interfaces that process what comes naturally
Communications of the ACM
Something from nothing: augmenting a paper-based work practice via multimodal interaction
DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments
Creating tangible interfaces by augmenting physical objects with multimodal language
Proceedings of the 6th international conference on Intelligent user interfaces
A voice and ink XML multimodal architecture for mobile e-commerce systems
WMC '02 Proceedings of the 2nd international workshop on Mobile commerce
A study of people's sketching habits in GIS
Spatial Cognition and Computation
Teaching mathematical explanation through audiographic technology
Computers & Education
The Effective Combination of Haptic and Auditory Textural Information
Proceedings of the First International Workshop on Haptic Human-Computer Interaction
Ecological Interfaces: Extending the Pointing Paradigm by Visual Context
CONTEXT '99 Proceedings of the Second International and Interdisciplinary Conference on Modeling and Using Context
A Comparison of Graphics and Speech in a Task-Oriented Interactio
Diagrams '00 Proceedings of the First International Conference on Theory and Application of Diagrams
Recognizing Time Pressure and Cognitive Load on the Basis of Speech: An Experimental Study
UM '01 Proceedings of the 8th International Conference on User Modeling 2001
The human-computer interaction handbook
Multimodal Interaction During Multiparty Dialogues: Initial Results
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Advances in Robust Multimodal Interface Design
IEEE Computer Graphics and Applications
Usability issues in spoken dialogue systems
Natural Language Engineering
The efficiency of multimodal interaction for a map-based task
ANLC '00 Proceedings of the sixth conference on Applied natural language processing
QuickSet: multimodal interaction for simulation set-up and control
ANLC '97 Proceedings of the fifth conference on Applied natural language processing
Deixis and conjunction in multimodal systems
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Finite-state multimodal parsing and understanding
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
When do we interact multimodally?: cognitive load and multimodal communication patterns
Proceedings of the 6th international conference on Multimodal interfaces
Speech-based cursor control: a study of grid-based solutions
Assets '04 Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility
ACM Transactions on Computer-Human Interaction (TOCHI)
ACM SIGACCESS Accessibility and Computing
Usability of speech based and multimodal interaction in a learning micro-world
IHM 2003 Proceedings of the 15th French-speaking conference on human-computer interaction on 15eme Conference Francophone sur l'Interaction Homme-Machine
Finite-state multimodal integration and understanding
Natural Language Engineering
Enabling context-sensitive information seeking
Proceedings of the 11th international conference on Intelligent user interfaces
Proceedings of the working conference on Advanced visual interfaces
A longitudinal evaluation of hands-free speech-based navigation during dictation
International Journal of Human-Computer Studies
Human-centered design meets cognitive load theory: designing interfaces that help people think
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Fusion of children's speech and 2D gestures when conversing with 3D characters
Signal Processing - Special section: Multimodal human-computer interfaces
Signal Processing - Special section: Multimodal human-computer interfaces
Modeling the impact of shared visual information on collaborative reference
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multimodal multiplayer tabletop gaming
Computers in Entertainment (CIE) - Interactive TV
Supporting Community Emergency Management Planning through a Geocollaboration Software Architecture
Computer Supported Cooperative Work
Speech-filtered bubble ray: improving target acquisition on display walls
Proceedings of the 9th international conference on Multimodal interfaces
Multimodal interaction analysis in a smart house
Proceedings of the 9th international conference on Multimodal interfaces
Multimodal interaction systems: information and time features
International Journal of Web and Grid Services
Personalised maps in multimodal mobile GIS
International Journal of Web Engineering and Technology
Proceedings of the 13th international conference on Intelligent user interfaces
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
Robust gesture processing for multimodal interaction
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Introduction to this special issue on multimodal interfaces
Human-Computer Interaction
Commentary on "Damaged merchandise?"
Human-Computer Interaction
Hands-free, speech-based navigation during dictation: difficulties, consequences, and solutions
Human-Computer Interaction
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
Expressive pen-based interfaces for math education
CSCL'07 Proceedings of the 8th iternational conference on Computer supported collaborative learning
EACL '06 Proceedings of the Eleventh Conference of the European Chapter of the Association for Computational Linguistics: Student Research Workshop
Speech-Based Navigation: Improving Grid-Based Solutions
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Robust understanding in multimodal interfaces
Computational Linguistics
Multimodal interaction: a new focal area for AI
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Investigating Grid-Based Navigation: The Impact of Physical Disability
ACM Transactions on Accessible Computing (TACCESS)
Mulitmodal interaction for distributed interactive simulation
AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence
Speak4it: multimodal interaction for local search
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Location grounding in multimodal local search
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Design and evaluation of a multimodal interface for in-car communication systems
SAICSIT '10 Proceedings of the 2010 Annual Research Conference of the South African Institute of Computer Scientists and Information Technologists
Multimodal local search in Speak4it
Proceedings of the 16th international conference on Intelligent user interfaces
A middleware for implicit interaction
Computing with instinct
Implicitly and intelligently influencing the interactive experience
Agents for games and simulations II
TMS for multimodal information processing
Multimedia Tools and Applications
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: design for all and eInclusion - Volume Part I
Multimodal, touchless interaction in spatial augmented reality environments
ICDHM'11 Proceedings of the Third international conference on Digital human modeling
Developing accessible TV applications
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
A multimodal reference resolution approach in virtual environment
VSMM'06 Proceedings of the 12th international conference on Interactive Technologies and Sociotechnical Systems
Multimodal architectures: issues and experiences
OTM'06 Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part I
Multimodal interaction patterns in mobile local search
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Delivering personalized context-aware spatial information to mobile devices
W2GIS'05 Proceedings of the 5th international conference on Web and Wireless Geographical Information Systems
Multimodal behavior and interaction as indicators of cognitive load
ACM Transactions on Interactive Intelligent Systems (TiiS) - Special issue on highlights of the decade in interactive intelligent systems
Finger-based multitouch interface for performing 3D CAD operations
International Journal of Human-Computer Studies
Cognitive Resource-Aware Adaptive Web Service Binding and Scheduling
WI-IAT '12 Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 01
PixelTone: a multimodal interface for image editing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
VideoKheti: making video content accessible to low-literate and novice users
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Design guidelines for adaptive multimodal mobile input solutions
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
The adjustable grid: a grid-based cursor control solution using speech recognition
Proceedings of the 51st ACM Southeast Conference
OrMiS: a tabletop interface for simulation-based training
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Demonstration of sketch-thru-plan: a multimodal interface for command and control
Proceedings of the 15th ACM on International conference on multimodal interaction
| Hi-index | 0.03 |
Dynamic interactive maps with powerful interface capabilities are beginning to emerge for a variety of geographical information systems, including ones situated on portables for travelers, students, business and service people, and others working in field settings. In part through the design of more expressive and flexible input capabilities, these map systems can provide new capabilities not supported by conventional interfaces of the past. In this research, interfaces supporting spoken, pen-based, and multimodal input were analyzed for their effectiveness in interacting with map systems. Input modality and map display format were varied as people completed realistic tasks with a simulated map system. The results identified a constellation of performance difficulties with speech-only map interactions, including elevated performance errors, lengthier task completion time, and more complex and disfluent input-problems that declined substantially when people could interact multimodally. These difficulties also mirrored a strong user preference to interact multimodally. The error-proneness and unacceptability of speech-only input to maps was traced to people's difficulty articulating spatially oriented descriptions. Analyses also indicated that map displays can be structured to minimize performance errors and disfluencies effectively. Implications of this research are discussed for the design of high-performance multimodal interfaces for future map systems.