Integration and synchronization of input modes during multimodal human-computer interaction

QuickSet: multimodal interaction for distributed applications

MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia

Synchronization of speech and hand gestures during multimodal human-computer interaction

CHI 98 Cconference Summary on Human Factors in Computing Systems

An empirical study of speech and gesture interaction: toward the definition of ergonomic design guidelines

CHI 98 Cconference Summary on Human Factors in Computing Systems

Mutual disambiguation of recognition errors in a multimodel architecture

Proceedings of the SIGCHI conference on Human Factors in Computing Systems

Ten myths of multimodal interaction

Communications of the ACM

Expression constraints in multimodal human-computer interaction

Proceedings of the 5th international conference on Intelligent user interfaces

Something from nothing: augmenting a paper-based work practice via multimodal interaction

DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments

Multimodal error correction for speech user interfaces

ACM Transactions on Computer-Human Interaction (TOCHI)

A framework to manage multimodal fusion of events for advanced interactions within virtual environments

EGVE '02 Proceedings of the workshop on Virtual environments 2002

EMBASSI: multimodal assistance for universal access to infotainment and service infrastructures

WUAUC'01 Proceedings of the 2001 EC/NSF workshop on Universal accessibility of ubiquitous computing: providing for the elderly

Designing robust multimodal systems for universal access

WUAUC'01 Proceedings of the 2001 EC/NSF workshop on Universal accessibility of ubiquitous computing: providing for the elderly

Multimodal human discourse: gesture and speech

ACM Transactions on Computer-Human Interaction (TOCHI)

A voice and ink XML multimodal architecture for mobile e-commerce systems

WMC '02 Proceedings of the 2nd international workshop on Mobile commerce

Teaching mathematical explanation through audiographic technology

Computers & Education

An Experimental Study of Input Modes for Multimodal Human-Computer Interaction

ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces

Multimodal Integration Using Complex Feature Set

ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces

Ecological Interfaces: Extending the Pointing Paradigm by Visual Context

CONTEXT '99 Proceedings of the Second International and Interdisciplinary Conference on Modeling and Using Context

A Multimodal Interface Framework for Using Hand Gestures and Speech in Virtual Environment Applications

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction

The Ecological Approach to Multimodal System Design

GW '99 Proceedings of the International Gesture Workshop on Gesture-Based Communication in Human-Computer Interaction

Why Are Multimodal Systems so Difficult to Build? - About the Difference between Deictic Gestures and Direct Manipulation

CMC '98 Revised Papers from the Second International Conference on Cooperative Multimodal Communication

Toward Natural Gesture/Speech Control of a Large Display

EHCI '01 Proceedings of the 8th IFIP International Conference on Engineering for Human-Computer Interaction

Multimodal interfaces

The human-computer interaction handbook

Outil de prototypage pour la conception et l'evaluation d'interfaces utilisateur multimodales

IHM '02 Proceedings of the 14th French-speaking conference on Human-computer interaction (Conférence Francophone sur l'Interaction Homme-Machine)

Advances in the robust processing of multimodal speech and pen systems

Multimodal interface for human-machine communication

Multimodal Interaction During Multiparty Dialogues: Initial Results

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

Prosody Based Co-analysis for Continuous Recognition of Coverbal Gestures

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

The Added Value of Multimodality in the NESPOLE! Speech-to-Speech Translation System: an Experimental Study

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces

Visual display, pointing, and natural language: the power of multimodal interaction

AVI '98 Proceedings of the working conference on Advanced visual interfaces

Toward a theory of organized multimodal integration patterns during human-computer interaction

Proceedings of the 5th international conference on Multimodal interfaces

Where is "it"? Event Synchronization in Gaze-Speech Input Systems

Proceedings of the 5th international conference on Multimodal interfaces

A visually grounded natural language interface for reference to spatial scenes

Proceedings of the 5th international conference on Multimodal interfaces

Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences

Proceedings of the 5th international conference on Multimodal interfaces

A probabilistic approach to reference resolution in multimodal user interfaces

Proceedings of the 9th international conference on Intelligent user interfaces

Naturally conveyed explanations of device behavior

Proceedings of the 2001 workshop on Perceptive user interfaces

QuickSet: multimodal interaction for simulation set-up and control

ANLC '97 Proceedings of the fifth conference on Applied natural language processing

Unification-based multimodal integration

ACL '98 Proceedings of the 35th Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics

Confirmation in multimodal systems

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 2

Unification-based multimodal parsing

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1

ISIS: an adaptive, trilingual conversational system with interleaving interaction and delegation dialogs

ACM Transactions on Computer-Human Interaction (TOCHI)

Elvis: situated speech and gesture understanding for a robotic chandelier

Proceedings of the 6th international conference on Multimodal interfaces

Implementation and evaluation of a constraint-based multimodal fusion system for speech and 3D pointing gestures

Proceedings of the 6th international conference on Multimodal interfaces

Linguistic theories in efficient multimodal reference resolution: an empirical investigation

Proceedings of the 10th international conference on Intelligent user interfaces

Multimodal new vocabulary recognition through speech and handwriting in a whiteboard scheduling application

Proceedings of the 10th international conference on Intelligent user interfaces

Individual differences in multimodal integration patterns: what are they and why do they exist?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Children's and adults' multimodal interaction with 2D conversational agents

CHI '05 Extended Abstracts on Human Factors in Computing Systems

An adaptive approach to collecting multimodal input

ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 2

TGH: a case study of designing natural interaction for mobile guide systems

Proceedings of the 7th international conference on Human computer interaction with mobile devices & services

Inferring body pose using speech content

ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces

Multimodal user input patterns in a non-visual context

Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility

Evaluating tangible objects for multimodal interaction design

OZCHI '05 Proceedings of the 17th Australia conference on Computer-Human Interaction: Citizens Online: Considerations for Today and the Future

Multimodal error correction for continuous handwriting recognition in pen-based user interfaces

Proceedings of the 11th international conference on Intelligent user interfaces

Adding extra input/output modalities to a spoken dialogue system

SIGDIAL '01 Proceedings of the Second SIGdial Workshop on Discourse and Dialogue - Volume 16

Component-based multimodal dialog interfaces for mobile knowledge creation

HLTKM '01 Proceedings of the workshop on Human Language Technology and Knowledge Management - Volume 2001

Working with robots and objects: revisiting deictic reference for achieving spatial common ground

Proceedings of the 1st ACM SIGCHI/SIGART conference on Human-robot interaction

Multimodal spatial reference in mediated environments: users' preferences and the pragmatics of pointing and talking

CHI '06 Extended Abstracts on Human Factors in Computing Systems

QuickFusion: multimodal fusion without time thresholds

MMUI '05 Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop - Volume 57

Human-centered collaborative interaction

Proceedings of the 1st ACM international workshop on Human-centered multimedia

Using redundant speech and handwriting for learning new vocabulary and understanding abbreviations

Proceedings of the 8th international conference on Multimodal interfaces

Naturally conveyed explanations of device behavior

ACM SIGGRAPH 2006 Courses

Health dialog systems for patients and consumers

Journal of Biomedical Informatics - Special issue: Dialog systems for health communications

Optimization in multimodal interpretation

ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics

Fusion of children's speech and 2D gestures when conversing with 3D characters

Signal Processing - Special section: Multimodal human-computer interfaces

Towards a taxonomy of error-handling strategies in recognition-based multi-modal human-computer interfaces

Signal Processing - Special section: Multimodal human-computer interfaces

Multimodal redundancy across handwriting and speech during computer mediated human-human interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Modeling the impact of shared visual information on collaborative reference

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Effects of tactile augmentation and self-body visualization on affective property evaluation of virtual mobile phone designs

Presence: Teleoperators and Virtual Environments

The drive to create: an investigation of tools to support disabled artists

Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition

The catchment feature model: a device for multimodal fusion and a bridge between signal and sense

EURASIP Journal on Applied Signal Processing

Multimodal interaction analysis in a smart house

Proceedings of the 9th international conference on Multimodal interfaces

Delivering interactive multimedia services in dynamic pervasive computing environments

Proceedings of the 1st international conference on Ambient media and systems

Speech and sketching: an empirical study of multimodal interaction

SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling

HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

Tlk or txt? Using voice input for SMS composition

Personal and Ubiquitous Computing

Real-Time Gesture Recognition, Evaluation and Feed-Forward Correction of a Multimodal Tai-Chi Platform

HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design

Multimodal interactive maps: designing for human performance

Human-Computer Interaction

Designing the user interface for multimodal speech and pen-based gesture applications: state-of-the-art systems and future research directions

Human-Computer Interaction

Handling uncertainty in multimodal pervasive computing applications

Computer Communications

Be Brief, And They Shall Learn: Generating Concise Language Feedback for a Computer Tutor

International Journal of Artificial Intelligence in Education

Think before you talk: an empirical study of relationship between speech pauses and cognitive load

Proceedings of the 20th Australasian Conference on Computer-Human Interaction: Designing for Habitus and Habitat

Designing Aircraft Cockpit Displays: Borrowing from Multimodal User Interfaces

Transactions on Computational Science III

Voice art: investigating paralinguistic voice as a mode of interaction to create visual art

BCS-HCI '07 Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...but not as we know it - Volume 2

Formalization of Multimodal Languages in Pervasive Computing Paradigm

Advanced Internet Based Systems and Applications

Performance evaluation and error analysis for multimodal reference resolution in a conversation system

HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers

UI on the Fly: generating a multimodal user interface

HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers

Multimodal Interaction within Ambient Environments: An Exploratory Study

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II

Robust understanding in multimodal interfaces

Computational Linguistics

Referring in multimodal systems: the importance of user expertise and system features

ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment

Cognitive principles in robust multimodal interpretation

Journal of Artificial Intelligence Research

Communicative gestures in coreference identification in multiparty meetings

Proceedings of the 2009 international conference on Multimodal interfaces

Combining speech and sketch to interpret unconstrained descriptions of mechanical devices

IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence

Usage patterns and latent semantic analyses for task goal inference of multimodal user interactions

Proceedings of the 15th international conference on Intelligent user interfaces

VR-CAD integration: Multimodal immersive interaction and advanced haptic paradigms for implicit edition of CAD models

Computer-Aided Design

Multimodal interfaces for in-vehicle applications

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: intelligent multimodal interaction environments

Wizard of oz for multimodal interfaces design: deployment considerations

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

A hybrid grammar-based approach to multimodal languages specification

OTM'07 Proceedings of the 2007 OTM confederated international conference on On the move to meaningful internet systems - Volume Part I

Adaptive user interactive sketching for teaching based on pen gesture

EPCE'07 Proceedings of the 7th international conference on Engineering psychology and cognitive ergonomics

Integrating semantics into multimodal interaction patterns

MLMI'07 Proceedings of the 4th international conference on Machine learning for multimodal interaction

Mulitmodal interaction for distributed interactive simulation

AAAI'97/IAAI'97 Proceedings of the fourteenth national conference on artificial intelligence and ninth conference on Innovative applications of artificial intelligence

A graphical tactile screen-explorer

ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs

Generating multimodal grammars for multimodal dialogue processing

IEEE Transactions on Systems, Man, and Cybernetics, Part A: Systems and Humans

Evaluating multimodal affective fusion using physiological signals

Proceedings of the 16th international conference on Intelligent user interfaces

Hand gestures in disambiguating types of you expressions in multiparty meetings

SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Enhancing multi-lingual information extraction via cross-media inference and fusion

COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters

An advanced multimodal platform for educational social networks

OTM'10 Proceedings of the 2010 international conference on On the move to meaningful internet systems

Multimodal behavior realization for embodied conversational agents

Multimedia Tools and Applications

Multimodal, touchless interaction in spatial augmented reality environments

ICDHM'11 Proceedings of the Third international conference on Digital human modeling

Developing accessible TV applications

The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility

Toward adaptive information fusion in multimodal systems

MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction

Tracking body parts of multiple people for multi-person multimodal interface

ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction

Multimodal architectures: issues and experiences

OTM'06 Proceedings of the 2006 international conference on On the Move to Meaningful Internet Systems: AWeSOMe, CAMS, COMINF, IS, KSinBIT, MIOS-CIAO, MONET - Volume Part I

Integrating intra and extra gestures into a mobile and multimodal shopping assistant

PERVASIVE'05 Proceedings of the Third international conference on Pervasive Computing

Multimodal interaction patterns in mobile local search

Proceedings of the 2012 ACM international conference on Intelligent User Interfaces

Combining user modeling and machine learning to predict users' multimodal integration patterns

MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction

Design of human-centric adaptive multimodal interfaces

International Journal of Human-Computer Studies

Pointing and speech: comparison of various voice commands

Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design

Move it there, or not?: the design of voice commands for gaze with speech

Proceedings of the 4th Workshop on Eye Gaze in Intelligent Human Machine Interaction

Latent Semantic Analysis for Multimodal User Input With Speech and Gestures

IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)