Specifying gestures by example
Proceedings of the 18th annual conference on Computer graphics and interactive techniques
COLLAGEN: A Collaboration Manager for Software Interface Agents
User Modeling and User-Adapted Interaction
An architecture for a generic dialogue shell
Natural Language Engineering
Deixis and conjunction in multimodal systems
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
Finite-state multimodal parsing and understanding
COLING '00 Proceedings of the 18th conference on Computational linguistics - Volume 1
The CommandTalk spoken dialogue system
ACL '99 Proceedings of the 37th annual meeting of the Association for Computational Linguistics on Computational Linguistics
An empirical study of the influence of user tailoring on evaluative argument effectiveness
IJCAI'01 Proceedings of the 17th international joint conference on Artificial intelligence - Volume 2
Context-Sensitive Help for Multimodal Dialogue
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
SmartKom: adaptive and flexible multimodal access to multiple applications
Proceedings of the 5th international conference on Multimodal interfaces
Speech and sketching for multimodal design
Proceedings of the 9th international conference on Intelligent user interfaces
Proceedings of the 6th international conference on Multimodal interfaces
Finite-state multimodal integration and understanding
Natural Language Engineering
An adaptive approach to collecting multimodal input
ACL '03 Proceedings of the 41st Annual Meeting on Association for Computational Linguistics - Volume 2
Exploiting a sensed environment to improve human-agent communication
Proceedings of the fourth international joint conference on Autonomous agents and multiagent systems
Integrating sketch and speech inputs using spatial information
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
A Speech-Centric Perspective for Human-Computer Interface: A Case Study
Journal of VLSI Signal Processing Systems
Enabling context-sensitive information seeking
Proceedings of the 11th international conference on Intelligent user interfaces
Interactive multimedia summaries of evaluative text
Proceedings of the 11th international conference on Intelligent user interfaces
HITIQA: an interactive question answering system a preliminary report
MultiSumQA '03 Proceedings of the ACL 2003 workshop on Multilingual summarization and question answering - Volume 12
Multimodal interaction on mobile phones: development and evaluation using ACICARE
Proceedings of the 8th conference on Human-computer interaction with mobile devices and services
Speech and sketching for multimodal design
ACM SIGGRAPH 2006 Courses
Optimization in multimodal interpretation
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
Trainable sentence planning for complex information presentation in spoken dialog systems
ACL '04 Proceedings of the 42nd Annual Meeting on Association for Computational Linguistics
MATCHKiosk: a multimodal interactive city guide
ACLdemo '04 Proceedings of the ACL 2004 on Interactive poster and demonstration sessions
A salience driven approach to robust input interpretation in multimodal conversational systems
HLT '05 Proceedings of the conference on Human Language Technology and Empirical Methods in Natural Language Processing
Speech and sketching for multimodal design
ACM SIGGRAPH 2007 courses
Proceedings of the 13th international conference on Intelligent user interfaces
Speech and sketching: an empirical study of multimodal interaction
SBIM '07 Proceedings of the 4th Eurographics workshop on Sketch-based interfaces and modeling
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
The Effect of Emotional Speech on a Smart-Home Application
IEA/AIE '08 Proceedings of the 21st international conference on Industrial, Engineering and Other Applications of Applied Intelligent Systems: New Frontiers in Applied Artificial Intelligence
Tailoring the Interpretation of Spatial Utterances for Playing a Board Game
AIMSA '08 Proceedings of the 13th international conference on Artificial Intelligence: Methodology, Systems, and Applications
Towards a minimalist multimodal dialogue framework using recursive MVC pattern
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
The WAMI toolkit for developing, deploying, and evaluating web-accessible multimodal interfaces
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
A browser-based multimodal interaction system
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Robust gesture processing for multimodal interaction
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Steps in Identifying Interaction Design Patterns for Multimodal Systems
HCSE-TAMODIA '08 Proceedings of the 2nd Conference on Human-Centered Software Engineering and 7th International Workshop on Task Models and Diagrams
Voice enabling mobile financial services with multimodal transformation
International Journal of Mobile Communications
The multimodal presentation dashboard
NAACL-HLT-Dialog '07 Proceedings of the Workshop on Bridging the Gap: Academic and Industrial Research in Dialog Technologies
HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
UI on the Fly: generating a multimodal user interface
HLT-NAACL-Short '04 Proceedings of HLT-NAACL 2004: Short Papers
Sentence planning for realtime navigational instructions
NAACL-Short '06 Proceedings of the Human Language Technology Conference of the NAACL, Companion Volume: Short Papers
Robust understanding in multimodal interfaces
Computational Linguistics
Individual and domain adaptation in sentence planning for dialogue
Journal of Artificial Intelligence Research
Building multimodal applications with EMMA
Proceedings of the 2009 international conference on Multimodal interfaces
Between linguistic attention and gaze fixations inmultimodal conversational interfaces
Proceedings of the 2009 international conference on Multimodal interfaces
An information state-based dialogue manager for call for fire dialogues
SigDIAL '06 Proceedings of the 7th SIGdial Workshop on Discourse and Dialogue
Combining speech and sketch to interpret unconstrained descriptions of mechanical devices
IJCAI'09 Proceedings of the 21st international jont conference on Artifical intelligence
Noun phrase generation for situated dialogs
INLG '06 Proceedings of the Fourth International Natural Language Generation Conference
Discourse planning for information composition and delivery: A reusable platform
Natural Language Engineering
Contextual coherence in natural language processing
CONTEXT'03 Proceedings of the 4th international and interdisciplinary conference on Modeling and using context
A comparison of speech and GUI input for navigation in complex visualizations on mobile devices
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Learning about voice search for spoken dialogue systems
HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Classifying dialogue acts in one-on-one live chats
EMNLP '10 Proceedings of the 2010 Conference on Empirical Methods in Natural Language Processing
Speak4it: multimodal interaction for local search
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Location grounding in multimodal local search
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
Multimodal local search in Speak4it
Proceedings of the 16th international conference on Intelligent user interfaces
Utilizing review summarization in a spoken recommendation system
SIGDIAL '10 Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue
Interpreting pointing gestures and spoken requests: a probabilistic, salience-based approach
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
Enabling the mobile web through auto-generating multimodal web pages
CIMMACS'05 Proceedings of the 4th WSEAS international conference on Computational intelligence, man-machine systems and cybernetics
Utilizing visual attention for cross-modal coreference interpretation
CONTEXT'05 Proceedings of the 5th international conference on Modeling and Using Context
Multimodal interaction patterns in mobile local search
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Collecting multimodal data in the wild
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Multimodal dialogue in mobile local search
Proceedings of the 14th ACM international conference on Multimodal interaction
An exploration of gesture-speech multimodal patterns for touch interfaces
Proceedings of the 3rd International Conference on Human Computer Interaction
A multimodal dialogue interface for mobile local search
Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion
VideoKheti: making video content accessible to low-literate and novice users
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A dialogue system for multimodal human-robot interaction
Proceedings of the 15th ACM on International conference on multimodal interaction
| Hi-index | 0.00 |
Mobile interfaces need to allow the user and system to adapt their choice of communication modes according to user preferences, the task at hand, and the physical and social environment. We describe a multimodal application architecture which combines finite-state multimodal language processing, a speech-act based multimodal dialogue manager, dynamic multimodal output generation, and user-tailored text planning to enable rapid prototyping of multimodal interfaces with flexible input and adaptive output. Our testbed application MATCH (Multimodal Access To City Help) provides a mobile multimodal speech-pen interface to restaurant and sub-way information for New York City.