The use of eye movements in human-computer interaction techniques: what you look at is what you get
ACM Transactions on Information Systems (TOIS) - Special issue on computer—human interaction
Some computer science issues in ubiquitous computing
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Intelligent multimedia interfaces
Intelligent multimedia interfaces
Productivity gains via an adaptive user interface: an empirical analysis
International Journal of Human-Computer Studies
Bricks: laying the foundations for graspable user interfaces
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Direct manipulation for comprehensible, predictable and controllable user interfaces
Proceedings of the 2nd international conference on Intelligent user interfaces
Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review
IEEE Transactions on Pattern Analysis and Machine Intelligence
Designing and evaluating intelligent user interfaces
IUI '99 Proceedings of the 4th international conference on Intelligent user interfaces
Making systems sensitive to the user's time and working memory constraints
IUI '99 Proceedings of the 4th international conference on Intelligent user interfaces
Mutual disambiguation of recognition errors in a multimodel architecture
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
The visual analysis of human movement: a survey
Computer Vision and Image Understanding
Human motion analysis: a review
Computer Vision and Image Understanding
User modeling in adaptive interfaces
UM '99 Proceedings of the seventh international conference on User modeling
Ten myths of multimodal interaction
Communications of the ACM
Perceptual user interfaces: perceptual intelligence
Communications of the ACM
Perceptual user interfaces: multimodal interfaces that process what comes naturally
Communications of the ACM
Towards a fault-tolerant multi-agent system architecture
AGENTS '00 Proceedings of the fourth international conference on Autonomous agents
Automatic Analysis of Facial Expressions: The State of the Art
IEEE Transactions on Pattern Analysis and Machine Intelligence
A survey of computer vision-based human motion capture
Computer Vision and Image Understanding - Modeling people toward vision-based underatanding of a person's shape, appearance, and movement
Detecting Faces in Images: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence
Leonardo's Laptop: Human Needs and the New Computing Technologies
Leonardo's Laptop: Human Needs and the New Computing Technologies
The Psychology of Human-Computer Interaction
The Psychology of Human-Computer Interaction
Exploring Versus Exploiting when Learning User Models for Text Recommendation
User Modeling and User-Adapted Interaction
Autonomous Agents and Multi-Agent Systems
IEEE MultiMedia
Communications of the ACM
Communications of the ACM - Digital rights management
Modeling humans in human-computer interaction
The human-computer interaction handbook
The human-computer interaction handbook
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A survey of research on context-aware homes
ACSW Frontiers '03 Proceedings of the Australasian information security workshop conference on ACSW frontiers 2003 - Volume 21
Evaluation of Tracking Methods for Human-Computer Interaction
WACV '02 Proceedings of the Sixth IEEE Workshop on Applications of Computer Vision
The production and recognition of emotions in speech: features and algorithms
International Journal of Human-Computer Studies - Application of affective computing in human—Computer interaction
Joint processing of audio-visual information for the recognition of emotional expressions in human-computer interaction
Face recognition: A literature survey
ACM Computing Surveys (CSUR)
Architecture and implementation of multimodal plug and play
Proceedings of the 5th international conference on Multimodal interfaces
A framework for rapid development of multimodal interfaces
Proceedings of the 5th international conference on Multimodal interfaces
Tangible multimodal interfaces for safety-critical applications
Communications of the ACM - Multimodal interfaces that flex, adapt, and persist
Guidelines for multimodal user interface design
Communications of the ACM - Multimodal interfaces that flex, adapt, and persist
Experimental evaluation of vision and speech based multimodal interfaces
Proceedings of the 2001 workshop on Perceptive user interfaces
A cognitive meta-analysis of design approaches to interruptions in intelligent environments
CHI '04 Extended Abstracts on Human Factors in Computing Systems
BT Technology Journal
IEEE Transactions on Pattern Analysis and Machine Intelligence
Individual differences in multimodal integration patterns: what are they and why do they exist?
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-Time Vision for Human-Computer Interaction
Real-Time Vision for Human-Computer Interaction
Affective multimodal human-computer interaction
Proceedings of the 13th annual ACM international conference on Multimedia
Human-Centered Multimedia: Culture, Deployment, and Access
IEEE MultiMedia
Evaluation of a haptic mixed reality system for interactions with a virtual control panel
Presence: Teleoperators and Virtual Environments - Special section: Legal, ethical, and policy issues associated with virtual environments and computer mediated reality
An architecture and applications for speech-based accessibility systems
IBM Systems Journal
Human-Computer Interaction (3rd Edition)
Human-Computer Interaction (3rd Edition)
Real-time estimation of emotional experiences from facial expressions
Interacting with Computers
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
Defining a taxonomy of output modalities from an HCI perspective
Computer Standards & Interfaces
Editorial: Special issue: eye detection and tracking
Computer Vision and Image Understanding - Special issue on eye detection and tracking
A survey on visual surveillance of object motion and behaviors
IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
Improving user verification by implementing an agent-based security system
Journal of Ambient Intelligence and Smart Environments
Affective negotiation support systems
Journal of Ambient Intelligence and Smart Environments
A middleware for implicit interaction
Computing with instinct
Implicitly and intelligently influencing the interactive experience
Agents for games and simulations II
Future technology oriented scenarios on e-accessibility
The proceedings of the 13th international ACM SIGACCESS conference on Computers and accessibility
Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions
Journal of Ambient Intelligence and Smart Environments
UCAmI'12 Proceedings of the 6th international conference on Ubiquitous Computing and Ambient Intelligence
Journal of Ambient Intelligence and Smart Environments
| Hi-index | 0.00 |
The development of interfaces has been a technology-driven process. However, the newly developed multimodal interfaces are using recognition-based technologies that must interpret human-speech, gesture, gaze, movement patterns, and other behavioral cues. As a result, the interface design requires a human-centered approach. In this paper we review the major approaches to multimodal Human Computer Interaction, giving an overview of the user and task modeling, and of the multimodal fusion. We highlight the challenges, open issues, and the future trends in multimodal interfaces research.