Synergistic use of direct manipulation and natural language
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Speech and gestures for graphic image manipulation
CHI '89 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Communications of the ACM
Charade: remote control of objects using free-hand gestures
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Interacting with paper on the DigitalDesk
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Integrating simultaneous input from speech, gaze, and hand gestures
Intelligent multimedia interfaces
Toward a vision-based hand gesture interface
VRST '94 Proceedings of the conference on Virtual reality software and technology
An approach to natural gesture in virtual environments
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on virtual reality software and technology
Coordinating vocal and visual parameters for 3D virtual agents
VE '95 Selected papers of the Eurographics workshops on Virtual environments '95
Integration and synchronization of input modes during multimodal human-computer interaction
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Synergistic use of direct manipulation and natural language
Readings in intelligent user interfaces
Natural language with integrated deictic and graphic gestures
Readings in intelligent user interfaces
RIEVL: Recursive Induction Learning in Hand Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Mutual disambiguation of recognition errors in a multimodel architecture
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Parametric Hidden Markov Models for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
An HMM-Based Threshold Model Approach for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
Perceptual user interfaces: multimodal interfaces that process what comes naturally
Communications of the ACM
Multimodal human discourse: gesture and speech
ACM Transactions on Computer-Human Interaction (TOCHI)
A Multimedia System for Temporally Situated Perceptual Psycholinguistic Analysis
Multimedia Tools and Applications
Unencumbered Gestural Interaction
IEEE MultiMedia
IEEE Computer Graphics and Applications
Computer Vision for Interactive Computer Graphics
IEEE Computer Graphics and Applications
IEEE Transactions on Pattern Analysis and Machine Intelligence
Vector Coherence Mapping: A Parallelizable Approach to Image Flow Computation
ACCV '98 Proceedings of the Third Asian Conference on Computer Vision-Volume II
Research Challenges in Gesture: Open Issues and Unsolved Problems
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Movement Phase in Signs and Co-Speech Gestures, and Their Transcriptions by Human Coders
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Velocity Profile Based Recognition of Dynamic Gestures with Discrete Hidden Markov Models
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Video-Based Sign Language Recognition Using Hidden Markov Models
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
High Performance Real-Time Gesture Recognition Using Hidden Markov Models
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
On the Use of Context and A Priori Knowledge in Motion Analysis for Visual Gesture Recognition
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Neural Architecture for Gesture-Based Human-Machine-Interaction
Proceedings of the International Gesture Workshop on Gesture and Sign Language in Human-Computer Interaction
Visual Gesture Interfaces for Virtual Environments
AUIC '00 Proceedings of the First Australasian User Interface Conference
Audio and Vision-Based Evaluation of Parkinson's Disease from Discourse Video
BIBE '01 Proceedings of the 2nd IEEE International Symposium on Bioinformatics and Bioengineering
Gesture recognition using the Perseus architecture
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Nonlinear PHMMs for the Interpretation of Parameterized Gesture
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Computer vision for computer games
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Invited Speech: "Gestural Interface to a visual computing Environment for Molecular biologists"
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Inductive learning in hand pose recognition
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Recovering the Temporal Structure of Natural Gesture
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Dynamical system representation, generation, and recognition of basic oscillatory motion gestures
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Robust classification of hand postures against complex backgrounds
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Toward the use of gesture in traditional user interfaces
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
A Gesture Interface for Human-Robot-Interaction
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
View-Based Interpretation of Real-Time Optical Flow for Gesture Recognition
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Recognizing Temporal Trajectories Using the Condensation Algorithm
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Segmenting Hands of Arbitrary Color
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Automatic Handwriting Gestures Recognition Using Hidden Markov Models
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
CHI '82 Proceedings of the 1982 Conference on Human Factors in Computing Systems
“Put-that-there”: Voice and gesture at the graphics interface
SIGGRAPH '80 Proceedings of the 7th annual conference on Computer graphics and interactive techniques
A Parallel Algorithm for Dynamic Gesture Tracking
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Comparison of Five Color Models in Skin Pixel Classification
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Gesture Cues for Conversational Interaction in Monocular Video
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Computer Vision for Television and Games
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Real-Time Context-Based Gesture Recognition Using HMM and Automaton
RATFG-RTS '99 Proceedings of the International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems
Fast and Accurate 3D Gesture Recognition Interface
ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 1 - Volume 1
Gesture Patterns during Speech Repairs
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
Hand Gesture Symmetric Behavior Detection and Analysis in Natural Conversation
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
DigitEyes: Vision-Based Human Hand Tracking
DigitEyes: Vision-Based Human Hand Tracking
Glove-talkii: mapping hand gestures to speech using neural networks. an approach to building adaptive interfaces
The virtual windtunnel: an environment for the exploration of three-dimensional unsteady flows
VIS '91 Proceedings of the 2nd conference on Visualization '91
Gesture Based 3D Man-Machine Interaction using a Single Camera
ICMCS '99 Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2
Hand motion gestural oscillations and multimodal discourse
Proceedings of the 5th international conference on Multimodal interfaces
Oscillatory gestures and discourse
ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 2
Structural and temporal inference search (STIS): pattern identification in multimodal data
Proceedings of the 14th ACM international conference on Multimodal interaction
Interactive data-driven discovery of temporal behavior models from events in media streams
Proceedings of the 20th ACM international conference on Multimedia
Interactive data-driven search and discovery of temporal behavior patterns from media streams
Proceedings of the 20th ACM international conference on Multimedia
Enabling the blind to see gestures
ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on the theory and practice of embodied interaction in HCI and interaction design
Hi-index | 0.00 |
The catchment feature model addresses two questions in the field of multimodal interaction: how we bridge video and audio processing with the realities of human multimodal communication, and how information from the different modes may be fused. We argue from a detailed literature review that gestural research has clustered around manipulative and semaphoric use of the hands, motivate the catchment feature model psycholinguistic research, and present the model. In contrast to "whole gesture" recognition, the catchment feature model applies a feature decomposition approach that facilitates cross-modal fusion at the level of discourse planning and conceptualization. We present our experimental framework for catchment feature-based research, cite three concrete examples of catchment features, and propose new directions of multimodal research based on the model.