Pfinder: Real-Time Tracking of the Human Body
IEEE Transactions on Pattern Analysis and Machine Intelligence
Gesture recognition using the Perseus architecture
CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
Integrated Person Tracking Using Stereo, Color, and Pattern Detection
CVPR '98 Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Invariant features for 3-D gesture recognition
FG '96 Proceedings of the 2nd International Conference on Automatic Face and Gesture Recognition (FG '96)
Detection and Estimation of Pointing Gestures in Dense Disparity Maps
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Real-Time Self-Calibrating Stereo Person Tracking Using 3-D Shape Estimation from Blob Features
ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
Recognition and Interpretation of Parametric Gesture
ICCV '98 Proceedings of the Sixth International Conference on Computer Vision
Proceedings of the 6th international conference on Multimodal interfaces
Real-time monocular tracking of view frustum for large screen human-computer interaction
ACSC '05 Proceedings of the Twenty-eighth Australasian conference on Computer Science - Volume 38
A study of manual gesture-based selection for the PEMMI multimodal transport management interface
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Distant freehand pointing and clicking on very large, high resolution displays
Proceedings of the 18th annual ACM symposium on User interface software and technology
An exploratory analysis of partner action and camera control in a video-mediated collaborative task
CSCW '06 Proceedings of the 2006 20th anniversary conference on Computer supported cooperative work
Estimating virtual touchscreen for fingertip interaction with large displays
OZCHI '06 Proceedings of the 18th Australia conference on Computer-Human Interaction: Design: Activities, Artefacts and Environments
Move to improve: promoting physical navigation to increase user performance with large displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Visual Analytics: Realizing embodied interaction for visual analytics through large displays
Computers and Graphics
Audio-visual multi-person tracking and identification for smart environments
Proceedings of the 15th international conference on Multimedia
AFRIGRAPH '07 Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa
Using alternative views for layout, comparison and context switching tasks in wall displays
OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Robust hand tracking using a simple color classification technique
VRCAI '08 Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
Initial evaluation of a bare-hand interaction technique for large displays using a webcam
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
An intelligent robotic assistive living system
Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
The Attentive Hearing Aid: Eye Selection of Auditory Sources for Hearing Impaired Users
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Hand Pointing Accuracy for Vision-Based Interactive Systems
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Extending touch: towards interaction with large-scale surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
3D user interface combining gaze and hand gestures for large-scale display
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Multi- and single view multiperson tracking for smart room environments
CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
Dwell-based pointing in applications of human computer interaction
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Comparison of human and machine recognition of everyday human actions
ICDHM'07 Proceedings of the 1st international conference on Digital human modeling
The recognition and comprehension of hand gestures: a review and research agenda
ZiF'06 Proceedings of the Embodied communication in humans and machines, 2nd ZiF research group international conference on Modeling communication with robots and virtual humans
Real-time 3D pointing gesture recognition for mobile robots with cascade HMM and particle filter
Image and Vision Computing
Interpreting pointing gestures and spoken requests: a probabilistic, salience-based approach
COLING '10 Proceedings of the 23rd International Conference on Computational Linguistics: Posters
3D-tracking of head and hands for pointing gesture recognition in a human-robot interaction scenario
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Head pose estimation using stereo vision for human-robot interaction
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
3D remote interface for smart displays
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Natural activation for gesture recognition systems
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Human-centered visualization environments
Human-centered visualization environments
Pub - point upon body: exploring eyes-free interaction and methods on an arm
Proceedings of the 24th annual ACM symposium on User interface software and technology
Robot navigation by eye pointing
ICEC'05 Proceedings of the 4th international conference on Entertainment Computing
Deictic gestures with a time-of-flight camera
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
Vision-based handwriting recognition for unrestricted text input in mid-air
Proceedings of the 14th ACM international conference on Multimodal interaction
High-precision pointing on large wall displays using small handheld devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Free-hand pointing for identification and interaction with distant objects
Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
| Hi-index | 0.00 |
In this paper, we present a system capable of visually detecting pointing gestures and estimating the 3D pointing direction in real-time. In order to acquire input features for gesture recognition, we track the positions of a person's face and hands on image sequences provided by a stereo-camera. Hidden Markov Models (HMMs), trained on different phases of sample pointing gestures, are used to classify the 3D-trajectories in order to detect the occurrence of a gesture. When analyzing sample pointing gestures, we noticed that humans tend to look at the pointing target while performing the gesture. In order to utilize this behavior, we additionally measured head orientation by means of a magnetic sensor in a similar scenario. By using head orientation as an additional feature, we observed significant gains in both recall and precision of pointing gestures. Moreover, the percentage of correctly identified pointing targets improved significantly from 65% to 83%. For estimating the pointing direction, we comparatively used three approaches: 1) The line of sight between head and hand, 2) the forearm orientation, and 3) the head orientation.