Understanding Human Behaviors Based on Eye-Head-Hand Coordination
BMCV '02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision
Attentional Object Spotting by Integrating Multimodal Input
ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A multimodal learning interface for grounding spoken language in sensory perceptions
Proceedings of the 5th international conference on Multimodal interfaces
A multimodal learning interface for grounding spoken language in sensory perceptions
ACM Transactions on Applied Perception (TAP)
Multi-agent activity recognition using observation decomposedhidden Markov models
Image and Vision Computing
A cognitive vision system for action recognition in office environments
CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
DAGM'06 Proceedings of the 28th conference on Pattern Recognition
Survey on classifying human actions through visual sensors
Artificial Intelligence Review
| Hi-index | 0.00 |
One of the major sources of cues in developmentallearning is that of watching another person.An observercan gain a comprehensive description of the purposes of actions by watching the other person's detailed body movements.Action recognition has traditionally studied processing fixed camera observations while ignoring non-visual information.This paper explores the dynamic properties of eye movements in natural tasks: eye and head movements are quite tightly coupled with actions. We present a method that utilizes eye gaze and head position information to detect the performer's focus of attention.Attention, as represented by eye fixation, is usedfor spotting the target object related to the action.Attention switches are calculated and used to segment the action sequence into action units which are recognized by Hidden Markov Models.An experimental system is built for recognizing actions in the natural task of "stapling a letter" which demonstrates the effectiveness of the approach.