Attention monitoring based on temporal signal-behavior structures

Authors:
Akira Utsumi;Shinjiro Kawato;Shinji Abe
Affiliations:
ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Kyoto, Japan
Venue:
ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction
Year:
2005

Citing 9
Cited 1

3-D model-based tracking of humans in action: a multi-view approach

CVPR '96 Proceedings of the 1996 Conference on Computer Vision and Pattern Recognition (CVPR '96)
3-D Facial Pose and Gaze Point Estimation Using a Robust Real-Time Tracking Paradigm

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Automatic Detection of Human Faces in Natural Scene Images by Use of a Skin Color Model and of Invariant Moments

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
A real-time face tracker

WACV '96 Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision (WACV '96)
Tracking Human Motion Using Multiple Cameras

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
A Camera-Based System for Tracking People in Real Time

ICPR '96 Proceedings of the International Conference on Pattern Recognition (ICPR '96) Volume III-Volume 7276 - Volume 7276
On Importance of Nose for Face Tracking

FGR '02 Proceedings of the Fifth IEEE International Conference on Automatic Face and Gesture Recognition
Technology applied to address difficulties of Alzheimer patients and their partners

Dutch HCI '04 Proceedings of the conference on Dutch directions in HCI
Detecting dance motion structure through music analysis

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition

Attention monitoring for music contents based on analysis of signal-behavior structures

ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we discuss our system that estimates user attention to displayed content signals with temporal analysis of their exhibited behavior. Detecting user attention and controlling contents are key issues in our “networked interaction therapy system,” which effectively attracts the attention of memory-impaired people. In our proposed system, user behavior, including facial movements and body motions (“beat actions”), is detected with vision-based methods. User attention to the displayed content is then estimated based on the on/off facial orientation from a display system and body motions synchronous to auditorial signals. This attention monitoring mechanism design is derived from observations of actual patients. Estimated attention level can be used for content control to attract more attention of the viewers to the display system. Experimental results suggest that the content switching mechanism effectively attracts user interest.