Attention monitoring for music contents based on analysis of signal-behavior structures

Authors:
Masatoshi Ohara;Akira Utsumi;Hirotake Yamazoe;Shinji Abe;Noriaki Katayama
Affiliations:
ATR Intelligent Robotics and Communication Laboratories, Sorakugun, Kyoto, Japan and Osaka Prefectural College of Technology, Neyagawashi, Osaka, Japan;ATR Intelligent Robotics and Communication Laboratories, Sorakugun, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Sorakugun, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Sorakugun, Kyoto, Japan;Osaka Prefectural College of Technology, Neyagawashi, Osaka, Japan
Venue:
ACCV'07 Proceedings of the 8th Asian conference on Computer vision - Volume Part I
Year:
2007

Citing 6
Cited 1

Virtualized Reality: Constructing Virtual Worlds from Real Scenes

IEEE MultiMedia
Detecting Irregularities in Images and in Video

ICCV '05 Proceedings of the Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1 - Volume 01
Human Tracking by Particle Filtering Using Full 3D Model of Both Target and Environment

ICPR '06 Proceedings of the 18th International Conference on Pattern Recognition - Volume 02
On automated model-based extraction and analysis of gait

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Tracking humans using prior and learned representations of shape and appearance

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Attention monitoring based on temporal signal-behavior structures

ICCV'05 Proceedings of the 2005 international conference on Computer Vision in Human-Computer Interaction

Estimation of user conversational states based on combination of user actions and feature normalization

CASEMANS '11 Proceedings of the 5th ACM International Workshop on Context-Awareness for Self-Managing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose a method to estimate user attention to displayed content signals with temporal analysis of their exhibited behavior. Detecting user attention and controlling contents are key issues in our "networked interaction therapy system" that effectively attracts the attention of memory-impaired people. In our proposed method, user behavior, including body motions (beat actions), is detected with auditory/vision-based methods. This design is based on our observations of the behavior of memory-impaired people under video watching conditions. User attention to the displayed content is then estimated based on body motions synchronized to auditorial signals. Estimated attention levels can be used for content control to attract deeper attention of viewers to the display system. Experimental results suggest that the proposed method effectively extracts user attention to musical signals.