Teaching and learning as multimedia authoring: the classroom 2000 project
MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Head orientation and gaze direction in meetings
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Simultaneous Tracking of Head Poses in a Panoramic View
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 3
Estimating focus of attention based on gaze and sound
Proceedings of the 2001 workshop on Perceptive user interfaces
Modeling focus of attention for meeting indexing based on multiple cues
IEEE Transactions on Neural Networks
Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality
Proceedings of the 5th international conference on Multimodal interfaces
Perceptual user interfaces using vision-based eye tracking
Proceedings of the 5th international conference on Multimodal interfaces
From conversational tooltips to grounded discourse: head poseTracking in interactive dialog systems
Proceedings of the 6th international conference on Multimodal interfaces
Identifying the addressee in human-human-robot interactions based on head pose and speech
Proceedings of the 6th international conference on Multimodal interfaces
Meetings, gatherings, and events in smart environments
VRCAI '04 Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry
Contextual recognition of head gestures
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Using social geometry to manage interruptions and co-worker attention in office environments
GI '05 Proceedings of Graphics Interface 2005
Tracking head pose and focus of attention with multiple far-field cameras
Proceedings of the 8th international conference on Multimodal interfaces
Audio-visual perception of a lecturer in a smart seminar room
Signal Processing - Special section: Multimodal human-computer interfaces
Pre-collision safety strategies for human-robot interaction
Autonomous Robots
Head gestures for perceptual interfaces: The role of context in improving recognition
Artificial Intelligence
Audio-visual multi-person tracking and identification for smart environments
Proceedings of the 15th international conference on Multimedia
A two-stage head pose estimation framework and evaluation
Pattern Recognition
Towards smart meeting: enabling technologies and a real-world application
Proceedings of the 9th international conference on Multimodal interfaces
Audiovisual head orientation estimation with particle filtering in multisensor scenarios
EURASIP Journal on Advances in Signal Processing
Visual Focus of Attention in Dynamic Meeting Scenarios
MLMI '08 Proceedings of the 5th international workshop on Machine Learning for Multimodal Interaction
As go the feet...: on the estimation of attentional focus from stance
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Probabilistic integration of sparse audio-visual cues for identity tracking
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Multimodal identity tracking in a smart room
Personal and Ubiquitous Computing
Automatic nonverbal analysis of social interaction in small groups: A review
Image and Vision Computing
Proceedings of the 2009 international conference on Multimodal interfaces
ACM Transactions on Applied Perception (TAP)
Smart meeting systems: A survey of state-of-the-art and open issues
ACM Computing Surveys (CSUR)
Proceedings of the Workshop on Use of Context in Vision Processing
Head pose detection based on fusion of multiple viewpoint information
CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
Head pose estimation using stereo vision for human-robot interaction
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Natural activation for gesture recognition systems
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Head pose estimation with one camera, in uncalibrated environments
Proceedings of the 2010 workshop on Eye gaze in intelligent human machine interaction
VACE multimodal meeting corpus
MLMI'05 Proceedings of the Second international conference on Machine Learning for Multimodal Interaction
An integrated two-stage framework for robust head pose estimation
AMFG'05 Proceedings of the Second international conference on Analysis and Modelling of Faces and Gestures
Visual focus of attention recognition in the ambient kitchen
ACCV'09 Proceedings of the 9th Asian conference on Computer Vision - Volume Part III
Fast detection of frequent change in focus of human attention
WAPCV'04 Proceedings of the Second international conference on Attention and Performance in Computational Vision
Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning
Building Intelligent Interactive Tutors: Student-centered strategies for revolutionizing e-learning
Recognizing the visual focus of attention for human robot interaction
HBU'12 Proceedings of the Third international conference on Human Behavior Understanding
System for assessing classroom attention
Proceedings of the Third International Conference on Learning Analytics and Knowledge
| Hi-index | 0.00 |
This paper presents an overview of our work on tracking focus of attention in meeting situations. We have developed a system capable of estimating participants' focus of attention from multiple cues. In our system we employ an omni-directional camera to simultaneously track the faces of participants sitting around a meeting table and use neural networks to estimate their head poses. In addition, we use microphones to detect who is speaking. The system predicts participants' focus of attention from acoustic and visual information separately, and then combines the output of the audio- and video-based focus of attention predictors.In addition this work reports recent experimental results: In order to determine how well we can predict a subject's focus of attention solely on the basis of his or her head orientation, we have conducted an experiment in which we recorded head and eye orientations of participants in a meeting using special tracking equipment. Our results demonstrate that head orientation was a sufficient indicator of the subjects' focus target in 89% of the time. Furthermore we discuss how the neural networks used to estimate head orientation can be adapted to work in new locations and under new illumination conditions.