A multicue Bayesian state estimator for gaze prediction in open signed video

Authors:
Sam J. C. Davies;Dimitris Agrafiotis;C. Nishan Canagarajah;David R. Bull
Affiliations:
Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK;Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK;Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK;Department of Electrical and Electronic Engineering, University of Bristol, Bristol, UK
Venue:
IEEE Transactions on Multimedia
Year:
2009

Citing 7
Cited 1

Algorithms for Defining Visual Regions-of-Interest: Comparison with Eye Fixations

IEEE Transactions on Pattern Analysis and Machine Intelligence
Robust Real-Time Face Detection

International Journal of Computer Vision
A Visual Attention Based Region-of-Interest Determination Framework for Video Sequences*

IEICE - Transactions on Information and Systems
Variable frame rate for low power mobile sign language communication

Proceedings of the 9th international ACM SIGACCESS conference on Computers and accessibility
Towards efficient context-specific video coding based on gaze-tracking analysis

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Top-down guided eye movements

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics
Automatic foveation for video compression using a neurobiological model of visual attention

IEEE Transactions on Image Processing

Automated localization of affective objects and actions in images via caption text-cum-eye gaze analysis

MM '09 Proceedings of the 17th ACM international conference on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

We propose a multicue gaze prediction framework for open signed video content, the benefits of which include coding gains without loss of perceived quality. We investigate which cues are relevant for gaze prediction and find that shot changes, facial orientation of the signer and face locations are the most useful. We then design a face orientation tracker based upon grid-based likelihood ratio trackers, using profile and frontal face detections. These cues are combined using a grid-based Bayesian state estimation algorithm to form a probability surface for each frame. We find that this gaze predictor outperforms a static gaze prediction and one based on face locations within the frame.