Impact of Gaze Analysis on the Design of a Caption Production Software

Authors:
Claude Chapdelaine;Samuel Foucher;Langis Gagnon
Affiliations:
R&D Department, Computer Research Institute of Montreal (CRIM), Montreal, H3A 1B9;R&D Department, Computer Research Institute of Montreal (CRIM), Montreal, H3A 1B9;R&D Department, Computer Research Institute of Montreal (CRIM), Montreal, H3A 1B9
Venue:
UAHCI '09 Proceedings of the 5th International Conference on Universal Access in Human-Computer Interaction. Part III: Applications and Services
Year:
2009

Citing 10
Cited 0

Identifying fixations and saccades in eye-tracking protocols

ETRA '00 Proceedings of the 2000 symposium on Eye tracking research & applications
Two-Dimensional PCA: A New Approach to Appearance-Based Face Representation and Recognition

IEEE Transactions on Pattern Analysis and Machine Intelligence
Augmenting icons for deaf computer users

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Rapid and brief communication: Diagonal principal component analysis for face recognition

Pattern Recognition
Automatic Detection and Clustering of Actor Faces based on Spectral Clustering Techniques

CRV '07 Proceedings of the Fourth Canadian Conference on Computer and Robot Vision
An iterative image registration technique with an application to stereo vision

IJCAI'81 Proceedings of the 7th international joint conference on Artificial intelligence - Volume 2
Detecting and reading text in natural scenes

CVPR'04 Proceedings of the 2004 IEEE computer society conference on Computer vision and pattern recognition
False alarm rate: a critical performance measure for face recognition

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Face detection and tracking in a video by propagating detection probabilities

IEEE Transactions on Pattern Analysis and Machine Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

Producing caption for the deaf and hearing impaired is a labor intensive task. We implemented a software tool, named SmartCaption, for assisting the caption production process using automatic visual detection techniques aimed at reducing the production workload. This paper presents the results of an eye-tracking analysis made on facial regions of interest to understand the nature of the task, not only to measure of the quantity of data but also to assess its importance to the end-user; the viewer. We also report on two interaction design approaches that were implemented and tested to cope with the inevitable outcomes of automatic detection such as false recognitions and false alarms. These approaches were compared with a Keystoke-Level Model (KLM) showing that the adopted approach allowed a gain of 43% in efficiency.