Detection of asymmetric eye action units in spontaneous videos

  • Authors:
  • Mina Mikhail;Rana El Kaliouby

  • Affiliations:
  • American University in Cairo, Computer Science Department, Cairo, Egypt;Massachusetts Institute of Technology, Media Laboratory, Cambridge, MA

  • Venue:
  • ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

With recent advances in machine vision, automatic detection of human expressions in video is becoming important especially because human labeling of videos is both tedious and error prone. In this paper, we present an approach for detecting facial expressions based on the Facial Action Coding System (FACS) in spontaneous videos. We present an automated system for detecting asymmetric eye open (AU41) and eye closed (AU43) actions. We use Gabor Jets to select distinctive features from the image and compare between three different classifiers--Bayesian networks, Dynamic Bayesian networks and Support Vector Machines--for classification. Experimental evaluation on a large corpus of spontaneous videos yielded an average accuracy of 98% for eye closed (AU43), and 92.75% for eye open (AU41).