Facial Expression Understanding in Image Sequences Using Dynamic and Active Visual Information Fusion

  • Authors:
  • Yongmian Zhang;Qiang Ji

  • Affiliations:
  • -;-

  • Venue:
  • ICCV '03 Proceedings of the Ninth IEEE International Conference on Computer Vision - Volume 2
  • Year:
  • 2003

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper explores the use of multisensory information fusiontechnique with Dynamic Bayesian networks (DBNs)for modeling and understanding the temporal behaviors offacial expressions in image sequences. Our approach tothe facial expression understanding lies in a probabilisticframework by integrating the DBNs with the facial actionunits (AUs) from psychological view. The DBNs provide acoherent and unified hierarchical probabilistic frameworkto represent spatial and temporal information related to facialexpressions, and to actively select the most informativevisual cues from the available information to minimize theambiguity in recognition. The recognition of facial expressionsis accomplished by fusing not only from the currentvisual observations, but also from the previous visual evidences.Consequently, the recognition becomes more robustand accurate through modeling the temporal behavior of facialexpressions. Experimental results demonstrate that ourapproach is more admissible for facial expression analysisin image sequences.