Monitoring visual focus of attention via local discriminant projection

  • Authors:
  • Honggang Zhang;Lorant Toth;Weihong deng;Jun Guo;Jie Yang

  • Affiliations:
  • PRIS lab, Beijing, China;InterAct lab, Pittsburgh, USA;PRIS lab, Beijing, China;PRIS lab, Beijing, China;Carnegie Mellon University, Pittsburgh, Pa., USA

  • Venue:
  • MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present a system to monitor a subject's Visual Focus of Attention (VFOA) based on his/her head poses. The system first detects faces from video images and determines if the detected face is a frontal or profile face. If a frontal face is detected, the system further estimates the head pose from the face image. Instead of estimating accurate head poses through detection or tracking methods, we formulate the problem as a classification problem and classify the head pose into one of a predefined number of poses using a local discriminant projection (LDP) method. The LDP method uses two graphs for the modeling the head pose embedding, one is the nearest native neighbor graph, the other is the nearest invader graph. We evaluate the LDP method in CAS-PEAL Database with 21 head poses and a realistic data set with 9 poses collected from our application scenario. The experimental results indicate that our approach outperforms other methods. We describe the implementation of the system with an application in monitoring customers' VFOA in a display window that exhibits merchandise in a shop. The system can be used to index and retrieve information for customer analysis.