Improving accuracy in face tracking user interfaces using consumer devices

  • Authors:
  • Norman H. Villaroman;Dale C. Rowe

  • Affiliations:
  • Brigham Young University, Provo, UT, USA;Brigham Young University, Provo, UT, USA

  • Venue:
  • Proceedings of the 1st Annual conference on Research in information technology
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Using face and head movements to control a computer can be especially helpful for users who, for various reasons, cannot effectively use common input devices with their hands. Using vision-based consumer devices makes such a user interface readily available and allows its use to be non-intrusive. However, a characteristic problem with this system is accurate control. Consumer devices capture already small face movements at a resolution that is usually lower than the screen resolution. Computer vision algorithms and technologies that enable such also introduce noise, adversely affecting usability. This paper describes how different components of this perceptual user interface contribute to the problem of accuracy and presents potential solutions. This interface was implemented with different configurations and was statistically evaluated to support the analysis. The different configurations include, among other things, the use of 2D and depth images from consumer devices, different input styles, and the use of the Kalman filter.