The Good, the Bad, and the Ugly Face Challenge Problem

  • Authors:
  • P. Jonathon Phillips;J. Ross Beveridge;Bruce A. Draper;Geof Givens;Alice J. O'Toole;David Bolme;Joseph Dunlop;Yui Man Lui;Hassan Sahibzada;Samuel Weimer

  • Affiliations:
  • National Institute of Standards and Technology, Gaithersburg, MD 20899, USA;Colorado State University, Fort Collins, CO 46556, USA;Colorado State University, Fort Collins, CO 46556, USA;Colorado State University, Fort Collins, CO 46556, USA;The University of Texas at Dallas, Richardson, TX 75083-0688, USA;Colorado State University, Fort Collins, CO 46556, USA;The University of Texas at Dallas, Richardson, TX 75083-0688, USA;Colorado State University, Fort Collins, CO 46556, USA;National Institute of Standards and Technology, Gaithersburg, MD 20899, USA;The University of Texas at Dallas, Richardson, TX 75083-0688, USA

  • Venue:
  • Image and Vision Computing
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

The Good, the Bad, and the Ugly Face Challenge Problem was created to encourage the development of algorithms that are robust to recognition across changes that occur in still frontal faces. The Good, the Bad, and the Ugly consists of three partitions. The Good partition contains pairs of images that are considered easy to recognize. The base verification rate (VR) is 0.98 at a false accept rate (FAR) of 0.001. The Bad partition contains pairs of images of average difficulty to recognize. For the Bad partition, the VR is 0.80 at a FAR of 0.001. The Ugly partition contains pairs of images considered difficult to recognize, with a VR of 0.15 at a FAR of 0.001. The base performance is from fusing the output of three of the top performers in the FRVT 2006. The design of the Good, the Bad, and the Ugly controls for posevariation, subject aging, and subject ''recognizability.'' Subject recognizability is controlled by having the same number of images of each subject in every partition. This implies that the differences in performance among the partitions are a result of how a face is presented in each image.