Video-rate capture of dynamic face shape and appearance

  • Authors:
  • Ioannis A. Ypsilos;Adrian Hilton;Simon Rowe

  • Affiliations:
  • Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK;Centre for Vision Speech and Signal Processing, University of Surrey, Guildford, UK;Canon Research Centre Europe, Bracknell, Beskshire, UK

  • Venue:
  • FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper presents a system for simultaneous capture of video sequences of face shape and colour appearance. Shape capture uses a projected infra-red structured light pattern together with stereo reconstruction to simultaneously acquire full resolution shape and colour image sequences at video rate. Displacement mapping techniques are introduced to represent dynamic face surface shape as a displacement video. This unifies the representation of face shape and colour. The displacement video representation enables efficient registration, integration and spatiotemporal analysis of captured face data. Results demonstrate that the system achieves video-rate (25Hz) acquisition of dynamic 3D colour faces at PAL resolution with an rms accuracy of 0.2mm and a visual quality comparable to the captured video.