A cell phone based platform for facial performance capture

  • Authors:
  • Svetlana Akim;Andrew Jones;Xueming Yu;Jay Busch;Graham Fyffe;Paul Graham;Paul Debevec

  • Affiliations:
  • USC, Institute for Creative Technologies;USC, Institute for Creative Technologies;USC, Institute for Creative Technologies;USC, Institute for Creative Technologies;USC, Institute for Creative Technologies;USC, Institute for Creative Technologies;USC, Institute for Creative Technologies

  • Venue:
  • ACM SIGGRAPH 2012 Posters
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

We propose a new head-mounted camera system based on stereo cell phone cameras. These cameras have the advantage of being extremely small, light-weight, and programmable. We provide step-by-step details on how to recreate this apparatus and also how to apply this data to multiple applications in facial tracking and reconstruction. Our system is based on the LG Thrill, a 3D enabled cell phone that provides two synchronized stereo cameras in a tiny 4.2 gram module. We use two phones for a total of four cameras. However we do not want to mount the entire phone at the end of the helmet arm. Instead we designed a custom umbilical cord that allows the camera module to function at a large distance from the phone itself.