Mobile Face Capture for Virtual Face Videos

Authors:
Chandan K. Reddy;George C. Stockman;Jannick P. Rolland;Frank A. Biocca
Affiliations:
Michigan State Univ., East Lansing, MI;Michigan State Univ., East Lansing, MI;Univ. of Central Florida, Orlando, FL;Michigan State Univ., East Lansing, MI
Venue:
CVPRW '04 Proceedings of the 2004 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'04) Volume 5 - Volume 05
Year:
2004

Citing 0
Cited 2

Development of head-mounted projection displays for distributed, collaborative, augmented reality applications

Presence: Teleoperators and Virtual Environments - Special issue: Immersive projection technology
Eyeglass-based hands-free videophone

Proceedings of the 2013 International Symposium on Wearable Computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

Minimally obtrusive face capture is essential for applications in tele-conferencing, collaborative work, and mobile applications. Acquiring and coding video for such applications is a challenging problem, particularly for a mobile user. A pilot head-mounted display system (HMD) is shown that captures two side views of the face and generates in real-time a quality frontal video of the wearer. The face is captured with little obstruction of the users field of view. The frontal views are generated by warping and blending the side views after a calibration step. In tests of a bench prototype, the generated virtual videos compared well with real video based on both objective and qualitative criteria. With success of the pilot work, we are continuing development of the mobile HMD system.