A free-viewpoint virtual mirror with marker-less user interaction

Authors:
Matthias Straka;Stefan Hauswiesner;Matthias Rüther;Horst Bischof
Affiliations:
Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria;Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria
Venue:
SCIA'11 Proceedings of the 17th Scandinavian conference on Image analysis
Year:
2011

Citing 11
Cited 1

Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
A Virtual Mirror Interface Using Real-Time Robust Face Tracking

FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
The GrImage Platform: A Mixed Reality Environment for Interactions

ICVS '06 Proceedings of the Fourth IEEE International Conference on Computer Vision Systems
A handheld mirror simulation

ICME '03 Proceedings of the 2003 International Conference on Multimedia and Expo - Volume 1
Surface Capture for Performance-Based Animation

IEEE Computer Graphics and Applications
Performance capture from sparse multi-view video

ACM SIGGRAPH 2008 papers
Real-Time GPU-Based Voxel Carving with Systematic Occlusion Handling

Proceedings of the 31st DAGM Symposium on Pattern Recognition
The GPU Computing Era

IEEE Micro
Parallel high resolution real-time visual hull on GPU

ICIP'09 Proceedings of the 16th IEEE international conference on Image processing
Coherent image-based rendering of real-world objects

I3D '11 Symposium on Interactive 3D Graphics and Games
A functional-based segmentation of human body scans in arbitrary postures

IEEE Transactions on Systems, Man, and Cybernetics, Part B: Cybernetics

Free viewpoint virtual try-on with commodity depth cameras

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a Virtual Mirror system which is able to simulate a physically correct full-body mirror on a monitor. In addition, users can freely rotate the mirror image which allows them to look at themselves from the side or from the back, for example. This is achieved through a multiple camera system and visual hull based rendering. A real-time 3D reconstruction and rendering pipeline enables us to create a virtual mirror image at 15 frames per second on a single computer. Moreover, it is possible to extract a three dimensional skeleton of the user which is the basis for marker-less interaction with the system.