Real time 3D avatar for interactive mixed reality

Authors:
Sang-Yup Lee;Ig-Jae Kim;Sang C Ahn;Heedong Ko;Myo-Taeg Lim;Hyoung-Gon Kim
Affiliations:
Korea Institute of Science and Technology;Korea Institute of Science and Technology;Korea Institute of Science and Technology;Korea Institute of Science and Technology;Korea University;Korea Institute of Science and Technology
Venue:
VRCAI '04 Proceedings of the 2004 ACM SIGGRAPH international conference on Virtual Reality continuum and its applications in industry
Year:
2004

Citing 10
Cited 6

Fast shadows and lighting effects using texture mapping

SIGGRAPH '92 Proceedings of the 19th annual conference on Computer graphics and interactive techniques
Image-based visual hulls

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Online model reconstruction for interactive virtual environments

I3D '01 Proceedings of the 2001 symposium on Interactive 3D graphics
Video flashlights: real time rendering of multiple videos for immersive model visualization

EGRW '02 Proceedings of the 13th Eurographics workshop on Rendering
3-D live: real time interaction for mixed reality

CSCW '02 Proceedings of the 2002 ACM conference on Computer supported cooperative work
The Visual Hull Concept for Silhouette-Based Image Understanding

IEEE Transactions on Pattern Analysis and Machine Intelligence
Polyhedral Visual Hulls for Real-Time Rendering

Proceedings of the 12th Eurographics Workshop on Rendering Techniques
Homography Based Parallel Volume Intersection: Toward Real-Time Volume Reconstruction using Active Cameras

CAMP '00 Proceedings of the Fifth IEEE International Workshop on Computer Architectures for Machine Perception (CAMP'00)
Real-Time Consensus-Based Scene Reconstruction Using Commodity Graphics Hardware

PG '02 Proceedings of the 10th Pacific Conference on Computer Graphics and Applications
Real-Time Generation and High-Fidelity Visualization of 3D Video

ICCIMA '03 Proceedings of the 5th International Conference on Computational Intelligence and Multimedia Applications

Toward immersive telecommunication: 3D video avatar with physical interaction

Proceedings of the 2005 international conference on Augmented tele-existence
Low-Cost Telepresence for Collaborative Virtual Environments

IEEE Transactions on Visualization and Computer Graphics
Evolutionary generative process for an artificial creature's personality

IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews
A GPU based, projective multi-texturing approach to reconstructing the 3D human form for application in tele-presence

Proceedings of the ACM 2011 conference on Computer supported cooperative work
An interactive virtual guide for the AR based visit of archaeological sites

Journal of Visual Languages and Computing
Intelligent 3d video avatar for immersive telecommunication

AI'05 Proceedings of the 18th Australian Joint conference on Advances in Artificial Intelligence

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents real-time reconstruction of dynamic 3D avatar for interactive mixed reality. In computer graphics, one of the main goals is the combination of virtual scenes with real-world scenes. However, the views of the real world objects are often restricted to views from the cameras. True navigation through such mixed reality scenes becomes impossible unless the components from real objects can be rendered from arbitrary viewpoints. Additionally, adding a real-world object to a virtual scene requires some depth information as well, in order to handle interaction. The proposed algorithm introduces an approach to generate 3D video avatars and to augment the avatars naturally into 3D virtual environment using the calibrated camera parameters and silhouette information. As a result, we can create photo-realistic live avatars from natural scenes and the resulting 3D live avatar can guide and interact participants in VR space.