Camera-based in-situ 3D modeling techniques for AR Diorama in ubiquitous virtual reality

Authors:
Atsushi Umakatsu;Hiroyuki Yasuhara;Tomohiro Mashita;Kiyoshi Kiyokawa;Haruo Takemura
Affiliations:
Graduate School of Information Science and Technology, Osaka University, Suita, Osaka, Japan;Graduate School of Information Science and Technology, Osaka University, Suita, Osaka, Japan;Graduate School of Information Science and Technology, Osaka University, Suita, Osaka, Japan and Cybermedia Center, Osaka University, Toyonaka, Osaka, Japan;Graduate School of Information Science and Technology, Osaka University, Suita, Osaka, Japan and Cybermedia Center, Osaka University, Toyonaka, Osaka, Japan;Graduate School of Information Science and Technology, Osaka University, Suita, Osaka, Japan and Cybermedia Center, Osaka University, Toyonaka, Osaka, Japan
Venue:
Proceedings of the 2011 international conference on Virtual and mixed reality: new trends - Volume Part I
Year:
2011

Citing 8
Cited 0

Harold: a world made of drawings

NPAR '00 Proceedings of the 1st international symposium on Non-photorealistic animation and rendering
Interactive manipulation of rigid body simulations

Proceedings of the 27th annual conference on Computer graphics and interactive techniques
Motion doodles: an interface for sketching character motion

ACM SIGGRAPH 2004 Papers
An Experimental Comparison of Min-Cut/Max-Flow Algorithms for Energy Minimization in Vision

IEEE Transactions on Pattern Analysis and Machine Intelligence
Immersive Authoring of Tangible Augmented Reality Applications

ISMAR '04 Proceedings of the 3rd IEEE/ACM International Symposium on Mixed and Augmented Reality
VideoTrace: rapid interactive scene modelling from video

ACM SIGGRAPH 2007 papers
Parallel Tracking and Mapping for Small AR Workspaces

ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
In-place 3D sketching for authoring and augmenting mechanical systems

ISMAR '09 Proceedings of the 2009 8th IEEE International Symposium on Mixed and Augmented Reality

Quantified Score

Hi-index	0.00

Visualization

Abstract

We have been studying an in-situ 3D modeling and authoring system, AR Diorama. In the AR Diorama system, a user is able to reconstruct a 3D model of a real object of concern and describe behaviors of the model by stroke input. In this article, we will introduce two ongoing studies on interactive 3D reconstruction techniques. First technique is feature-based. Natural feature points are first extracted and tracked. A convex hull is then obtained from the feature points based on Delaunay tetrahedralisation. The polygon mesh is carved to approximate the target object based on a feature-point visibility test. Second technique is region-based. Foreground and background color distribution models are first estimated to extract an object region. Then a 3D model of the target object is reconstructed by silhouette carving. Experimental results show that the two techniques can reconstruct a better 3D model interactively compared with our previous system.