Interacting with 3D objects in a virtual environment using an intuitive gesture system

Authors:
Corey Manders;Farzam Farbiz;Tang Ka Yin;Yuan Miaolong;Bryan Chong;Chua Gim Guan
Affiliations:
A*STAR Institute for Infocomm Research, Connexis, Singapore;A*STAR Institute for Infocomm Research, Connexis, Singapore;A*STAR Institute for Infocomm Research, Connexis, Singapore;A*STAR Institute for Infocomm Research, Connexis, Singapore;A*STAR Institute for Infocomm Research, Connexis, Singapore;A*STAR Institute for Infocomm Research, Connexis, Singapore
Venue:
VRCAI '08 Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
Year:
2008

Citing 5
Cited 3

The world through the computer: computer augmented interaction with real world environments

Proceedings of the 8th annual ACM symposium on User interface and software technology
Collaborative augmented reality

Communications of the ACM - How the virtual inspires the real
The Use of Dense Stereo Range Data in Augmented Reality

ISMAR '02 Proceedings of the 1st International Symposium on Mixed and Augmented Reality
Marker Tracking and HMD Calibration for a Video-Based Augmented Reality Conferencing System

IWAR '99 Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality
A Hitchhikers Guide to Virtual Reality

A Hitchhikers Guide to Virtual Reality

Virtual reality interactions using inexpensive webcams

Proceedings of the 8th International Conference on Virtual Reality Continuum and its Applications in Industry
2D motion detection bounded hand 3D trajectory tracking and gesture recognition under complex background

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry
Real-time 3D markerless multiple hand detection and tracking for human computer interaction applications

Proceedings of the 9th ACM SIGGRAPH Conference on Virtual-Reality Continuum and its Applications in Industry

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present a system for interacting with 3D objects in a 3D virtual environment. Using the notion that a typical head-mounted display does not cover the user's entire face, we use a fiducial marker placed on the HMD to locate the user's exposed facial skin. Using this information, a skin model is built and combined with the depth information obtained from a stereo camera. The information when used in tandem allows the position of the user's hands to be detected and tracked in real time. Once both hands are located, our system allows the user to manipulate the object with five degrees of freedom (translation in x, y, and z axis with roll and yaw rotations) in virtual three-dimensional space using a series of intuitive hand gestures.