Multiple Camera, Multiple Person Tracking with Pointing Gesture Recognition in Immersive Environments

Authors:
Anuraag Sridhar;Arcot Sowmya
Affiliations:
School of Computer Science and Engineering, University of New South Wales, Sydney, Australia NSW 2052;School of Computer Science and Engineering, University of New South Wales, Sydney, Australia NSW 2052
Venue:
ISVC '08 Proceedings of the 4th International Symposium on Advances in Visual Computing
Year:
2008

Citing 7
Cited 2

Surround-screen projection-based virtual reality: the design and implementation of the CAVE

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
A Natural Interface to a Virtual Environment through Computer Vision-Estimated Pointing Gestures

GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Understanding people pointing: the Perseus system

ISCV '95 Proceedings of the International Symposium on Computer Vision
Multiple View Geometry in Computer Vision

Multiple View Geometry in Computer Vision
AVIE: a versatile multi-user stereo 360° interactive VR theatre

EDT '07 Proceedings of the 2007 workshop on Emerging displays technologies: images and beyond: the future of displays and interacton
Real-time pointing gesture recognition for an immersive environment

FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
Visual tracking for seamless 3d interactions in augmented reality

ISVC'05 Proceedings of the First international conference on Advances in Visual Computing

Incremental placement of interactive perception applications

Proceedings of the 20th international symposium on High performance distributed computing
Day and night at the museum: intangible computer interfaces for public exhibitions

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a technique that allows multiple participants within a large-scale immersive, virtual environment to interact with it using pointing gestures. Multiple cameras observing the environment are used along with various computer vision techniques to obtain a 3-D reconstruction of each participant's finger position, allowing the participants to point at and interact with virtual objects. This use of the pointing gesture provides an intuitive method of interaction, and has many applications in the field of human computer interaction. No markers or special clothing are required to be worn. Furthermore, we show that the system is able to provide robust results in real time.