4 + 4 fingers manipulating virtual objects in mixed-reality environment

Authors:
Somsak Walairacht;Keita Yamada;Shoichi Hasegawa;Yasuharu Koike;Makoto Sato
Affiliations:
Precision and Intelligence Laboratory, Tokyo Institute of Technology, Tokyo, Japan;Precision and Intelligence Laboratory, Tokyo Institute of Technology, Tokyo, Japan;Precision and Intelligence Laboratory, Tokyo Institute of Technology, Tokyo, Japan;Precision and Intelligence Laboratory, Tokyo Institute of Technology, Tokyo, Japan;Precision and Intelligence Laboratory, Tokyo Institute of Technology, Tokyo, Japan
Venue:
Presence: Teleoperators and Virtual Environments - Mixed reality
Year:
2002

Citing 5
Cited 2

A portable dextrous master with force feedback

Presence: Teleoperators and Virtual Environments - Premier issue
Windows on the world: 2D windows for 3D augmented reality

UIST '93 Proceedings of the 6th annual ACM symposium on User interface software and technology
Visuo-Haptic Display Using Head-Mounted Projector

VR '00 Proceedings of the IEEE Virtual Reality 2000 Conference
What You Can See is What You Can Feel -- Development of Visual/Haptic Interface to Virtual Environment

VRAIS '96 Proceedings of the 1996 Virtual Reality Annual International Symposium (VRAIS 96)
An Augmented Reality System Using a Real-Time Vision Based Registration

ICPR '98 Proceedings of the 14th International Conference on Pattern Recognition-Volume 2 - Volume 2

FingARtips: gesture based direct manipulation in Augmented Reality

Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Sublimate: state-changing virtual and physical rendering to augment interaction with shape displays

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes the construction of a prototype system that allows the user to manipulate virtual objects in a mixed-reality environment. The user can perceive haptic sensations at his or her fingertips and see a virtual world with a live image of his or her hands manipulating the virtual objects. The difficulty of constructing such a visual presentation is the problem of merging the real image with correct geometrical occlusion with images of virtual objects in the simulated virtual world. In this paper, a method of solving registration of real and virtual images to produce mixed-reality scenes is proposed. We nave combined this method with our haptic interface device, SPIDAR-8, to construct a system that integrates these realities by using the sense of touch and vision of real images in the virtual world that can be realized during the manipulation of virtual objects. The implemented results are shown and remaining problems are discussed.