Charade: remote control of objects using free-hand gestures
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Image plane interaction techniques in 3D immersive environments
Proceedings of the 1997 symposium on Interactive 3D graphics
An HMM-Based Threshold Model Approach for Gesture Recognition
IEEE Transactions on Pattern Analysis and Machine Intelligence
An HMM-Based Approach for Gesture Segmentation and Recognition
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 3
Active Appearance Models Revisited
International Journal of Computer Vision
Recognition-based gesture spotting in video games
Pattern Recognition Letters
Sign Recognition using Depth Image Streams
FGR '06 Proceedings of the 7th International Conference on Automatic Face and Gesture Recognition
Real-time Hand Pose Recognition Using Low-Resolution Depth Images
CVPR '06 Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Volume 2
Remote interaction for 3D manipulation
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Hand gesture recognition using depth data
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
3D remote interface for smart displays
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Real-time facial animation from live video tracking
SCA '11 Proceedings of the 2011 ACM SIGGRAPH/Eurographics Symposium on Computer Animation
On Appearance Based Face and Facial Action Tracking
IEEE Transactions on Circuits and Systems for Video Technology
Avatar interoperability and control in virtual Worlds
Image Communication
| Hi-index | 0.00 |
Virtual world such as Second life and 3D internet/broadcasting services have been increasingly popular. A life-scale virtual world presentation and the intuitive interaction between the users and the virtual worlds would provide more natural and immersive experience for users. The emergence of novel interaction technologies, such as facial-expression/body-motion tracking and remote interaction for virtual object manipulation, could be used to provide a strong connection between users in the real world and avatars in the virtual world. For the wide acceptance and the use of the virtual world, various types of novel interaction devices should have a unified interaction format between the real world and the virtual world. Thus, MPEG-V Media Context and Control (ISO/IEC 23005) standardizes such connecting information. The paper provides an overview and its usage example of MPEG-V from the real world to the virtual world (R2V) on interfaces for controlling avatars and virtual objects in the virtual world by the real world devices. In particular, we investigate how the MPEG-V framework can be applied for the facial animation and hand-based 3D manipulation using intelligent camera. In addition, in order to intuitively manipulate objects in a 3D virtual environment, we present two interaction techniques using motion sensors such as a two-handed spatial 3D interaction approach and a gesture-based interaction approach.