A comparison of input devices in element pointing and dragging tasks
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Surround-screen projection-based virtual reality: the design and implementation of the CAVE
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
Pfinder: Real-Time Tracking of the Human Body
IEEE Transactions on Pattern Analysis and Machine Intelligence
Visual interpretation of hand gestures as a practical interface modality
Visual interpretation of hand gestures as a practical interface modality
The use of gestures in multimodal input
Assets '98 Proceedings of the third international ACM conference on Assistive technologies
Usability Engineering
Human Body Model Acquisition and Tracking Using Voxel Data
International Journal of Computer Vision
A Natural Interface to a Virtual Environment through Computer Vision-Estimated Pointing Gestures
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Meaningful Gestures for Human Computer Interaction: Beyond Hand Postures
FG '98 Proceedings of the 3rd. International Conference on Face & Gesture Recognition
Gesture Modeling and Recognition Using Finite State Machines
FG '00 Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000
Real-time pointing gesture recognition for an immersive environment
FGR' 04 Proceedings of the Sixth IEEE international conference on Automatic face and gesture recognition
CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
AFRIGRAPH '07 Proceedings of the 5th international conference on Computer graphics, virtual reality, visualisation and interaction in Africa
OZCHI '07 Proceedings of the 19th Australasian conference on Computer-Human Interaction: Entertaining User Interfaces
Robust hand tracking using a simple color classification technique
VRCAI '08 Proceedings of The 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry
Computers in Entertainment (CIE) - SPECIAL ISSUE: Media Arts and Games
Augmented reality target finding based on tactile cues
Proceedings of the 2009 international conference on Multimodal interfaces
Human-centered visualization environments
Human-centered visualization environments
Gesture-based user interfaces for public spaces
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: users diversity - Volume Part II
An adaptive solution for intra-operative gesture-based human-machine interaction
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Empirical study of a vision-based depth-sensitive human-computer interaction system
Proceedings of the 10th asia pacific conference on Computer human interaction
Design and usability analysis of gesture-based control for common desktop tasks
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
| Hi-index | 0.00 |
This paper discusses several usability issues related to the use of gestures as an input mode in multimodal interfaces. The use of gestures has been suggested before as a natural solution for applications that require hands-free and notouch interaction with computers, such as in virtual reality (VR) environments. We introduce a simple but robust 2D computer vision based gesture recognition system that was successfully used for interaction in VR environments such as CAVEs and Powerwalls. This interface was tested under 3 different scenarios, as a regular pointing device in a GUI interface, as a navigation tool, and as a visualization tool. Our experiments show that the time to completion of simple pointing tasks is considerably slower when compared to a mouse and that its use during even short periods of time causes fatigue. Despite, these drawbacks, the use of gestures as an alternative mode in multimodal interfaces offers several advantages, such as quick access to computing resources that might be embedded in the environment, using a natural and intuitive way, and that scales nicely to group and collaborative applications, where gestures can be used sporadically.