Charade: remote control of objects using free-hand gestures
Communications of the ACM - Special issue on computer augmented environments: back to the real world
The design and evaluation of marking menus
The design and evaluation of marking menus
Moving objects in space: exploiting proprioception in virtual-environment interaction
Proceedings of the 24th annual conference on Computer graphics and interactive techniques
The role of contextual haptic and visual constraints on object manipulation in virtual environments
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
FlowMenu: combining command, text, and data entry
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
TiltType: accelerometer-supported text entry for very small devices
Proceedings of the 15th annual ACM symposium on User interface software and technology
Using marking menus to develop command sets for computer vision based hand gesture interfaces
Proceedings of the second Nordic conference on Human-computer interaction
Control menus: excecution and control in a single interactor
CHI '00 Extended Abstracts on Human Factors in Computing Systems
Design and Evaluation of Menu Systems for Immersive Virtual Environments
VR '01 Proceedings of the Virtual Reality 2001 Conference (VR'01)
GWindows: robust stereo vision for gesture-based control of windows
Proceedings of the 5th international conference on Multimodal interfaces
TiltText: using tilt for text input to mobile phones
Proceedings of the 16th annual ACM symposium on User interface software and technology
Proceedings of the 17th annual ACM symposium on User interface software and technology
Tilt to Scroll: Evaluating a Motion Based Vibrotactile Mobile Interface
WHC '05 Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Cross-Dimensional Gestural Interaction Techniques for Hybrid Imrnersive Environments
VR '05 Proceedings of the 2005 IEEE Conference 2005 on Virtual Reality
Distant freehand pointing and clicking on very large, high resolution displays
Proceedings of the 18th annual ACM symposium on User interface software and technology
Robust computer vision-based detection of pinching for one and two-handed gesture input
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Virtual Environments: Three-dimensional menus: A survey and taxonomy
Computers and Graphics
Earpod: eyes-free menu selection using touch input and reactive audio feedback
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A motion-based marking menu system
CHI '07 Extended Abstracts on Human Factors in Computing Systems
Wrist rotation for interaction in mobile contexts
Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Tilt techniques: investigating the dexterity of wrist-based input
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A gesture-based and eyes-free control method for mobile devices
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Tech-note: rapMenu: Remote Menu Selection Using Freehand Gestural Input
3DUI '08 Proceedings of the 2008 IEEE Symposium on 3D User Interfaces
Enabling always-available input with muscle-computer interfaces
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Beyond flat surface computing: challenges of depth-aware and curved interfaces
MM '09 Proceedings of the 17th ACM international conference on Multimedia
Evaluating performance and acceptance of older adults using freehand gestures for TV menu control
Proceedings of the 10th European conference on Interactive tv and video
Special Section on Touching the 3rd Dimension: 3D selection with freehand gesture
Computers and Graphics
Hi-index | 0.00 |
Freehand gestural interaction, in which the user's hands move in mid-air to provide input, has been of interest to researchers, but freehand menu selection interfaces have been under-investigated so far. Freehand menu selection is inherently difficult, especially with increasing menu breadth (i.e., the number of items), largely because moving hands in free space cannot achieve precision as high as physical input devices such as mouse and stylus. We have designed a novel menu selection interface called the rapMenu (Ni et al., 2008), which is controlled by wrist tilt and multiple pinch gestures, and takes advantage of the multiple discrete gesture inputs to reduce the required precision of the user hand movements. In this article, we first review the visual design and behavior of the rapMenu technique, as well as related design issues and its potential advantages. In the second part, we present two studies of the rapMenu in order to further investigate the strengths and limitations of the design principle. In the first study, we compared the rapMenu to the extensively studied tilt menu technique (Rahman et al., 2009). Our results revealed that the rapMenu outperforms the tilt menu as menu breadth increases. In the second study, we investigated how the rapMenu affords the opportunity of eyes-free selection and users' transition from novice to expert. We found that within 10min of practice, eyes-free selection with rapMenu has competitive speed and accuracy with the visual rapMenu and the tilt menu. Finally, we discuss design variations that use other axes of wrist movement and adopt alternative auditory feedback.