Recent Advances in Augmented Reality
IEEE Computer Graphics and Applications
Augmented reality for manufacturing planning
EGVE '03 Proceedings of the workshop on Virtual environments 2003
FingARtips: gesture based direct manipulation in Augmented Reality
Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Augmented Foam: A Tangible Augmented Reality for Product Design
ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Presence: Teleoperators and Virtual Environments
Jump: a system for interactive, tangible queries of paper
GI '07 Proceedings of Graphics Interface 2007
Of pages and paddles: Children's expectations and mistaken interactions with physical-digital tools
Interacting with Computers
Parallel Tracking and Mapping for Small AR Workspaces
ISMAR '07 Proceedings of the 2007 6th IEEE and ACM International Symposium on Mixed and Augmented Reality
Handy AR: Markerless Inspection of Augmented Reality Objects Using Fingertip Tracking
ISWC '07 Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers
Visual and tangible interactions with physical and virtual objects using context-aware RFID
Expert Systems with Applications: An International Journal
Medical augment reality using a markerless registration framework
Expert Systems with Applications: An International Journal
Evolutionary joint selection to improve human action recognition with RGB-D devices
Expert Systems with Applications: An International Journal
Hi-index | 12.05 |
Several studies have been carried out on augmented reality (AR)-based environments that deal with user interfaces for manipulating and interacting with virtual objects aimed at improving immersive feeling and natural interaction. Most of these studies have utilized AR paddles or AR cubes for interactions. However, these interactions overly constrain the users in their ability to directly manipulate AR objects and are limited in providing natural feeling in the user interface. This paper presents a novel approach to natural and intuitive interactions through a direct hand touchable interface in various AR-based user experiences. It combines markerless augmented reality with a depth camera to effectively detect multiple hand touches in an AR space. Furthermore, to simplify hand touch recognition, the point cloud generated by Kinect is analyzed and filtered out. The proposed approach can easily trigger AR interactions, and allows users to experience more intuitive and natural sensations and provides much control efficiency in diverse AR environments. Furthermore, it can easily solve the occlusion problem of the hand and arm region inherent in conventional AR approaches through the analysis of the extracted point cloud. We present the effectiveness and advantages of the proposed approach by demonstrating several implementation results such as interactive AR car design and touchable AR pamphlet. We also present an analysis of a usability study to compare the proposed approach with other well-known AR interactions.