AR pen and hand gestures: a new tool for pen drawings

Authors:
Hark-Joon Kim;Hayoung Kim;Seungho Chae;Jonghoon Seo;Tack-Don Han
Affiliations:
Samsung Electronics, Suwon, South Korea;Yonsei University, Seoul, South Korea;Yonsei University, Seoul, South Korea;Yonsei University, Seoul, South Korea;Yonsei University, Seoul, South Korea
Venue:
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Year:
2013

Citing 12
Cited 0

Surface drawing: creating organic 3D shapes with the hand and tangible tools

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Two-handed interaction on a tablet display

CHI '04 Extended Abstracts on Human Factors in Computing Systems
PlayAnywhere: a compact interactive tabletop projection-vision system

Proceedings of the 18th annual ACM symposium on User interface software and technology
Projector-guided painting

UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Combining and measuring the benefits of bimanual pen and direct-touch interaction on horizontal interfaces

AVI '08 Proceedings of the working conference on Advanced visual interfaces
PenLight: combining a mobile projector and a digital pen for dynamic visual overlay

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Map torchlight: a mobile augmented reality camera projector unit

CHI '09 Extended Abstracts on Human Factors in Computing Systems
MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pen + touch = new tools

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
MAI painting brush: an interactive device that realizes the feeling of real painting

UIST '10 Proceedings of the 23nd annual ACM symposium on User interface software and technology
LuminAR: portable robotic augmented reality interface design and prototype

UIST '10 Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology
Motionbeam: a metaphor for character interaction with handheld projectors

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper explores the interaction possibilities when artists use their non-dominant hand, while drawing with a pen in their dominant hand. We propose a new interactive AR-based pen tool which can overlay virtual images onto a physical drawing in real time. This system allows artists to control the augmented images with gestures of a non-dominant hand while drawing. By interacting with the visually augmented contents using hand gestures and a pen bimanually, artists can draw pictures more creatively. We also made a standalone pen system integrated with a pico-projector and a camera, and suggest a set of useful scenarios for the conventional pen-and-paper drawing.