Interacting with paper on the DigitalDesk
Communications of the ACM - Special issue on computer augmented environments: back to the real world
The design and evaluation of marking menus
The design and evaluation of marking menus
PaperLink: a technique for hyperlinking from real paper to electronic content
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
The missing link: augmenting biology laboratory notebooks
Proceedings of the 15th annual ACM symposium on User interface software and technology
High precision touch screen interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The Myth of the Paperless Office
The Myth of the Paperless Office
Paper augmented digital documents
Proceedings of the 16th annual ACM symposium on User interface software and technology
Distinctive Image Features from Scale-Invariant Keypoints
International Journal of Computer Vision
Video-based document tracking: unifying your physical and electronic desktops
Proceedings of the 17th annual ACM symposium on User interface software and technology
AppLens and launchTile: two designs for one-handed thumb use on small devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Design and analysis of delimiters for selection-action pen gesture phrases in scriboli
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 18th annual ACM symposium on User interface software and technology
Marked-up maps: combining paper maps and electronic information resources
Personal and Ubiquitous Computing
ButterflyNet: a mobile capture and access system for field biology research
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Camera phone based motion sensing: interaction techniques, applications and performance study
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Shift: a technique for operating pen-based interfaces using touch
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Papiercraft: A gesture-based command system for interactive paper
ACM Transactions on Computer-Human Interaction (TOCHI)
Map navigation with mobile devices: virtual versus physical movement with and without visual context
Proceedings of the 9th international conference on Multimodal interfaces
ICAT '07 Proceedings of the 17th International Conference on Artificial Reality and Telexistence
Target acquisition with camera phones when used as magic lenses
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Paperproof: a paper-digital proof-editing system
CHI '08 Extended Abstracts on Human Factors in Computing Systems
Mobile Retriever: access to digital documents from their physical source
International Journal on Document Analysis and Recognition
HOTPAPER: multimedia interaction with paper using mobile phones
MM '08 Proceedings of the 16th ACM international conference on Multimedia
Musink: composing music through augmented drawing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Unravelling seams: improving mobile gesture recognition with visual feedback techniques
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Like bees around the hive: a comparative study of a mobile augmented reality map
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pose tracking from natural features on mobile phones
ISMAR '08 Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality
High accuracy and language independent document retrieval with a fast invariant transform
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Real-world interaction with camera phones
UCS'04 Proceedings of the Second international conference on Ubiquitous Computing Systems
Physical gestures for abstract concepts: Inclusive design with primary metaphors
Interacting with Computers
Sensor synaesthesia: touch in motion, and motion in touch
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Deep shot: a framework for migrating tasks across devices using mobile phone cameras
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Who's that girl? handheld augmented reality for printed photo books
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Minimum correspondence sets for improving large-scale augmented paper
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
CBDAR'11 Proceedings of the 4th international conference on Camera-Based Document Analysis and Recognition
Interpreting strokes on paper with a mobile assistant
Proceedings of the 25th annual ACM symposium on User interface software and technology
SmartFinger: an augmented finger as a seamless 'channel' between digital and physical objects
Proceedings of the 4th Augmented Human International Conference
Toward compound navigation tasks on mobiles via spatial manipulation
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Annotate me: supporting active reading using real-time document image retrieval on mobile devices
Proceedings of the 2013 ACM conference on Pervasive and ubiquitous computing adjunct publication
Enhanced virtual transparency in handheld ar: digital magnifying glass
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Proceedings of the 15th ACM on International conference on multimodal interaction
SmartFinger: connecting devices, objects and people seamlessly
Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
Hi-index | 0.01 |
PACER is a gesture-based interactive paper system that supports fine-grained paper document content manipulation through the touch screen of a cameraphone. Using the phone's camera, PACER links a paper document to its digital version based on visual features. It adopts camera-based phone motion detection for embodied gestures (e.g. marquees, underlines and lassos), with which users can flexibly select and interact with document details (e.g. individual words, symbols and pixels). The touch input is incorporated to facilitate target selection at fine granularity, and to address some limitations of the embodied interaction, such as hand jitter and low input sampling rate. This hybrid interaction is coupled with other techniques such as semi-real time document tracking and loose physical-digital document registration, offering a gesture-based command system. We demonstrate the use of PACER in various scenarios including work-related reading, maps and music score playing. A preliminary user study on the design has produced encouraging user feedback, and suggested future research for better understanding of embodied vs. touch interaction and one vs. two handed interaction.