CHI '86 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Issues in combining marking and direct manipulation techniques
UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology
The role of natural language in a multimodal interface
UIST '92 Proceedings of the 5th annual ACM symposium on User interface software and technology
The marks are on the knowledge worker
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The design of a GUI paradigm based on tablets, two-hands, and transparency
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
QuickSet: multimodal interaction for distributed applications
MULTIMEDIA '97 Proceedings of the fifth ACM international conference on Multimedia
A diary study of work-related reading: design implications for digital reading devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Beyond paper: supporting active reading with free form digital ink annotations
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 12th annual ACM symposium on User interface software and technology
Sensing techniques for mobile interaction
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays
Proceedings of the 16th annual ACM symposium on User interface software and technology
Two-handed interaction on a tablet display
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Saving and using encountered information: implications for electronic periodicals
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Documents at Hand: Learning from Paper to Improve Digital Technologies
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Experimental analysis of mode switching techniques in pen-based user interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces
TABLETOP '06 Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems
Keepin' it real: pushing the desktop metaphor with physics, piles and the pen
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
InkSeine: In Situ search for active note taking
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Affordances for manipulation of physical versus digital media on interactive surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A study on the scalability of non-preferred hand mode manipulation
Proceedings of the 9th international conference on Multimodal interfaces
Usability evaluation considered harmful (some of the time)
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Navigation techniques for dual-display e-book readers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A model of non-preferred hand mode switching
GI '08 Proceedings of graphics interface 2008
AVI '08 Proceedings of the working conference on Advanced visual interfaces
Bringing physics to the surface
Proceedings of the 21st annual ACM symposium on User interface software and technology
Extending 2D object arrangement with pressure-sensitive layering cues
Proceedings of the 21st annual ACM symposium on User interface software and technology
The prevention of mode errors through sensory feedback
Human-Computer Interaction
Bezel swipe: conflict-free scrolling and multiple selection on mobile touch screen devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Codex: a dual screen tablet computer
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GestureBar: improving the approachability of gesture-based interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Occlusion-aware menu design for digital tabletops
CHI '09 Extended Abstracts on Human Factors in Computing Systems
Sketching User Experiences: Getting the Design Right and the Right Design
Sketching User Experiences: Getting the Design Right and the Right Design
Pictionaire: supporting collaborative design work by integrating physical and digital artifacts
Proceedings of the 2010 ACM conference on Computer supported cooperative work
Investigating multi-touch and pen gestures for diagram editing on interactive surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
TUIC: enabling tangible interaction on capacitive multi-touch displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
LiquidText: a flexible, multitouch environment to support active reading
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Touch-Bookmark: a lightweight navigation and bookmarking technique for e-books
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Multimodal video annotation for contemporary dance creation
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Combining bimanual manipulation and pen-based input for 3D modelling
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Conté: multimodal input inspired by an artist's crayon
Proceedings of the 24th annual ACM symposium on User interface software and technology
TapSense: enhancing finger interaction on touch surfaces
Proceedings of the 24th annual ACM symposium on User interface software and technology
Neat: a set of flexible tools and gestures for layout tasks on interactive displays
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Pointable: an in-air pointing technique to manipulate out-of-reach targets on tabletops
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Data analysis on interactive whiteboards through sketch-based interaction
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Informal information gathering techniques for active reading
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Toward a theory of interaction in mobile paper-digital ensembles
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ZeroTouch: an optical multi-touch and free-air interaction architecture
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
User learning and performance with bezel menus
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
DisplayStacks: interaction techniques for stacks of flexible thin-film displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative evaluation of finger and pen stroke gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Self-revealing gestures: teaching new touch interactions in windows 8
CHI '12 Extended Abstracts on Human Factors in Computing Systems
An approach for real-time recognition of online Chinese handwritten sentences
Pattern Recognition
Evaluation of a multimodal video annotator for contemporary dance
Proceedings of the International Working Conference on Advanced Visual Interfaces
Supporting active reading on pen and touch-operated tabletops
Proceedings of the International Working Conference on Advanced Visual Interfaces
Mockup builder: direct 3D modeling on and above the surface in a continuous interaction space
Proceedings of Graphics Interface 2012
MelodicBrush: a novel system for cross-modal digital art creation linking calligraphy and music
Proceedings of the Designing Interactive Systems Conference
International Journal of Human-Computer Studies
Interpreting strokes on paper with a mobile assistant
Proceedings of the 25th annual ACM symposium on User interface software and technology
High-performance pen + touch modality interactions: a real-time strategy game eSports context
Proceedings of the 25th annual ACM symposium on User interface software and technology
GaussSense: attachable stylus sensing using magnetic sensor grid
Proceedings of the 25th annual ACM symposium on User interface software and technology
PyzoFlex: printed piezoelectric pressure sensing foil
Proceedings of the 25th annual ACM symposium on User interface software and technology
Interactive construction: interactive fabrication of functional mechanical devices
Proceedings of the 25th annual ACM symposium on User interface software and technology
Towards document engineering on pen and touch-operated interactive tabletops
Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology
Empirical evaluation of uni- and bimodal pen and touch interaction properties on digital tabletops
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
HandyWidgets: local widgets pulled-out from hands
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Microanalysis of active reading behavior to inform design of interactive desktop workspaces
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Amazing forearm as an innovative interaction device and data storage on tabletop display
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
GaussBrush: Drawing with Magnetic Stylus
SIGGRAPH Asia 2012 Emerging Technologies
Your left hand can do it too!: investigating intermanual, symmetric gesture transfer on touchscreens
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Direct space-time trajectory control for visual media editing
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
AR pen and hand gestures: a new tool for pen drawings
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Gesture-supported document creation on pen and touch tabletops
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Interactive space: a prototyping framework for touch and gesture on and above the desktop
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Toward compound navigation tasks on mobiles via spatial manipulation
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Light on horizontal interactive surfaces: Input space for tabletop computing
ACM Computing Surveys (CSUR)
TextTearing: opening white space for digital ink annotation
Proceedings of the 26th annual ACM symposium on User interface software and technology
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Pen and touch gestural environment for document editing on interactive tabletops
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Motion and context sensing techniques for pen computing
Proceedings of Graphics Interface 2013
Hi-index | 0.00 |
We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of materials. Based on our explorations we advocate a division of labor between pen and touch: the pen writes, touch manipulates, and the combination of pen + touch yields new tools. This articulates how our system interprets unimodal pen, unimodal touch, and multimodal pen+touch inputs, respectively. For example, the user can hold a photo and drag off with the pen to create and place a copy; hold a photo and cross it in a freeform path with the pen to slice it in two; or hold selected photos and tap one with the pen to staple them all together. Touch thus unifies object selection with mode switching of the pen, while the muscular tension of holding touch serves as the "glue" that phrases together all the inputs into a unitary multimodal gesture. This helps the UI designer to avoid encumbrances such as physical buttons, persistent modes, or widgets that detract from the user's focus on the workspace.