The vocabulary problem in human-system communication
Communications of the ACM
Findings from observational studies of collaborative work
International Journal of Man-Machine Studies - Computer-supported cooperative work and groupware. Part 1
Charade: remote control of objects using free-hand gestures
Communications of the ACM - Special issue on computer augmented environments: back to the real world
Interacting with paper on the DigitalDesk
Communications of the ACM - Special issue on computer augmented environments: back to the real world
An experimental study of future “natural” multimodal human-computer interaction
CHI '93 INTERACT '93 and CHI '93 Conference Companion on Human Factors in Computing Systems
CHI 98 Cconference Summary on Human Factors in Computing Systems
Implications for a gesture design tool
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Expression constraints in multimodal human-computer interaction
Proceedings of the 5th international conference on Intelligent user interfaces
Optimization criteria for checkpoint placement
Communications of the ACM
DiamondTouch: a multi-user touch technology
Proceedings of the 14th annual ACM symposium on User interface software and technology
SmartSkin: an infrastructure for freehand manipulation on interactive surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Participatory Design: Principles and Practices
Participatory Design: Principles and Practices
From a Typology of Gestures to a Procedure for Gesture Production
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Evoking Gestures in SmartKom - Design of the Graphical User Interface
GW '01 Revised Papers from the International Gesture Workshop on Gesture and Sign Languages in Human-Computer Interaction
Multi-finger and whole hand gestural interaction techniques for multi-user tabletop displays
Proceedings of the 16th annual ACM symposium on User interface software and technology
A study on the manipulation of 2D objects in a projector/camera-based augmented reality environment
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Maximizing the guessability of symbolic input
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Interacting with large displays from a distance with vision-tracked multi-finger gestural input
Proceedings of the 18th annual ACM symposium on User interface software and technology
PlayAnywhere: a compact interactive tabletop projection-vision system
Proceedings of the 18th annual ACM symposium on User interface software and technology
Gesture Registration, Relaxation, and Reuse for Multi-Point Direct-Touch Surfaces
TABLETOP '06 Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems
Cooperative gestures: multi-user gestural interactions for co-located groupware
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A study of hand shape use in tabletop gesture interaction
CHI '06 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the working conference on Advanced visual interfaces
Multi-finger cursor techniques
GI '06 Proceedings of Graphics Interface 2006
TNT: improved rotation and translation on digital tables
GI '06 Proceedings of Graphics Interface 2006
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Multi-user, multi-display interaction with a single-user, single-display geospatial application
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
Bringing physics to the surface
Proceedings of the 21st annual ACM symposium on User interface software and technology
Direct manipulation interfaces
Human-Computer Interaction
Improving computer interaction for older adults
ACM SIGACCESS Accessibility and Computing
Exploring Manual Interaction and Social Behaviour Patterns in Intensely Collaborative Teamwork
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Understanding Multi-touch Manipulation for Surface Computing
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Bonfire: a nomadic system for hybrid laptop-tabletop interaction
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Espace de caractérisation des interactions gestuelles physiques sur dispositifs mobiles
Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Analysis of natural gestures for controlling robot teams on multi-touch tabletop surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Investigating multi-touch and pen gestures for diagram editing on interactive surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
ShadowGuides: visualizations for in-situ learning of multi-touch and whole-hand gestures
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Multi-touch interaction for tasking robots
Proceedings of the 5th ACM/IEEE international conference on Human-robot interaction
Exploring the accessibility and appeal of surface computing for older adult health care support
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
iCon: utilizing everyday objects as additional, auxiliary and instant tabletop controllers
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How users manipulate deformable displays as input devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
MAGIC: a motion gesture design tool
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The design and evaluation of multitouch marking menus
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A multi-touch enabled steering wheel: exploring the design space
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Wearable-object-based interaction for a mobile audio device
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Cultural similarities and differences in user-defined gestures for touchscreen user interfaces
CHI '10 Extended Abstracts on Human Factors in Computing Systems
Exploring strategies and guidelines for developing full body video game interfaces
Proceedings of the Fifth International Conference on the Foundations of Digital Games
Automatically generating personalized user interfaces with Supple
Artificial Intelligence
Understanding users' preferences for surface gestures
Proceedings of Graphics Interface 2010
Architecting next-generation user interfaces
Proceedings of the International Conference on Advanced Visual Interfaces
Proposing a multi-touch interface for intrusion detection environments
Proceedings of the Seventh International Symposium on Visualization for Cyber Security
User-defined gestures for connecting mobile phones, public displays, and tabletops
Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
The booTable experience: iterative design and prototyping of an alternative interactive tabletop
Proceedings of the 8th ACM Conference on Designing Interactive Systems
Comparing user interaction with low and high fidelity prototypes of tabletop surfaces
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Evaluating multimodal systems: a comparison of established questionnaires and interaction parameters
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Mobile device interaction gestures for older users
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Physical gestures for abstract concepts: Inclusive design with primary metaphors
Interacting with Computers
Enhancing single touch gesture classifiers to multitouch support
ICCHP'10 Proceedings of the 12th international conference on Computers helping people with special needs
Diagram editing on interactive displays using multi-touch and pen gestures
Diagrams'10 Proceedings of the 6th international conference on Diagrammatic representation and inference
Free-hand gestures for music playback: deriving gestures with a user-centred process
Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
ACM International Conference on Interactive Tabletops and Surfaces
Towards a formalization of multi-touch gestures
ACM International Conference on Interactive Tabletops and Surfaces
Tool support for testing complex multi-touch gestures
ACM International Conference on Interactive Tabletops and Surfaces
A set of multi-touch graph interaction techniques
ACM International Conference on Interactive Tabletops and Surfaces
What caused that touch?: expressive interaction with a surface through fiduciary-tagged gloves
ACM International Conference on Interactive Tabletops and Surfaces
Physical and digital media usage patterns on interactive tabletop surfaces
ACM International Conference on Interactive Tabletops and Surfaces
SCiVA: a design process for applications on interactive surfaces
ACM International Conference on Interactive Tabletops and Surfaces
EGrid: supporting the control room operation of a utility company with multi-touch tables
ACM International Conference on Interactive Tabletops and Surfaces
Co-located collaborative software visualization
Human Aspects of Software Engineering
Multimedia Tools and Applications
User-defined motion gestures for mobile interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usable gestures for blind people: understanding preference and performance
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gestural interaction on the steering wheel: reducing the visual demand
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
SandCanvas: a multi-touch art medium inspired by sand animation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Eden: a professional multitouch tool for constructing virtual organic environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How users associate wireless devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ShadowPuppets: supporting collocated interaction with mobile projector phones using hand shadows
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
tBox: a 3d transformation widget designed for touch-screens
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gestures in the wild: studying multi-touch gesture sequences on interactive tabletop exhibits
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
My own-style interaction: exploring individuals' preferences to interactivity
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Integrating activity theory for context analysis on large display
Transactions on edutainment V
SCIVA: designing applications for surface computers
Proceedings of the 3rd ACM SIGCHI symposium on Engineering interactive computing systems
Combining bimanual manipulation and pen-based input for 3D modelling
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
3D gesture recognition: an evaluation of user and system performance
Pervasive'11 Proceedings of the 9th international conference on Pervasive computing
Usability testing of the interaction of novices with a multi-touch table in semi public space
HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
Considerations of applying surface-based phone gestures to natural context
Proceedings of the 13th international conference on Ubiquitous computing
Estimating the perceived difficulty of pen gestures
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
"Oh snap" - helping users align digital objects on touch interfaces
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part III
Access overlays: improving non-visual access to large touch screens for blind users
Proceedings of the 24th annual ACM symposium on User interface software and technology
A domain specific language to define gestures for multi-touch applications
Proceedings of the 10th Workshop on Domain-Specific Modeling
Gesture-aware remote controls: guidelines and interaction technique
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Hands-on interactive tabletop LEGO application
Proceedings of the 8th International Conference on Advances in Computer Entertainment Technology
Designing user-, hand-, and handpart-aware tabletop interactions with the TouchID toolkit
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Design of unimanual multi-finger pie menu interaction
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Generic gesture kernel modeling and its application with virtual garment design
Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
The artificiality of natural user interfaces
Communications of the ACM
Gestures for large display control
GW'09 Proceedings of the 8th international conference on Gesture in Embodied Communication and Human-Computer Interaction
BCS '10 Proceedings of the 24th BCS Interaction Specialist Group Conference
Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
6DMG: a new 6D motion gesture database
Proceedings of the 3rd Multimedia Systems Conference
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Studying user-defined iPad gestures for interaction in multi-display environment
Proceedings of the 2012 ACM international conference on Intelligent User Interfaces
Rewarding the original: explorations in joint user-sensor motion spaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Hand occlusion on a multi-touch tabletop
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Bimanual marking menu for near surface interactions
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Putting your best foot forward: investigating real-world mappings for foot-based gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
ShoeSense: a new perspective on gestural interaction and wearable applications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A comparative evaluation of finger and pen stroke gestures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Self-revealing gestures: teaching new touch interactions in windows 8
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Drawing shapes and lines: spawning objects on interactive tabletops
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Towards the establishment of a framework for intuitive multi-touch interaction design
Proceedings of the International Working Conference on Advanced Visual Interfaces
Proceedings of the International Working Conference on Advanced Visual Interfaces
Understanding user gestures for manipulating 3D objects from touchscreen inputs
Proceedings of Graphics Interface 2012
The effect of perspective projection in multi-touch 3D interaction
Proceedings of Graphics Interface 2012
Multimedia Tools and Applications
To move or to remove?: a human-centric approach to understanding gesture interpretation
Proceedings of the Designing Interactive Systems Conference
User-defined gestures for free-hand TV control
Proceedings of the 10th European conference on Interactive tv and video
A pattern language for interactive tabletops in collaborative workspaces
Proceedings of the 15th European Conference on Pattern Languages of Programs
Spring: a solution for managing the third DOF with tactile interface
Proceedings of the 10th asia pacific conference on Computer human interaction
Proceedings of the 10th asia pacific conference on Computer human interaction
Nomadic gestures: A technique for reusing gesture commands for frequent ambient interactions
Journal of Ambient Intelligence and Smart Environments
Semiotic analysis of multi-touch interface design: The MuTable case study
International Journal of Human-Computer Studies
Assessing the effectiveness of direct gesture interaction for a safety critical maritime application
International Journal of Human-Computer Studies
Identifying emotions expressed by mobile users through 2D surface and 3D motion gestures
Proceedings of the 2012 ACM Conference on Ubiquitous Computing
Tilt displays: designing display surfaces with multi-axis tilting and actuation
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Exploring the effects of size on deformable user interfaces
MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services companion
BCS-HCI '12 Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers
High-performance pen + touch modality interactions: a real-time strategy game eSports context
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proton++: a customizable declarative multitouch framework
Proceedings of the 25th annual ACM symposium on User interface software and technology
Extended multitouch: recovering touch posture and differentiating users using a depth camera
Proceedings of the 25th annual ACM symposium on User interface software and technology
FlowBlocks: a multi-touch ui for crowd interaction
Proceedings of the 25th annual ACM symposium on User interface software and technology
Proceedings of the 14th ACM international conference on Multimodal interaction
A hierarchical approach to continuous gesture analysis for natural multi-modal interaction
Proceedings of the 14th ACM international conference on Multimodal interaction
Multimodal interaction in the car: combining speech and gestures on the steering wheel
Proceedings of the 4th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Comparing elicited gestures to designer-created gestures for selection above a multitouch surface
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Eliciting usable gestures for multi-display environments
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Web on the wall: insights from a multimodal interaction elicitation study
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Touch, click, navigate: comparing tabletop and desktop interaction for map navigation tasks
Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces
Speech augmented multitouch interaction patterns
Proceedings of the 16th European Conference on Pattern Languages of Programs
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
An exploratory study of how abundant display space may support data analysis
Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design
TouchPosing: multi-modal interaction with geospatial data
Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia
User-defined body gestures for navigational control of a humanoid robot
ICSR'12 Proceedings of the 4th international conference on Social Robotics
Gestures for industry: intuitive human-robot communication from human observation
Proceedings of the 8th ACM/IEEE international conference on Human-robot interaction
Multi-tap sliders: advancing touch interaction for parameter adjustment
Proceedings of the 2013 international conference on Intelligent user interfaces
From small screens to big displays: understanding interaction in multi-display environments
Proceedings of the companion publication of the 2013 international conference on Intelligent user interfaces companion
Don't open that door: designing gestural interactions for interactive narratives
Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction
A virtual camera controlling method using multi-touch gestures for capturing free-viewpoint video
Proceedings of the 11th european conference on Interactive TV and video
There's a world outside your TV: exploring interactions beyond the physical TV screen
Proceedings of the 11th european conference on Interactive TV and video
Designing gestural interfaces for the interactive TV
Proceedings of the 11th european conference on Interactive TV and video
WorldKit: rapid and easy creation of ad-hoc interactive applications on everyday surfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Memorability of pre-designed and user-defined gesture sets
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
The challenges and potential of end-user gesture customization
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
How groups of users associate wireless devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tactile perceptions of digital textiles: a design research approach
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tweetris: a study of whole-body interaction during a public art event
Proceedings of the 9th ACM Conference on Creativity & Cognition
Template based classification of multi-touch gestures
Pattern Recognition
User-defined gestures for augmented reality
CHI '13 Extended Abstracts on Human Factors in Computing Systems
How we gesture towards machines: an exploratory study of user perceptions of gestural interaction
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Beyond recognition: using gesture variation for continuous interaction
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Métamorphe: augmenting hotkey usage with actuated keys
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
StrikeAPose: revealing mid-air gestures on public displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Interactive prototyping of tabletop and surface applications
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
RefactorPad: editing source code on touchscreens
Proceedings of the 5th ACM SIGCHI symposium on Engineering interactive computing systems
TouchViz: a case study comparing two interfaces for data analytics on tablets
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 12th International Conference on Interaction Design and Children
A Wizard-of-Oz elicitation study examining child-defined gestures with a whole-body interface
Proceedings of the 12th International Conference on Interaction Design and Children
Exploring pinch and spread gestures on mobile devices
Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services
Proceedings of the 2013 ACM international joint conference on Pervasive and ubiquitous computing
Touchless gestural interaction with small displays: a case study
Proceedings of the Biannual Conference of the Italian Chapter of SIGCHI
Light on horizontal interactive surfaces: Input space for tabletop computing
ACM Computing Surveys (CSUR)
The skweezee system: enabling the design and the programming of squeeze interactions
Proceedings of the 26th annual ACM symposium on User interface software and technology
Arpège: learning multitouch chord gestures vocabularies
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Multi-touch pinch gestures: performance and ergonomics
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Deconstructing the touch experience
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
Towards user-defined multi-touch gestures for 3D objects
Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces
A study of unidirectional swipe gestures on in-vehicle touch screens
Proceedings of the 5th International Conference on Automotive User Interfaces and Interactive Vehicular Applications
Relative accuracy measures for stroke gestures
Proceedings of the 15th ACM on International conference on multimodal interaction
Intuitive gestures on multi-touch displays for reading radiological images
HCI International'13 Proceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction for health, safety, mobility and complex environments - Volume Part II
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: interaction modalities and techniques - Volume Part IV
Understanding the consistency of users' pen and finger stroke gesture articulation
Proceedings of Graphics Interface 2013
Interaction techniques for older adults using touchscreen devices: a literature review
Proceedings of the 25ième conférence francophone on l'Interaction Homme-Machine
Analyzing touchless hand gestures performance
Proceedings of the 2013 Chilean Conference on Human - Computer Interaction
Hacking the Gestures of Past for Future Interactions
Proceedings of International Conference on Advances in Mobile Computing & Multimedia
Framed guessability: using embodied allegories to increase user agreement on gesture sets
Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction
Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration
ACM Transactions on Interactive Intelligent Systems (TiiS)
Left and right hand distinction for multi-touch tabletop interactions
Proceedings of the 19th international conference on Intelligent User Interfaces
Mimetic interaction spaces: controlling distant displays in pervasive environments
Proceedings of the 19th international conference on Intelligent User Interfaces
CUBOD: a customized body gesture design tool for end users
BCS-HCI '13 Proceedings of the 27th International BCS Human Computer Interaction Conference
Journal of Ambient Intelligence and Smart Environments
Hi-index | 0.02 |
Many surface computing prototypes have employed gestures created by system designers. Although such gestures are appropriate for early investigations, they are not necessarily reflective of user behavior. We present an approach to designing tabletop gestures that relies on eliciting gestures from non-technical users by first portraying the effect of a gesture, and then asking users to perform its cause. In all, 1080 gestures from 20 participants were logged, analyzed, and paired with think-aloud data for 27 commands performed with 1 and 2 hands. Our findings indicate that users rarely care about the number of fingers they employ, that one hand is preferred to two, that desktop idioms strongly influence users' mental models, and that some commands elicit little gestural agreement, suggesting the need for on-screen widgets. We also present a complete user-defined gesture set, quantitative agreement scores, implications for surface technology, and a taxonomy of surface gestures. Our results will help designers create better gesture sets informed by user behavior.