The human factors of computer graphics interaction techniques
IEEE Computer Graphics and Applications
A cookbook for using the model-view controller user interface paradigm in Smalltalk-80
Journal of Object-Oriented Programming
Surface interaction: a paradigm and model for separating application and interface
CHI '90 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A new model for handling input
ACM Transactions on Information Systems (TOIS)
The information visualizer, an information workspace
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A morphological analysis of the design space of input devices
ACM Transactions on Information Systems (TOIS) - Special issue on computer—human interaction
Dynamic queries for information exploration: an implementation and evaluation
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Motif programming manual (vol. six A)
Motif programming manual (vol. six A)
Toolglass and magic lenses: the see-through interface
SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
UIST '93 Proceedings of the 6th annual ACM symposium on User interface software and technology
Beyond interface builders: model-based interface tools
CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Integrality and separability of input devices
ACM Transactions on Computer-Human Interaction (TOCHI)
User learning and performance with marking menus
CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Pad++: a zooming graphical interface for exploring alternate interface physics
UIST '94 Proceedings of the 7th annual ACM symposium on User interface software and technology
ACM Transactions on Computer-Human Interaction (TOCHI)
Evaluation of techniques for specifying 3D rotations with a 2D input device
HCI '95 Proceedings of the HCI'95 conference on People and computers X
Bricks: laying the foundations for graspable user interfaces
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Local tools: an alternative to tool palettes
Proceedings of the 9th annual ACM symposium on User interface software and technology
The design of a GUI paradigm based on tablets, two-hands, and transparency
Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Design principles for interactive software
Design principles for interactive software
Readings in information visualization
The Hotbox: efficient access to a large number of menu-items
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Through the Interface: A Human Activity Approach to User Interface Design
Through the Interface: A Human Activity Approach to User Interface Design
Macintosh human interface guidelines
Macintosh human interface guidelines
Reification, polymorphism and reuse: three principles for designing visual interfaces
AVI '00 Proceedings of the working conference on Advanced visual interfaces
Video artifacts for design: bridging the Gap between abstraction and detail
DIS '00 Proceedings of the 3rd conference on Designing interactive systems: processes, practices, methods, and techniques
The architecture and implementation of CPN2000, a post-WIMP graphical application
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A model-based tool for interactive prototyping of highly interactive applications
CHI '02 Extended Abstracts on Human Factors in Computing Systems
Proceedings of the thirteenth ACM conference on Hypertext and hypermedia
Window frames as areas for information visualization
Proceedings of the second Nordic conference on Human-computer interaction
Extending direct manipulation in a text editor
Proceedings of the 20th annual international conference on Computer documentation
CPN/tools: revisiting the desktop metaphor with post-WIMP interaction techniques
CHI '01 Extended Abstracts on Human Factors in Computing Systems
High precision touch screen interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
iStuff: a physical user interface toolkit for ubiquitous computing environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
CPN/Tools: A Post-WIMP Interface for Editing and Simulating Coloured Petri Nets
ICATPN '01 Proceedings of the 22nd International Conference on Application and Theory of Petri Nets
UbiComp '01 Proceedings of the 3rd international conference on Ubiquitous Computing
Prototyping tools and techniques
The human-computer interaction handbook
Programmer I'interaction avec des machines à états hiérarchiques
IHM '02 Proceedings of the 14th French-speaking conference on Human-computer interaction (Conférence Francophone sur l'Interaction Homme-Machine)
Interaction styles in development tools for virtual reality applications
Production methods
A Model-Based Tool for Interactive Prototyping of Highly Interactive Applications
RSP '01 Proceedings of the 12th International Workshop on Rapid System Prototyping
Object-action association: a HCI design model
Proceedings of the 9th international conference on Intelligent user interfaces
A molecular architecture for creating advanced GUIs
Proceedings of the 16th annual ACM symposium on User interface software and technology
Journal of Systems and Software - Special issue: Ubiquitous computing
HabilisDraw DT: a bimanual tool-based direct manipulation drawing environment
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Designing interaction, not interfaces
Proceedings of the working conference on Advanced visual interfaces
On tangible user interfaces, humans and spatiality
Personal and Ubiquitous Computing
The MaggLite post-WIMP toolkit: draw it, connect it and run it
Proceedings of the 17th annual ACM symposium on User interface software and technology
What is the space for?: the role of space in authoring hypertext representations
Proceedings of the sixteenth ACM conference on Hypertext and hypermedia
A comparison of two methods of scaling on form perception via a haptic interface
ICMI '05 Proceedings of the 7th international conference on Multimodal interfaces
Benefits of merging command selection and direct manipulation
ACM Transactions on Computer-Human Interaction (TOCHI)
Modèle d'interaction mixte: la réalité mixte à la lumière des modalités d'interaction
UbiMob '05 Proceedings of the 2nd French-speaking conference on Mobility and ubiquity computing
Getting a grip on tangible interaction: a framework on physical space and social interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
What is the next generation of human-computer interaction?
CHI '06 Extended Abstracts on Human Factors in Computing Systems
DoPIdom: une approche de l'interaction et de la collaboration centrée sur les documents
IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
IHM '06 Proceedings of the 18th International Conferenceof the Association Francophone d'Interaction Homme-Machine
Programming rich interactions using the hierarchical state machine toolkit
Proceedings of the working conference on Advanced visual interfaces
Interaction design of tools for fostering creativity in the early stages of information design
International Journal of Human-Computer Studies - Special issue: Computer support for creativity
Screen-based musical interfaces as semiotic machines
NIME '06 Proceedings of the 2006 conference on New interfaces for musical expression
Etude préliminaire visant la détermination de seuils de confort pour un zoom haptique
IHM 2005 Proceedings of the 17th international conference on Francophone sur l'Interaction Homme-Machine
Modélisation de l'interaction collaborative dans les systèmes de Réalité Mixte
IHM 2004 Proceedings of the 16th conference on Association Francophone d'Interaction Homme-Machine
DoPIdom: une boîte à outils pour la conception d'interfaces centrées sur les documents XML
IHM 2004 Proceedings of the 16th conference on Association Francophone d'Interaction Homme-Machine
Explicit task representation based on gesture interaction
MMUI '05 Proceedings of the 2005 NICTA-HCSNet Multimodal User Interaction Workshop - Volume 57
SwingStates: adding state machines to the swing toolkit
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
When second wave HCI meets third wave challenges
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Affordances and constraints in screen-based musical instruments
Proceedings of the 4th Nordic conference on Human-computer interaction: changing roles
Haptic recognition of shapes at different scales: A comparison of two methods of interaction
Interacting with Computers
ExperiScope: an analysis tool for interaction data
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Reality-based interaction: unifying the new generation of interaction styles
CHI '07 Extended Abstracts on Human Factors in Computing Systems
CHI2006: what is the next generation of human-computer interaction?
interactions - Business leadership and the UX manager
Evaluation of Input Devices for Musical Expression: Borrowing Tools from HCI
Computer Music Journal
Instrumentness for creativity mediation, materiality & metonymy
Proceedings of the 6th ACM SIGCHI conference on Creativity & cognition
Loop-R: real-time video interface
NIME '07 Proceedings of the 7th international conference on New interfaces for musical expression
Modeling human interaction resources to support the design of wearable multimodal systems
Proceedings of the 9th international conference on Multimodal interfaces
HYUI: a visual framework for prototyping hybrid user interfaces
Proceedings of the 2nd international conference on Tangible and embedded interaction
Reality-based interaction: a framework for post-WIMP interfaces
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Video browsing by direct manipulation
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
PieCursor: merging pointing and command selection for rapid in-place tool switching
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
An instrumental paradigm for ubiquitous interaction
Proceedings of the 14th European conference on Cognitive ergonomics: invent! explore!
Human-Computer Interaction
A Design-Oriented Information-Flow Refinement of the ASUR Interaction Model
Engineering Interactive Systems
Palettes satellitaires: faciliter les changements d'outils avec la rotation de la souris
Proceedings of the 20th International Conference of the Association Francophone d'Interaction Homme-Machine
Peripheral tangible interaction by analytic design
Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Designing pen-and-paper user interfaces for interaction with documents
Proceedings of the 3rd International Conference on Tangible and Embedded Interaction
Touch and toys: new techniques for interaction with a remote group of robots
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
VIGO: instrumental interaction in multi-surface environments
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Revisiting read wear: analysis, design, and evaluation of a footprints scrollbar
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Easy to use and incredibly difficult: on the mythical border between interface and gameplay
Proceedings of the 4th International Conference on Foundations of Digital Games
Quinze ans de recherche sur les menus: critères et propriétés des techniques de menus
IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
Conception du dialogue d'une application interactive
IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
Un bureau basé sur les instruments et des graphes
IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
Proceedings of the Working Conference on Advanced Visual Interfaces
Proceedings of the Working Conference on Advanced Visual Interfaces
Modeling Multimodal Interaction for Performance Evaluation
Proceedings of the 13th International Conference on Human-Computer Interaction. Part II: Novel Interaction Methods and Techniques
An Interactive System Based on Semantic Graphs
Proceedings of the Symposium on Human Interface 2009 on ConferenceUniversal Access in Human-Computer Interaction. Part I: Held as Part of HCI International 2009
Augmented Interactions: A Framework for Adding Expressive Power to GUI Widgets
INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part I
Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Malai: un modèle conceptuel d'interaction pour les systèmes interactifs
Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Espace de caractérisation des interactions gestuelles physiques sur dispositifs mobiles
Proceedings of the 21st International Conference on Association Francophone d'Interaction Homme-Machine
Presence: Teleoperators and Virtual Environments
From the gaming experience to the wider user experience
Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Tangible User Interfaces: Past, Present, and Future Directions
Foundations and Trends in Human-Computer Interaction
Meta-user interfaces for ambient spaces
TAMODIA'06 Proceedings of the 5th international conference on Task models and diagrams for users interface design
Supporting several levels of restriction in the UML
UML'00 Proceedings of the 3rd international conference on The unified modeling language: advancing the standard
Nearly-integral manipulation of rotary widgets
INTERACT'07 Proceedings of the 11th IFIP TC 13 international conference on Human-computer interaction
Generating interactive applications from task models: a hard challenge
TAMODIA'07 Proceedings of the 6th international conference on Task models and diagrams for user interface design
Improving modularity and usability of interactive systems with Malai
Proceedings of the 2nd ACM SIGCHI symposium on Engineering interactive computing systems
Synchronous cooperation and visualization for social bookmarking systems
Proceedings of the International Conference on Advanced Visual Interfaces
Proceedings of the Ergonomie et Informatique Avancee Conference
Collective interaction by design collective controllers for social navigation on digital photos
Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries
Component-based high fidelity interactive prototyping of post-WIMP interactions
International Conference on Multimodal Interfaces and the Workshop on Machine Learning for Multimodal Interaction
A novel taxonomy for gestural interaction techniques based on accelerometers
Proceedings of the 16th international conference on Intelligent user interfaces
Direct manipulation through surrogate objects
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Shared substance: developing flexible multi-surface applications
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Design principles for a new generic digital habitat
CHI '11 Extended Abstracts on Human Factors in Computing Systems
CHI '11 Extended Abstracts on Human Factors in Computing Systems
Gesture-based design of 2D contours: an alternative to sketching?
Proceedings of the Eighth Eurographics Symposium on Sketch-Based Interfaces and Modeling
Edition synchrone de plusieurs objets: services et interaction
23rd French Speaking Conference on Human-Computer Interaction
Augmenting the SCOPE of interactions with implicit and explicit graphical structures
Proceedings of the 24th annual ACM symposium adjunct on User interface software and technology
Cracking the cocoa nut: user interface programming at runtime
Proceedings of the 24th annual ACM symposium on User interface software and technology
Gliimpse: Animating from markup code to rendered documents and vice versa
Proceedings of the 24th annual ACM symposium on User interface software and technology
Use is everywhere and changing: analysis and design with the human-artifact model
Proceedings of the 29th Annual European Conference on Cognitive Ergonomics
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
What I grasp is what I control: interacting through grasp releases
Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
Augmenting the scope of interactions with implicit and explicit graphical structures
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Affordances in HCI: toward a mediated action perspective
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tangible remote controllers for wall-size displays
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
When hand and device melt into a unit: microgestures on grasped objects
CHI '12 Extended Abstracts on Human Factors in Computing Systems
Metaphor modelling for tangible interfaces evaluation
Proceedings of the International Working Conference on Advanced Visual Interfaces
Specifying and running rich graphical components with Loa
Proceedings of the 4th ACM SIGCHI symposium on Engineering interactive computing systems
Fluid interaction for information visualization
Information Visualization - Special issue on State of the Field and New Research Directions
Histomages: fully synchronized views for image editing
Proceedings of the 25th annual ACM symposium on User interface software and technology
Interpreting strokes on paper with a mobile assistant
Proceedings of the 25th annual ACM symposium on User interface software and technology
Design space for finger gestures with hand-held tablets
Proceedings of the 14th ACM international conference on Multimodal interaction
Understanding interactive legends: a comparative evaluation with standard widgets
EuroVis'10 Proceedings of the 12th Eurographics / IEEE - VGTC conference on Visualization
Sketch Based Video Annotation and Organization System in Distributed Teaching Environment
International Journal of Distributed Systems and Technologies
Poetry in motion: appropriation of the world of apps
Proceedings of the 30th European Conference on Cognitive Ergonomics
Indirect control and making actions explicit in 3D drawing
Proceedings of the 9th ACM Conference on Creativity & Cognition
CHI '13 Extended Abstracts on Human Factors in Computing Systems
Visions and visioning in CHI: CHI 2013 special interest group meeting
CHI '13 Extended Abstracts on Human Factors in Computing Systems
EISEval, a generic reconfigurable environment for evaluating agent-based interactive systems
International Journal of Human-Computer Studies
Activity or product?: drawing and HCI
Proceedings of the International Conference on Multimedia, Interaction, Design and Innovation
The effects of GUI on users' creative performance in computerized drawing
Proceedings of the International Conference on Multimedia, Interaction, Design and Innovation
Light on horizontal interactive surfaces: Input space for tabletop computing
ACM Computing Surveys (CSUR)
HCI'13 Proceedings of the 15th international conference on Human-Computer Interaction: human-centred design approaches, methods, tools, and environments - Volume Part I
Plataforma para manipulação de objetos de aprendizagem com interação sobre boneco anatômico
Proceedings of the 12th Brazilian Symposium on Human Factors in Computing Systems
| Hi-index | 0.01 |
This article introduces a new interaction model called Instrumental Interaction that extends and generalizes the principles of direct manipulation. It covers existing interaction styles, including traditional WIMP interfaces, as well as new interaction styles such as two-handed input and augmented reality. It defines a design space for new interaction techniques and a set of properties for comparing them. Instrumental Interaction describes graphical user interfaces in terms of domain objects and interaction instruments. Interaction between users and domain objects is mediated by interaction instruments, similar to the tools and instruments we use in the real world to interact with physical objects. The article presents the model, applies it to describe and compare a number of interaction techniques, and shows how it was used to create a new interface for searching and replacing text.