CHI '86 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Text compression
The perspective wall: detail and context smoothly integrated
CHI '91 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Graphical fisheye views of graphs
CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A focus+context technique based on hyperbolic geometry for visualizing large hierarchies
CHI '95 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A framework for unifying presentation space
Proceedings of the 14th annual ACM symposium on User interface software and technology
Improving focus targeting in interactive fisheye views
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Abstracting Craft: The Practiced Digital Hand
Abstracting Craft: The Practiced Digital Hand
Beyond Interaction Design: Beyond Human-Computer Interaction
Beyond Interaction Design: Beyond Human-Computer Interaction
A framework for elastic presentation space
A framework for elastic presentation space
Designing interaction, not interfaces
Proceedings of the working conference on Advanced visual interfaces
Shoogle: excitatory multimodal interaction on mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Proceedings of the 2nd international conference on Tangible and embedded interaction
Rotational Dynamics for Design of Bidirectional Feedback during Manual Interaction
Proceedings of the 2nd International Conference on Fun and Games
overView: physically-based vibrotactile feedback for temporal information browsing
Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Touching annotations: A visual metaphor for navigation of annotation in digital documents
International Journal of Human-Computer Studies
| Hi-index | 0.00 |
In this paper we introduce a dynamic system approach to the design of multimodal interactive systems. We use an example where we support human behavior in browsing a document, by adapting the dynamics of navigation and the visual feedback (using a focus-in-context (F+C) method) to support the current inferred task. We also demonstrate non-speech audio feedback, based on a language model. We argue that to design interaction we need models of key aspects of the process, here for example, we need models for the dynamic system, language model and sonification. We show how the user's intention is coupled to the visualization technique via the dynamic model, and how the focus-in-context method couples details in context to audio samples via the language identification system. We present probabilistic audio feedback as an example of a multimodal approach to sensing different languages in a multilingual text. This general approach is well suited to mobile and wearable applications, and shared displays.