A visual modality for the augmentation of paper

Authors:
David R. McGee;Misha Pavel;Adriana Adami;Guoping Wang;Philip R. Cohen
Affiliations:
Pacific Northwest National Laboratory, Richland, WA;Oregon Health and Sciences University, Beaverton, OR;Oregon Health and Sciences University, Beaverton, OR;Oregon Health and Sciences University, Beaverton, OR;Oregon Health and Sciences University, Beaverton, OR
Venue:
Proceedings of the 2001 workshop on Perceptive user interfaces
Year:
2001

Citing 16
Cited 6

The DigitalDesk calculator: tangible manipulation on a desk top display

UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology
Multimodal interfaces for dynamic interactive maps

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Tangible bits: towards seamless interfaces between people, bits and atoms

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
The metaDESK: models and prototypes for tangible user interfaces

Proceedings of the 10th annual ACM symposium on User interface software and technology
Reinventing the familiar: exploring an augmented reality design space for air traffic control

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Urp: a luminous-tangible workbench for urban planning and design

Proceedings of the SIGCHI conference on Human Factors in Computing Systems
Is paper safer? The role of paper flight strips in air traffic control

ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on interface design for safety-critical interactive systems: when there is no room for user error
Something from nothing: augmenting a paper-based work practice via multimodal interaction

DARE '00 Proceedings of DARE 2000 on Designing augmented reality environments
Creating tangible interfaces by augmenting physical objects with multimodal language

Proceedings of the 6th international conference on Intelligent user interfaces
The designers' outpost: a tangible interface for collaborative web site

Proceedings of the 14th annual ACM symposium on User interface software and technology
The ins and outs of collaborative walls: demonstrating the collaborage concept

CHI '99 Extended Abstracts on Human Factors in Computing Systems
A Formal Semantics for ProxyCommunicative Acts

ATAL '01 Revised Papers from the 8th International Workshop on Intelligent Agents VIII
The Adaptive Agent Architecture: Achieving Fault-Tolerance Using Persistent Broker Teams

ICMAS '00 Proceedings of the Fourth International Conference on MultiAgent Systems (ICMAS-2000)
A visual modality for the augmentation of paper

Proceedings of the 2001 workshop on Perceptive user interfaces
Unification-based multimodal parsing

COLING '98 Proceedings of the 17th international conference on Computational linguistics - Volume 1
Multimodal integration-a statistical view

IEEE Transactions on Multimedia

Comparing paper and tangible, multimodal tools

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
A Map-Based System Using Speech and 3D Gestures for Pervasive Computing

ICMI '02 Proceedings of the 4th IEEE International Conference on Multimodal Interfaces
A visual modality for the augmentation of paper

Proceedings of the 2001 workshop on Perceptive user interfaces
Localisation and Interaction for Augmented Maps

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
Implementation of god-like interaction techniques for supporting collaboration between outdoor AR and indoor tabletop users

ISMAR '06 Proceedings of the 5th IEEE and ACM International Symposium on Mixed and Augmented Reality

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe how we have enhanced our multimodal paper-based system, Rasa, with visual perceptual input. We briefly explain how Rasa improves upon current decision-support tools by augmenting, rather than replacing, the paper-based tools that people in command and control centers have come to rely upon. We note shortcomings in our initial approach, discuss how we have added computer-vision as another input modality in our multimodal fusion system, and characterize the advantages that it has to offer. We conclude by discussing our current limitations and the work we intend to pursue to overcome them in the future.