Collocated AAR: Augmenting After Action Review with Mixed Reality

Authors:
John Quarles;Samsun Lampotang;Ira Fischler;Paul Fishwick;Benjamin Lok
Affiliations:
Dept. of CISE, University of Florida, USA;Dept. of Anesthesiology, University of Florida, USA;Dept. of Psychology, University of Florida, USA;Dept. of CISE, University of Florida, USA;Dept. of CISE, University of Florida, USA
Venue:
ISMAR '08 Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality
Year:
2008

Citing 10
Cited 1

Toolglass and magic lenses: the see-through interface

SIGGRAPH '93 Proceedings of the 20th annual conference on Computer graphics and interactive techniques
After action review in military training simulations

WSC '94 Proceedings of the 26th conference on Winter simulation
3D magic lenses

Proceedings of the 9th annual ACM symposium on User interface software and technology
Tangible bits: towards seamless interfaces between people, bits and atoms

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Simulation Model Design and Execution: Building Digital Worlds

Simulation Model Design and Execution: Building Digital Worlds
Training for Physical Tasks in Virtual Environments: Tai Chi

VR '03 Proceedings of the IEEE Virtual Reality 2003
Through the looking glass: the use of lenses as an interface tool for Augmented Reality interfaces

Proceedings of the 2nd international conference on Computer graphics and interactive techniques in Australasia and South East Asia
Synchronizing 3D Movements for Quantitative Comparison and Simultaneous Visualization of Actions

ISMAR '05 Proceedings of the 4th IEEE/ACM International Symposium on Mixed and Augmented Reality
Integrating Dynamic and Geometry Model Components through Ontology-Based Inference

Simulation
Tangible User Interfaces Compensate for Low Spatial Cognition

3DUI '08 Proceedings of the 2008 IEEE Symposium on 3D User Interfaces

Analytic review of usability evaluation in ISMAR

Interacting with Computers

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes collocated After Action Review (AAR) of training experiences. Through Mixed Reality (MR), collocated AAR allows users to review past training experiences in situ with the user’s current, real-world experience. MR enables a user-controlled egocentric viewpoint, a visual overlay of virtual information, and playback of recorded training experiences collocated with the user’s current experience. Collocated AAR presents novel challenges for MR, such as collocating time, interactions, and visualizations of previous and current experiences. We created a collocated AAR system for anesthesia education, the Augmented Anesthesia Machine Visualization and Interactive Debriefing system (AAMVID). The system was evaluated in two studies by students (n=19) and educators (n=3). The results demonstrate how collocated AAR systems such as AAMVID can: (1) effectively direct student attention and interaction during AAR and (2) provide novel visualizations of aggregate student performance and insight into student understanding for educators.