The virtual patrol: capturing and accessing information for the soldier in the field

  • Authors:
  • Thad Starner

  • Affiliations:
  • Georgia Tech, Atlanta, GA

  • Venue:
  • Proceedings of the 3rd ACM workshop on Continuous archival and retrival of personal experences
  • Year:
  • 2006

Quantified Score

Hi-index 0.00

Visualization

Abstract

While a military patrol may be well-planned, its soldiers well-trained, and the intelligence objectives achieved, the information requirements of the commander may change significantly after the patrol has returned. An area that has been scouted for military action may later be the focus for humanitarian aid. In addition, the artifacts and intelligence gained from presence patrols may cause an intelligence officer, upon reflection, to wish for more specifically targeted information than what the patrol was told to recover. Georgia Tech's Virtual Patrol allows a soldier to revisit a patrol captured earlier using the Soldier's Assist System (SAS) wearable computer. SAS captures video, ambient audio, speech audio, high resolution still images, GPS position, altitude, orientation, and body movement during a patrol. The soldier can replay the patrol as a continuous movie, search for specific events, or quickly browse the patrol using a map-based or timeline-based interface. The soldier can quickly select media from the interface to semi-automatically create a presentation about the patrol. In this talk, we will describe the difficulties of creating the on-body capture hardware for this project, the lessons learned in interface design, and the challenges of automatically indexing media taken from the patrols using the types of events soldiers wish to search.