Multimodal collaboration for crime scene investigation in mediated reality

  • Authors:
  • Dragoş Datcu;Thomas Swart;Stephan Lukosch;Zoltan Rusak

  • Affiliations:
  • Delft University of Technology, Delft, Netherlands;Delft University of Technology, Delft, Netherlands;Delft University of Technology, Delft, Netherlands;Delft University of Technology, Delft, Netherlands

  • Venue:
  • Proceedings of the 14th ACM international conference on Multimodal interaction
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we present an innovative mediated reality-oriented, real-time software system designed to support multimodal collaboration among remote CSI experts and forensic investigators at the crime scene. Our prototype integrates state-of-the art technologies for stereo navigation, 3D digital mapping and adaptive hand gesture-based user interface for natural interaction. The multimodal interface accepts mouse inputs, audio and hand gestures possibly while interacting with a purposively designed physical object. The evaluation done by a panel of international CSI practitioners [5] using an adapted Burkhardt et al. method [1], shows that our prototype system genuinely fits into the common practice of forensic investigation while clearly boosting the quality of collaboration. At the moment, the system is under consideration for routinely being adopted as part of special procedures by The Forensic Institute in The Hague, The Netherlands [6].