A novel interface for simulator training: describing and presenting manipulation skill through VR annotations

  • Authors:
  • Mikko Rissanen;Yoshihiro Kuroda;Tomohiro Kuroda;Hiroyuki Yoshihara

  • Affiliations:
  • Graduate School of Informatics, Kyoto University and Kyoto University Hospital, Kyoto, Japan;Graduate School of Engineering Science, Osaka University and Dept. of Medical Science and Bioengineering, Osaka University, Osaka, Japan;Kyoto University Hospital, Kyoto, Japan and Kyoto University;Kyoto University Hospital, Kyoto, Japan and Kyoto University

  • Venue:
  • ICVR'07 Proceedings of the 2nd international conference on Virtual reality
  • Year:
  • 2007

Quantified Score

Hi-index 0.00

Visualization

Abstract

Virtual reality (VR) based skill training simulators are highly interactive computer systems that allow for training of e.g. manipulation skills. In the most complex domains, such as in surgery, teaching correct manipulation requires expert's judgement and instructions. Video annotation has enabled presentation of explicit principles of manipulation that are highlighted on a recorded demonstration of an expert. In VR, similar annotation methods have been applied even though interactivity of VR allows for novel kinds of representations of annotated data. This paper presents an annotation model and an interface that uses interactivity of VR as an advantage on reading the annotations, which has potential to convey the principles of manipulation through multiple modalities to novices. The design of the model is based on behavioural parameters of the simulation - features which cannot be accessed in the real world. This approach has potential to enhance efficiency of VR simulator based skill training.