A multimodal virtual environment for interacting with 3d deformable models

  • Authors:
  • Ziying Tang;Anant Patel;Xiaohu Guo;Balakrishnan Prabhakaran

  • Affiliations:
  • University of Texas at Dallas, Richardson, TX, USA;University of Texas at Dallas, Richardson, TX, USA;University of Texas at Dallas, Richardson, TX, USA;University of Texas at Dallas, Richardson, TX, USA

  • Venue:
  • Proceedings of the international conference on Multimedia
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this video presentation, we introduce an immersive multimodal virtual environment which supports real-time interactions with 3D deformable model through a haptic device. We include a system called "FakeSpace" to imitate 3D environment, and a PHAMTOM device to simulate touching forces. Movements of 3D deformable models are simulated based on a spectral method, and forces are simulated as spring forces. We are able to real-time update both visual and haptic feedbacks, so that to provide a more realistic user interaction. In addition, with the help of stereoscopic display, we can present an immersive 3D experience. This video illustrates the settings of our environment and demonstrates how users real-time manipulate 3D models in this immersive system using some interactive examples. Our system is reconfigurable and is useful for different applications in the fields of education, entertainment, medical simulation and so on.