Integration of multimodal interaction as assistance in virtual environments

  • Authors:
  • Kiran Pala;Sachin Joshi;Ramnaresh Pothukuchi;Suryakanth V. Ganagashetty

  • Affiliations:
  • International Institute of Information Technology Hyderabad, Hyderabad, India;International Institute of Information Technology Hyderabad, Hyderabad, India;International Institute of Information Technology Hyderabad, Hyderabad, India;International Institute of Information Technology Hyderabad, Hyderabad, India

  • Venue:
  • SMIAE '12 Proceedings of the 1st Workshop on Speech and Multimodal Interaction in Assistive Environments
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

This paper discusses the significance of the multimodal interaction in virtual environments (VE) and the criticalities involved in integration and coordination between modes during interaction. Also, we present an architecture and design of the integration mechanism with respect to information access in second language learning. In this connection, we have conducted an experiential study on speech inputs to understand how far users' experience of information can be considered to be supportive to this architecture.