Responsive multimedia system for virtual storytelling

Authors:
Youngho Lee;Sejin Oh;Youngmin Park;Beom-Chan Lee;Jeung-Chul Park;Yoo Rhee Oh;Seokhee Lee;Han Oh;Jeha Ryu;Kwan H. Lee;Hong Kook Kim;Yong-Gu Lee;JongWon Kim;Yo-Sung Ho;Woontack Woo
Affiliations:
GIST U-VR Lab., Gwangju, S.Korea;GIST U-VR Lab., Gwangju, S.Korea;GIST U-VR Lab., Gwangju, S.Korea;Human-Machine-Computer Interface Lab;Intelligent Design & Graphics Lab;Speech, Audio, and Language Communications Lab;Network Media Lab;Visual Communications Lab;Human-Machine-Computer Interface Lab;Intelligent Design & Graphics Lab;Speech, Audio, and Language Communications Lab;Nanoscale Simulation Lab;Network Media Lab;Visual Communications Lab;GIST U-VR Lab., Gwangju, S.Korea
Venue:
PCM'05 Proceedings of the 6th Pacific-Rim conference on Advances in Multimedia Information Processing - Volume Part I
Year:
2005

Citing 2
Cited 2

Tangible bits: towards seamless interfaces between people, bits and atoms

Proceedings of the ACM SIGCHI Conference on Human factors in computing systems
Haptic Rendering: Introductory Concepts

IEEE Computer Graphics and Applications

Context-aware mobile AR system for personalization, selective sharing, and interaction of contents in ubiquitous computing environments

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction platforms and techniques
Digital buddhist image creation by haptic deformation

Edutainment'06 Proceedings of the First international conference on Technologies for E-Learning and Digital Entertainment

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we propose Responsive Multimedia System (RMS) for a virtual storytelling. It consists of three key components; Multi-modal Tangible User Interface (MTUI), a Unified Context-aware Application Model for Virtual Environments (vr-UCAM), and Virtual Environment Manager (VEManager). MTUI allows users to interact with virtual environments (VE) through human’s senses by exploiting tangible, haptic and vision-based interfaces. vr-UCAM decides reactions of VE according to multi-modal input. VEManager generates dynamic VE by applying the reactions and display it through 3D graphics and 3D sounds, etc. To demonstrate an effectiveness of the proposed system, we implemented a virtual storytelling system which unfolds a legend of Unju Temple. We believe the proposed system plays an important role in implementing various entertainment applications.