Saliency-Driven tactile effect authoring for real-time visuotactile feedback

Authors:
Myongchan Kim;Sungkil Lee;Seungmoon Choi
Affiliations:
Pohang University of Science and Technology, Korea;Sungkyunkwan University, Korea;Pohang University of Science and Technology, Korea
Venue:
EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
Year:
2012

Citing 7
Cited 1

A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
Attentional Selection for Object Recognition A Gentle Way

BMCV '02 Proceedings of the Second International Workshop on Biologically Motivated Computer Vision
Real-Time Tracking of Visually Attended Objects in Virtual Environments and Its Application to LOD

IEEE Transactions on Visualization and Computer Graphics
A body-conforming tactile jacket to enrich movie viewing

WHC '09 Proceedings of the World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
A Tactile Glove Design and Authoring System for Immersive Multimedia

IEEE MultiMedia
How 4D effects cause different types of presence experience?

Proceedings of the 10th International Conference on Virtual Reality Continuum and Its Applications in Industry
3D video player system with haptic interaction based on depth image-based representation

IEEE Transactions on Consumer Electronics

Real-time perception-level translation from audio signals to vibrotactile effects

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

New-generation media such as the 4D film have appeared lately to deliver immersive physical experiences, yet the authoring has relied on content artists, impeding the popularization of such media. An automated approach for the authoring becomes increasingly crucial in lowering production costs and saving user interruption. This paper presents a fully automated framework of authoring tactile effects from existing video images to render synchronized visuotactile stimuli in real time. The spatiotemporal features of video images are analyzed in terms of visual saliency and translated into tactile cues that are rendered on tactors installed on a chair. A user study was conducted to evaluate the usability of visuotactile rendering against visual-only presentation. The result indicated that the visuotactile rendering can improve the movie to be more interesting, immersive, appealing, and understandable.