Touch saliency

Authors:
Mengdi Xu;Bingbing Ni;Jian Dong;Zhongyang Huang;Meng Wang;Shuicheng Yan
Affiliations:
National University of Singapore, Singapore, Singapore;Advanced Digital Science Center, Singapore, Singapore;National University of Singapore, Singapore, Singapore;Panasonic Singapore Laboratories, Singapore, Singapore;Hefei University of Technology, Hefei, China;National University of Singapore, Singapore, Singapore
Venue:
Proceedings of the 20th ACM international conference on Multimedia
Year:
2012

Citing 8
Cited 0

A Model of Saliency-Based Visual Attention for Rapid Scene Analysis

IEEE Transactions on Pattern Analysis and Machine Intelligence
A Coherent Computational Approach to Model Bottom-Up Visual Attention

IEEE Transactions on Pattern Analysis and Machine Intelligence
Automatic image retargeting

MUM '05 Proceedings of the 4th international conference on Mobile and ubiquitous multimedia
Esaliency (Extended Saliency): Meaningful Attention Using Stochastic Image Modeling

IEEE Transactions on Pattern Analysis and Machine Intelligence
Dynamic captioning: video accessibility enhancement for hearing impairment

Proceedings of the international conference on Multimedia
An eye fixation database for saliency detection in images

ECCV'10 Proceedings of the 11th European conference on Computer vision: Part IV
Video accessibility enhancement for hearing-impaired users

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP) - Special section on ACM multimedia 2010 best paper candidates, and issue on social media
In-Image Accessibility Indication

IEEE Transactions on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this work, we propose a new concept of touch saliency, and attempt to answer the question of whether the underlying image saliency map may be implicitly derived from the accumulative touch behaviors (or more specifically speaking, zoom-in and panning manipulations) when many users browse the image on smart mobile devices with multi-touch display of small size. The touch saliency maps are collected for the images of the recently released NUSEF dataset, and the preliminary comparison study demonstrates: 1) the touch saliency map is highly correlated with human eye fixation map for the same stimuli, yet compared to the latter, the touch data collection is much more flexible and requires no cooperation from users; and 2) the touch saliency is also well predictable by popular saliency detection algorithms. This study opens a new research direction of multimedia analysis by harnessing human touch information on increasingly popular multi-touch smart mobile devices.