Video coding based on audio-visual attention

Authors:
Jong-Seok Lee;Francesca De Simone;Touradj Ebrahimi
Affiliations:
Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland;Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland;Ecole Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
Venue:
ICME'09 Proceedings of the 2009 IEEE international conference on Multimedia and Expo
Year:
2009

Citing 4
Cited 1

Neural Substrates of Perceptual Enhancement by Cross-Modal Spatial Attention

Journal of Cognitive Neuroscience
Cross-Modal Localization via Sparsity

IEEE Transactions on Signal Processing
Spatiotemporal Visual Considerations for Video Coding

IEEE Transactions on Multimedia
Automatic foveation for video compression using a neurobiological model of visual attention

IEEE Transactions on Image Processing

Efficient video coding based on audio-visual focus of attention

Journal of Visual Communication and Image Representation

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper proposes an efficient video coding method based on audio-visual attention, which is motivated by the fact that cross-modal interaction significantly affects humans' perception of multimedia content. First, we propose an audio-visual source localization method to locate the sound source in a video sequence. Then, its result is used for applying spatial blurring to video frames in order to reduce redundant high-frequency information and achieve coding efficiency. We demonstrate the effectiveness of the proposed method for H.264/AVC coding along with the results of a subjective evaluation.