Adaptive Block-size Transform based Just-Noticeable Difference model for images/videos

  • Authors:

  • Lin Ma;King Ngi Ngan;Fan Zhang;Songnan Li

  • Affiliations:

  • Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong;Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong;Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong;Department of Electronic Engineering, The Chinese University of Hong Kong, Shatin, Hong Kong

  • Venue:
  • Image Communication
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper, we propose a novel Adaptive Block-size Transform (ABT) based Just-Noticeable Difference (JND) model for images/videos. Extension from 8x8 Discrete Cosine Transform (DCT) based JND model to 16x16 DCT based JND is firstly performed by considering both the spatial and temporal Human Visual System (HVS) properties. For still images or INTRA video frames, a new spatial selection strategy based on the Spatial Content Similarity (SCS) between a macroblock and its sub-blocks is proposed to determine the transform size to be employed to generate the JND map. For the INTER video frames, a temporal selection strategy based on the Motion Characteristic Similarity (MCS) between a macroblock and its sub-blocks is presented to decide the transform size for the JND. Compared with other JND models, our proposed scheme can tolerate more distortions while preserving better perceptual quality. In order to demonstrate the efficiency of the ABT-based JND in modeling the HVS properties, a simple visual quality metric is designed by considering the ABT-based JND masking properties. Evaluating on the image and video subjective databases, the proposed metric delivers a performance comparable to the state-of-the-art metrics. It confirms that the ABT-based JND consists well with the HVS. The proposed quality metric also is applied on ABT-based H.264/Advanced Video Coding (AVC) for the perceptual video coding. The experimental results demonstrate that the proposed method can deliver video sequences with higher visual quality at the same bit-rates.