Real-time visual content description system based on MPEG-7 descriptors

Authors:
Rafał Kapela;Paweł Śniatała;Andrzej Rybarczyk
Affiliations:
Department of Computer Engineering, Faculty of Computing Science and Management, Poznań University of Technology, Poznań, Poland 60-965;Department of Computer Engineering, Faculty of Computing Science and Management, Poznań University of Technology, Poznań, Poland 60-965;Department of Computer Engineering, Faculty of Computing Science and Management, Poznań University of Technology, Poznań, Poland 60-965
Venue:
Multimedia Tools and Applications
Year:
2011

Citing 5
Cited 2

Demonstration of an MPEG-7 multimedia data cartridge

Proceedings of the tenth ACM international conference on Multimedia
Introduction to MPEG-7: Multimedia Content Description Interface

Introduction to MPEG-7: Multimedia Content Description Interface
Content Description Servers for Networked Video Surveillance

ITCC '04 Proceedings of the International Conference on Information Technology: Coding and Computing (ITCC'04) Volume 2 - Volume 2
Real-time shape description system based on MPEG-7 descriptors

Journal of Systems Architecture: the EUROMICRO Journal
Overview of the MPEG-7 standard

IEEE Transactions on Circuits and Systems for Video Technology

Illumination invariant eye detection in facial images based on the retinex theory

IScIDE'11 Proceedings of the Second Sino-foreign-interchange conference on Intelligent Science and Intelligent Data Engineering
Eye detection under varying illumination using the retinex theory

Neurocomputing

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a real-time Visual Content Description System (VCDS) based on MPEG-7 descriptors. In our approach the system's structure is divided into two parts, the first of which is the extraction of the descriptors using the VCDS. The second part uses the descriptors' values in a particular search algorithm. We propose here original solutions for both parts. The proposed system architecture could be used for real-time video indexing and retrieval, content summarization, content delivery, surveillance, personalized services, etc. The descriptor extractor IP core, which is part of the VCDS, implements four MPEG-7 visual descriptors and was designed for ASIC implementation in CMOS 0.35 μm, which is a novel solution for a real-time content description problem. The proposed hardware architecture splits the computational burden into several threads, so that calculations are made simultaneously in order to improve the system's speed. These methods make the hardware implementation of the most computationally demanding modules of the system more time- and power-efficient. Four different variations of the basic hardware architecture are discussed. New search algorithms based on the VCDS responses are also proposed. Experimental results demonstrate the effectiveness of the hardware architectures, and the new approach to similarity-based searching methods.