Rich internet application for semi-automatic annotation of semantic shots on keyframes

Authors:
Elisabet Carcel;Manuel Martos;Xavier Giró-i-Nieto;Ferran Marqués
Affiliations:
Technical University of Catalonia (UPC), Barcelona, Catalonia, Spain;Technical University of Catalonia (UPC), Barcelona, Catalonia, Spain;Technical University of Catalonia (UPC), Barcelona, Catalonia, Spain;Technical University of Catalonia (UPC), Barcelona, Catalonia, Spain
Venue:
MUSCLE'11 Proceedings of the 2011 international conference on Computational Intelligence for Multimedia Understanding
Year:
2011

Citing 5
Cited 0

LIBSVM: A library for support vector machines

ACM Transactions on Intelligent Systems and Technology (TIST)
Lookapp: interactive construction of web-based concept detectors

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
A flexible environment for multimedia management and publishing

Proceedings of the 1st ACM International Conference on Multimedia Retrieval
An efficient automatic video shot size annotation scheme

MMM'07 Proceedings of the 13th international conference on Multimedia Modeling - Volume Part I
A unified framework for semantic shot classification in sports video

IEEE Transactions on Multimedia

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper describes a system developed for the semi- automatic annotation of keyframes in a broadcasting company. The tool aims at assisting archivists who traditionally label every keyframe manually by suggesting them an automatic annotation that they can intuitively edit and validate. The system is valid for any domain as it uses generic MPEG-7 visual descriptors and binary SVM classifiers. The classification engine has been tested on the multiclass problem of semantic shot detection, a type of metadata used in the company to index new content ingested in the system. The detection performance has been tested in two different domains: soccer and parliament. The core engine is accessed by a Rich Internet Application via a web service. The graphical user interface allows the edition of the suggested labels with an intuitive drag and drop mechanism between rows of thumbnails, each row representing a different semantic shot class. The system has been described as complete and easy to use by the professional archivists at the company.