Informedia Digital Video Library
Communications of the ACM
Tools and Techniques for Video Performance Evaluation
ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 4
Labeling images with a computer game
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Videotater: an approach for pen-based digital video segmentation and tagging
UIST '06 Proceedings of the 19th annual ACM symposium on User interface software and technology
To search or to label?: predicting the performance of search-based automatic image classifiers
MIR '06 Proceedings of the 8th ACM international workshop on Multimedia information retrieval
The challenge problem for automated detection of 101 semantic concepts in multimedia
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
SmartLabel: an object labeling tool using iterated harmonic energy minimization
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Toward bridging the annotation-retrieval gap in image search by a generative modeling approach
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Automatic speech recognition for webcasts: how good is good enough and what to do when it isn't
Proceedings of the 8th international conference on Multimodal interfaces
Autonomous authoring tools for hypertext
ACM Computing Surveys (CSUR)
Multimedia retrieval at INEX 2006
ACM SIGIR Forum
Exploring human judgement of digital imagery
ACSC '07 Proceedings of the thirtieth Australasian conference on Computer science - Volume 62
Evaluation of active learning strategies for video indexing
Image Communication
An efficient manual image annotation approach based on tagging and browsing
Workshop on multimedia information retrieval on The many faces of multimedia semantics
Tagging over time: real-world image annotation by lightweight meta-learning
Proceedings of the 15th international conference on Multimedia
Arthemis: Annotation software in an integrated capturing and analysis system for colonoscopy
Computer Methods and Programs in Biomedicine
Collaborative editing for improved usefulness and usability of transcript-enhanced webcasts
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multi-query interactive image and video retrieval -: theory and practice
CIVR '08 Proceedings of the 2008 international conference on Content-based image and video retrieval
Savanta--search, analysis, visualisation and navigation of temporal annotations
Multimedia Tools and Applications
Assessing concept selection for video retrieval
MIR '08 Proceedings of the 1st ACM international conference on Multimedia information retrieval
Collaborative Video Scene Annotation Based on Tag Cloud
PCM '08 Proceedings of the 9th Pacific Rim Conference on Multimedia: Advances in Multimedia Information Processing
Foundations and Trends in Information Retrieval
Workflow-Based Architecture for Collaborative Video Annotation
OCSC '09 Proceedings of the 3d International Conference on Online Communities and Social Computing: Held as Part of HCI International 2009
Communication-Efficient Classification in P2P Networks
ECML PKDD '09 Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases: Part I
Semi-automatically labeling objects in images
IEEE Transactions on Image Processing
GAT: a Graphical Annotation Tool for semantic regions
Multimedia Tools and Applications
Video corpus annotation using active learning
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Active learning in multimedia annotation and retrieval: A survey
ACM Transactions on Intelligent Systems and Technology (TIST)
Using web sources for improving video categorization
Journal of Intelligent Information Systems
ICCHP'06 Proceedings of the 10th international conference on Computers Helping People with Special Needs
SynTag: a web-based platform for labeling real-time video
Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
Multiscale annotation of still images with GAT
Proceedings of the 1st International Workshop on Visual Interfaces for Ground Truth Collection in Computer Vision Applications
Assistive tagging: A survey of multimedia tagging with human-computer joint exploration
ACM Computing Surveys (CSUR)
| Hi-index | 0.00 |
Annotated collections of images and videos are a necessary basis for the successful development of multimedia retrieval systems. The underlying models of such systems rely heavily on quality and availability of large training collections. The annotation of large collections, however, is a time-consuming and error prone task as it has to be performed by human annotators. In this paper we present the IBM Efficient Video Annotation (EVA) system, a server-based tool for semantic concept annotation of large video and image collections. It is optimised for collaborative annotation and includes features such as workload sharing and support in conducting inter-annotator analysis. We discuss initial results of an ongoing user-evaluation of this system. The results are based on data collected during the 2005 TRECVID Annotation Forum, where more than 100 annotators have been using the system.