The scholarly impact of TRECVid (2003–2009)

Authors:
Clare V. Thornley;Andrea C. Johnson;Alan F. Smeaton;Hyowon Lee
Affiliations:
School of Information and Library Studies, University College Dublin, Belfield, Dublin 4, Ireland;School of Information and Library Studies, University College Dublin, Belfield, Dublin 4, Ireland;CLARITY: Centre for Sensor Web Technologies, School of Computing, Dublin City University, Glasnevin, Dublin 9, Ireland;CLARITY: Centre for Sensor Web Technologies, School of Computing, Dublin City University, Glasnevin, Dublin 9, Ireland
Venue:
Journal of the American Society for Information Science and Technology
Year:
2011

Citing 0
Cited 5

Assessing the scholarly impact of imageCLEF

CLEF'11 Proceedings of the Second international conference on Multilingual and multimodal information access evaluation
Bringing the algorithms to the data: cloud---based benchmarking for medical image analysis

CLEF'12 Proceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics
PROMISE retreat report prospects and opportunities for information access evaluation

ACM SIGIR Forum
A preliminary test of Google Scholar as a source for citation data: a longitudinal study of Nobel prize winners

Scientometrics
Retrieval of high-dimensional visual data: current state, trends and challenges ahead

Multimedia Tools and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper reports on an investigation into the scholarly impact of the TRECVid (Text Retrieval and Evaluation Conference, Video Retrieval Evaluation) benchmarking conferences between 2003 and 2009. The contribution of TRECVid to research in video retrieval is assessed by analyzing publication content to show the development of techniques and approaches over time and by analyzing publication impact through publication numbers and citation analysis. Popular conference and journal venues for TRECVid publications are identified in terms of number of citations received. For a selection of participants at different career stages, the relative importance of TRECVid publications in terms of citations vis à vis their other publications is investigated. TRECVid, as an evaluation conference, provides data on which research teams ‘scored’ highly against the evaluation criteria and the relationship between ‘top scoring’ teams at TRECVid and the ‘top scoring’ papers in terms of citations is analyzed. A strong relationship was found between ‘success’ at TRECVid and ‘success’ at citations both for high scoring and low scoring teams. The implications of the study in terms of the value of TRECVid as a research activity, and the value of bibliometric analysis as a research evaluation tool, are discussed. © 2011 Wiley Periodicals, Inc.