Finding the best picture: cross-media retrieval of content

Authors:
Koen Deschacht;Marie-Francine Moens
Affiliations:
Katholieke Universiteit Leuven, Department of Computer Science, Heverlee, Belgium;Katholieke Universiteit Leuven, Department of Computer Science, Heverlee, Belgium
Venue:
ECIR'08 Proceedings of the IR research, 30th European conference on Advances in information retrieval
Year:
2008

Citing 6
Cited 9

Language Modeling for Information Retrieval

Language Modeling for Information Retrieval
Matching words and pictures

The Journal of Machine Learning Research
Image Retrieval Using Multiple Evidence Ranking

IEEE Transactions on Knowledge and Data Engineering
Automatic rule induction for unknown-word guessing

Computational Linguistics
Web image retrieval on ImagEVAL: evidences on visualness and textualness concept dependency in fusion model

Proceedings of the 6th ACM international conference on Image and video retrieval
Reranking Methods for Visual Search

IEEE MultiMedia

A generalised cross-modal clustering method applied to multimedia news semantic indexing and retrieval

Proceedings of the 18th international conference on World wide web
HMNews: an integrated system for searching and browsing hypermedia news content

Proceedings of the 20th ACM conference on Hypertext and hypermedia
Measuring the descriptiveness of web comments

Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Towards comment-based cross-media retrieval

Proceedings of the 19th international conference on World wide web
Learning to associate relevant photos to georeferenced textual documents

Proceedings of the 19th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems
Information Retrieval in the Commentsphere

ACM Transactions on Intelligent Systems and Technology (TIST)
Hyper Media News: a fully automated platform for large scale analysis, production and distribution of multimodal news content

Multimedia Tools and Applications
Inter-media hashing for large-scale retrieval from heterogeneous data sources

Proceedings of the 2013 ACM SIGMOD International Conference on Management of Data
Enhancing news organization for convenient retrieval and browsing

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)

Quantified Score

Hi-index	0.00

Visualization

Abstract

We query the pictures of Yahoo! News for persons and objects by using the accompanying news captions as an indexing annotation. Our aim is to find these pictures on top of the answer list in which the sought persons or objects are most prominently present. We demonstrate that an appearance or content model based on syntactic, semantic and discourse analysis of the short news text is only useful for finding the best picture of a person of object if the database contains photos each picturing many entities. In other circumstances a simpler bag-of-nouns representation has a good performance. The appearance models are tested in a probabilistic ranking function.