Computing similarity between cultural heritage items using multimodal features

Authors:
Nikolaos Aletras;Mark Stevenson
Affiliations:
University of Sheffield, Sheffield, UK;University of Sheffield, Sheffield, UK
Venue:
LaTeCH '12 Proceedings of the 6th Workshop on Language Technology for Cultural Heritage, Social Sciences, and Humanities
Year:
2012

Citing 30
Cited 0

Color indexing

International Journal of Computer Vision
Fast multiresolution image querying

SIGGRAPH '95 Proceedings of the 22nd annual conference on Computer graphics and interactive techniques
Foundations of statistical natural language processing

Foundations of statistical natural language processing
Automatic sense disambiguation using machine readable dictionaries: how to tell a pine cone from an ice cream cone

SIGDOC '86 Proceedings of the 5th annual international conference on Systems documentation
Color-based retrieval

Pattern Recognition Letters
Modern Information Retrieval

Modern Information Retrieval
Probabilistic multimedia retrieval

SIGIR '02 Proceedings of the 25th annual international ACM SIGIR conference on Research and development in information retrieval
Unifying Keywords and Visual Contents in Image Retrieval

IEEE MultiMedia
Object Recognition Using Multidimensional Receptive Field Histograms

ECCV '96 Proceedings of the 4th European Conference on Computer Vision-Volume I - Volume I
Combining Textual and Visual Cues for Content-Based Image Retrieval on the World Wide Web

CBAIVL '98 Proceedings of the IEEE Workshop on Content - Based Access of Image and Video Libraries
Object Recognition from Local Scale-Invariant Features

ICCV '99 Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2
Automatic image annotation and retrieval using cross-media relevance models

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Modeling annotated data

Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval
Latent dirichlet allocation

The Journal of Machine Learning Research
Distinctive Image Features from Scale-Invariant Keypoints

International Journal of Computer Vision
Multi-model similarity propagation and its application for web image retrieval

Proceedings of the 12th annual ACM international conference on Multimedia
Hierarchical clustering of WWW image search results using visual, textual and link information

Proceedings of the 12th annual ACM international conference on Multimedia
Exploratory search: from finding to understanding

Communications of the ACM - Supporting exploratory search
Discriminating image senses by clustering with multimodal features

COLING-ACL '06 Proceedings of the COLING/ACL on Main conference poster sessions
Image retrieval: Ideas, influences, and trends of the new age

ACM Computing Surveys (CSUR)
Understanding cultural heritage experts' information seeking needs

Proceedings of the 8th ACM/IEEE-CS joint conference on Digital libraries
Recommendations based on semantically enriched museum collections

Web Semantics: Science, Services and Agents on the World Wide Web
A study on similarity and relatedness using distributional and WordNet-based approaches

NAACL '09 Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Computing semantic relatedness using Wikipedia-based explicit semantic analysis

IJCAI'07 Proceedings of the 20th international joint conference on Artifical intelligence
Organizing and browsing photos using different feature vectors and their evaluations

Proceedings of the ACM International Conference on Image and Video Retrieval
Using measures of semantic relatedness for word sense disambiguation

CICLing'03 Proceedings of the 4th international conference on Computational linguistics and intelligent text processing
Topic models for image annotation and text illustration

HLT '10 Human Language Technologies: The 2010 Annual Conference of the North American Chapter of the Association for Computational Linguistics
Using ontological and document similarity to estimate museum exhibit relatedness

Journal on Computing and Cultural Heritage (JOCCH)
Computer Vision: Algorithms and Applications

Computer Vision: Algorithms and Applications
The notion of overview in information visualization

International Journal of Human-Computer Studies

Quantified Score

Hi-index	0.00

Visualization

Abstract

A significant amount of information about Cultural Heritage artefacts is now available in digital format and has been made available in digital libraries. Being able to identify items that are similar would be useful for search and navigation through these data sets. Information about items in these repositories is often multimodal, such as pictures of the artefact and an accompanying textual description. This paper explores the use of information from these various media for computing similarity between Cultural Heritage artefacts. Results show that combining information from images and text produces better estimates of similarity than when only a single medium is considered.