I-SEARCH: a unified framework for multimodal search and retrieval

Authors:
Apostolos Axenopoulos;Petros Daras;Sotiris Malassiotis;Vincenzo Croce;Marilena Lazzaro;Jonas Etzold;Paul Grimm;Alberto Massari;Antonio Camurri;Thomas Steiner;Dimitrios Tzovaras
Affiliations:
Centre for Research and Technology Hellas (CERTH/ITI), Thessaloniki, Greece;Centre for Research and Technology Hellas (CERTH/ITI), Thessaloniki, Greece;Centre for Research and Technology Hellas (CERTH/ITI), Thessaloniki, Greece;Engineering Ingegneria Informatica S.p.a., Palermo, Italy;Engineering Ingegneria Informatica S.p.a., Palermo, Italy;Hochschule Fulda, Fulda, Germany;Hochschule Fulda, Fulda, Germany;Casa Paganini --- InfoMus Research Centre, University of Genoa, Genoa, Italy;Casa Paganini --- InfoMus Research Centre, University of Genoa, Genoa, Italy;Google Germany GmbH, Hamburg, Germany;Centre for Research and Technology Hellas (CERTH/ITI), Thessaloniki, Greece
Venue:
The Future Internet
Year:
2012

Citing 12
Cited 2

PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps

Proceedings of the 14th annual ACM symposium on User interface software and technology
Time as essence for photo browsing through personal digital libraries

Proceedings of the 2nd ACM/IEEE-CS joint conference on Digital libraries
Ranking with local regression and global alignment for cross media retrieval

MM '09 Proceedings of the 17th ACM international conference on Multimedia
www.MMRetrieval.net: a multimodal search engine

Proceedings of the Third International Conference on SImilarity Search and APplications
An approach to content-based image retrieval based on the Lucene search engine library

ECDL'10 Proceedings of the 14th European conference on Research and advanced technology for digital libraries
Toward a Minimal Representation of Affective Gestures

IEEE Transactions on Affective Computing
Multimodal search and retrieval using manifold learning and query formulation

Proceedings of the 16th International Conference on 3D Web Technology
Measuring multi-modality similarities via subspace learning for cross-media retrieval

PCM'06 Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information Processing
I-SEARCH: a multimodal search engine based on rich unified content description (RUCoD)

Proceedings of the 21st international conference companion on World Wide Web
Optimizing multimedia retrieval using multimodal fusion and relevance feedback techniques

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
Context-aware querying for multimodal search engines

MMM'12 Proceedings of the 18th international conference on Advances in Multimedia Modeling
A System for Real-Time Multimodal Analysis of Nonverbal Affective Social Interaction in User-Centric Media

IEEE Transactions on Multimedia

Modeling end-users as contributors in human computation applications

MEDI'12 Proceedings of the 2nd international conference on Model and Data Engineering
A unified framework for multimodal retrieval

Pattern Recognition

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this article, a unified framework for multimodal search and retrieval is introduced. The framework is an outcome of the research that took place within the I-SEARCH European Project. The proposed system covers all aspects of a search and retrieval process, namely low-level descriptor extraction, indexing, query formulation, retrieval and visualisation of the search results. All I-SEARCH components advance the state of the art in the corresponding scientific fields. The I-SEARCH multimodal search engine is dynamically adapted to end-user's devices, which can vary from a simple mobile phone to a high-performance PC.