Content-Based Image Retrieval at the End of the Early Years
IEEE Transactions on Pattern Analysis and Machine Intelligence
PicASHOW: pictorial authority search by hyperlinks on the Web
Proceedings of the 10th international conference on World Wide Web
Object Recognition as Machine Translation: Learning a Lexicon for a Fixed Image Vocabulary
ECCV '02 Proceedings of the 7th European Conference on Computer Vision-Part IV
Optimizing search engines using clickthrough data
Proceedings of the eighth ACM SIGKDD international conference on Knowledge discovery and data mining
Staging transformations for multimodal web interaction management
Proceedings of the 13th international conference on World Wide Web
Web-assisted annotation, semantic indexing and search of television and radio news
WWW '05 Proceedings of the 14th international conference on World Wide Web
WWW '05 Proceedings of the 14th international conference on World Wide Web
Real-time computerized annotation of pictures
MULTIMEDIA '06 Proceedings of the 14th annual ACM international conference on Multimedia
Exhibit: lightweight structured data publishing
Proceedings of the 16th international conference on World Wide Web
Optimal audio-visual representations for illiterate users of computers
Proceedings of the 16th international conference on World Wide Web
Identifying and improving retrieval for procedural questions
Information Processing and Management: an International Journal
Image retrieval: Ideas, influences, and trends of the new age
ACM Computing Surveys (CSUR)
Crowdsourcing user studies with Mechanical Turk
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Improving relevance judgment of web search results with image excerpts
Proceedings of the 17th international conference on World Wide Web
Generating diverse and representative image search results for landmarks
Proceedings of the 17th international conference on World Wide Web
Pagerank for product image search
Proceedings of the 17th international conference on World Wide Web
Detecting image spam using visual features and near duplicate detection
Proceedings of the 17th international conference on World Wide Web
Speeded-Up Robust Features (SURF)
Computer Vision and Image Understanding
A Discriminative Kernel-Based Approach to Rank Images from Text Queries
IEEE Transactions on Pattern Analysis and Machine Intelligence
Predicting information seeker satisfaction in community question answering
Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Hamming Embedding and Weak Geometric Consistency for Large Scale Image Search
ECCV '08 Proceedings of the 10th European Conference on Computer Vision: Part I
Automatic image annotation using visual content and folksonomies
Multimedia Tools and Applications
Visual diversification of image search results
Proceedings of the 18th international conference on World wide web
Proceedings of the 18th international conference on World wide web
Mining multilingual topics from wikipedia
Proceedings of the 18th international conference on World wide web
Towards language-independent web genre detection
Proceedings of the 18th international conference on World wide web
Current research issues and trends in non-English Web searching
Information Retrieval
Searching documentation using text, OCR, and image
Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval
Foundations and Trends in Information Retrieval
Sikuli: using GUI screenshots for search and automation
Proceedings of the 22nd annual ACM symposium on User interface software and technology
Caption and query translation for cross-language image retrieval
CLEF'04 Proceedings of the 5th conference on Cross-Language Evaluation Forum: multilingual Information Access for Text, Speech and Images
International Journal of Digital Library Systems
Hi-index | 0.00 |
The multimedia information retrieval community has dedicated extensive research effort to the problem of content-based image retrieval (CBIR). However, these systems find their main limitation in the difficulty of creating pictorial queries. As a result, few systems offer the option of querying by visual examples, and rely on automatic concept detection and tagging techniques to provide support for searching visual content using textual queries. This paper proposes and studies a practical multimodal web search scenario, where CBIR fits intuitively to improve the retrieval of rich information queries. Many online articles contain useful know-how knowledge about computer applications. These articles tend to be richly illustrated by screenshots. We present a system to search for such software know-how articles that leverages the visual correspondences between screenshots. Users can naturally create pictorial queries simply by taking a screenshot of the application to retrieve a list of articles containing a matching screenshot. We build a prototype comprising 150k articles that are classified into walkthrough, book, gallery, and general categories, and provide a comprehensive evaluation of this system, focusing on technical (accuracy of CBIR techniques) and usability (perceived system usefulness) aspects. We also consider the study of added value features of such a visual-supported search, including the ability to perform cross-lingual queries. We find that the system is able to retrieve matching screenshots for a wide variety of programs, across language boundaries, and provide subjectively more useful results than keyword-based web and image search engines.