Learning from User Behavior in Image Retrieval: Application of Market Basket Analysis

Authors:
Henning Müller;Thierry Pun;David Squire
Affiliations:
Computer Vision Group, University of Geneva, 24 Rue du Général Dufour, CH-1211 Genève 4, Switzerland. Henning.Mueller@cui.unige.ch;Computer Vision Group, University of Geneva, 24 Rue du Général Dufour, CH-1211 Genève 4, Switzerland;Computer Science and Software Engineering, Monash University, Melbourne, Australia. David.Squire@csse.monash.edu.au
Venue:
International Journal of Computer Vision - Special Issue on Content-Based Image Retrieval
Year:
2004

Citing 21
Cited 17

Term-weighting approaches in automatic text retrieval

Information Processing and Management: an International Journal
Mining association rules between sets of items in large databases

SIGMOD '93 Proceedings of the 1993 ACM SIGMOD international conference on Management of data
VisualSEEk: a fully automated content-based image query system

MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Beyond market baskets: generalizing association rules to correlations

SIGMOD '97 Proceedings of the 1997 ACM SIGMOD international conference on Management of data
SpeedTracer: a Web usage mining and analysis tool

IBM Systems Journal
Mining frequent patterns without candidate generation

SIGMOD '00 Proceedings of the 2000 ACM SIGMOD international conference on Management of data
Content-Based Image Retrieval at the End of the Early Years

IEEE Transactions on Pattern Analysis and Machine Intelligence
Algorithms for association rule mining — a general survey and comparison

ACM SIGKDD Explorations Newsletter
Content-based query of image databases: inspirations from text retrieval

Pattern Recognition Letters - Selected papers from the 11th scandinavian conference on image analysis
Performance evaluation in content-based image retrieval: overview and proposals

Pattern Recognition Letters - Special issue on image/video indexing and retrieval
A statistical correlation model for image retrieval

MULTIMEDIA '01 Proceedings of the 2001 ACM workshops on Multimedia: multimedia information retrieval
Multimedia Storage and Archiving Systems IV

Multimedia Storage and Archiving Systems IV
Fast Algorithms for Mining Association Rules in Large Databases

VLDB '94 Proceedings of the 20th International Conference on Very Large Data Bases
An Efficient Algorithm for Mining Association Rules in Large Databases

VLDB '95 Proceedings of the 21th International Conference on Very Large Data Bases
Interaction in Content-Based Image Retrieval: The Evaluation of the State-of-the-Art Review

VISUAL '00 Proceedings of the 4th International Conference on Advances in Visual Information Systems
Discovering Spatial Co-location Patterns: A Summary of Results

SSTD '01 Proceedings of the 7th International Symposium on Advances in Spatial and Temporal Databases
Analysis of navigation behaviour in web sites integrating multiple information systems

The VLDB Journal — The International Journal on Very Large Data Bases
Target Testing and the PicHunter Bayesian Multimedia Retrieval System

ADL '96 Proceedings of the 3rd International Forum on Research and Technology Advances in Digital Libraries
Image Retrieval Evaluation

CBAIVL '98 Proceedings of the IEEE Workshop on Content - Based Access of Image and Video Libraries
Strategies for Positive and Negative Relevance Feedback in Image Retrieval

ICPR '00 Proceedings of the International Conference on Pattern Recognition - Volume 1
Relevance feedback: a power tool for interactive content-based image retrieval

IEEE Transactions on Circuits and Systems for Video Technology

The CLEF 2005 Automatic Medical Image Annotation Task

International Journal of Computer Vision
Image retrieval: Ideas, influences, and trends of the new age

ACM Computing Surveys (CSUR)
Learning to reduce the semantic gap in web image retrieval and annotation

Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval
Learning a Mahalanobis distance metric for data clustering and classification

Pattern Recognition
Learning a Frequency---Based Weighting for Medical Image Classification

Medical Imaging and Informatics
An efficient algorithm for local distance metric learning

AAAI'06 Proceedings of the 21st national conference on Artificial intelligence - Volume 1
Music recommendation based on acoustic features and user access patterns

IEEE Transactions on Audio, Speech, and Language Processing
Semi-supervised distance metric learning for collaborative image retrieval and clustering

ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Implicit visual concept modeling in image / video annotation

Proceedings of the first ACM international workshop on Analysis and retrieval of tracked events and motion in imagery streams
Similarity beyond distance measurement

Large Scale Semantic Access to Content (Text, Image, Video, and Sound)
The use of MedGIFT and EasyIR for ImageCLEF 2005

CLEF'05 Proceedings of the 6th international conference on Cross-Language Evalution Forum: accessing Multilingual Information Repositories
Content-free image retrieval by combinations of keywords and user feedbacks

CIVR'05 Proceedings of the 4th international conference on Image and Video Retrieval
DBCAMM: A novel density based clustering algorithm via using the Mahalanobis metric

Applied Soft Computing
Towards group behavioral reason mining

Expert Systems with Applications: An International Journal
Image classification with a frequency-based information retrieval scheme for ImageCLEFmed 2006

CLEF'06 Proceedings of the 7th international conference on Cross-Language Evaluation Forum: evaluation of multilingual and multi-modal information retrieval
Topic modelling of clickthrough data in image search

Multimedia Tools and Applications
Automatic annotation of image databases based on implicit crowdsourcing, visual concept modeling and evolution

Multimedia Tools and Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

This article describes an approach to learn feature weights for content-based image retrieval (CBIR) from user interaction log files. These usage log files are analyzed for images marked together by a user in the same query step. The problem is somewhat similar to one of the traditional data mining problems, the market basket analysis problem, where items bought together in a supermarket are analyzed. This paper outlines similarities and differences between the two fields and explains how to use the interaction data for deriving a better feature weighting.Experiments with existing log files are done and a significant improvement in performance is reached with a feature weighting calculated from the information contained in the log files. Even with several steps of relevance feedback the results remain much better than without the learning, which means that not only information from feedback is taken into account earlier, but a better quality of retrieval is reached in all steps.