Classification of user image descriptions

  • Authors:

  • L. Hollink;A. Th. Schreiber;B. J. Wielinga;M. Worring

  • Affiliations:

  • Free University of Amsterdam, Business Informatics, De Boelelaan 1081a, NL-1081 HV Amsterdam, Netherlands;Free University of Amsterdam, Business Informatics, De Boelelaan 1081a, NL-1081 HV Amsterdam, Netherlands;University of Amsterdam, Social Science Informatics, Roetersstraat 15, NL-1018 WB Amsterdam, Netherlands;University of Amsterdam, Intelligent Sensory Information Systems, Kruislaan 403, NL-1098 SJ Amsterdam, Netherlands

  • Venue:
  • International Journal of Human-Computer Studies
  • Year:
  • 2004

Quantified Score

Hi-index 0.00

Visualization

Abstract

In order to resolve the mismatch between user needs and current image retrieval techniques, we conducted a study to get more information about what users look for in images. First, we developed a framework for the classification of image descriptions by users, based on various classification methods from the literature. The classification framework distinguishes three related viewpoints on images, namely nonvisual metadata, perceptual descriptions and conceptual descriptions. For every viewpoint a set of descriptive classes and relations is specified. We used the framework in an empirical study, in which image descriptions were formulated by 30 participants. The resulting descriptions were split into fragments and categorized in the framework. The results suggest that users prefer general descriptions as opposed to specific or abstract descriptions. Frequently used categories were objects, events and relations between objects in the image.