Evaluation measures for similarity search results in process model repositories

  • Authors:
  • Markus Guentert;Matthias Kunze;Mathias Weske

  • Affiliations:
  • Hasso Plattner Institute at the University of Potsdam, Potsdam, Germany;Hasso Plattner Institute at the University of Potsdam, Potsdam, Germany;Hasso Plattner Institute at the University of Potsdam, Potsdam, Germany

  • Venue:
  • ER'12 Proceedings of the 31st international conference on Conceptual Modeling
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

With the increasing uptake of business process management efforts in companies, similarity search in large process model repositories has gained significance, as it forms a cornerstone of effective process model management and reuse. Similarity search uses a process model as query and retrieves all models, which resemble the query, in a ranked order. So far, the quality of the ranking has not been investigated. In this paper, we propose quality measures for similarity search results in order to address this problem, providing information on how good and how differentiated the results are. Our measures assess result statistics, which are derived from the similarity to the query model, and the agreement of different rankings, produced by diverse similarity measures. We apply our findings to a reference process model collection and comprehensively evaluate their prediction towards human assessment of process similarity.