Comparison of generality based algorithm variants for automatic taxonomy generation

  • Authors:
  • Andreas Henschel;Wei Lee Woon;Thomas Wächter;Stuart Madnick

  • Affiliations:
  • Masdar Institute of Science and Technology, Abu Dhabi, UAE;Masdar Institute of Science and Technology, Abu Dhabi, UAE;Technische Universität Dresden, Dresden, Germany;Massachusetts Institute of Technology, Cambridge, MA

  • Venue:
  • IIT'09 Proceedings of the 6th international conference on Innovations in information technology
  • Year:
  • 2009

Quantified Score

Hi-index 0.00

Visualization

Abstract

We compare a family of algorithms for the automatic generation of taxonomies by adapting the Heymannalgorithm in various ways. The core algorithm determines the generality of terms and iteratively inserts them in a growing taxonomy. Variants of the algorithm are created by altering the way and the frequency, generality of terms is calculated. We analyse the performance and the complexity of the variants combined with a systematic threshold evaluation on a set of seven manually created benchmark sets. As a result, betweenness centrality calculated on unweighted similarity graphs often performs best but requires threshold fine-tuning and is computationally more expensive than closeness centrality. Finally, we show how an entropy-based filter can lead to more precise taxonomies.