Interestingness filtering engine: Mining Bayesian networks for interesting patterns

  • Authors:
  • Rana Malhas;Zaher Al Aghbari

  • Affiliations:
  • Department of Computer Science & Engineering, University of Qatar, Doha, Qatar;Department of Computer Science, University of Sharjah, P.O. Box 27272, Sharjah, United Arab Emirates

  • Venue:
  • Expert Systems with Applications: An International Journal
  • Year:
  • 2009

Quantified Score

Hi-index 12.05

Visualization

Abstract

In this paper, we present a new measure of interestingness to discover interesting patterns based on the user's background knowledge, represented by a Bayesian network. The new measure (sensitivity measure) captures the sensitivity of the Bayesian network to the patterns discovered by assessing the uncertainty-increasing potential of a pattern on the beliefs of the Bayesian network. Patterns that attain the highest sensitivity scores are deemed interesting. In our approach, mutual information (from information theory) came in handy as a measure of uncertainty. The Sensitivity of a pattern is computed by summing up the mutual information increases incurred by a pattern when entered as evidence/findings to the Bayesian network. We demonstrate the strength of our approach experimentally using the KSL dataset of Danish 70 year olds as a case study. The results were verified by consulting two doctors (internists).