A Large-Scale Evaluation of an E-mail Management Assistant

  • Authors:
  • Wayne Wobcke;Alfred Krzywicki;Yiu-Wa Chan

  • Affiliations:
  • -;-;-

  • Venue:
  • WI-IAT '08 Proceedings of the 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology - Volume 02
  • Year:
  • 2008

Quantified Score

Hi-index 0.00

Visualization

Abstract

EMMA is an e-mail management assistant based on Ripple Down Rules, providing a high degree of classification accuracy while simplifying the task of maintaining the consistency of the rule base. A Naive Bayes algorithm is used to improve the usability of EMMA by suggesting keywords to help the user define rules. In this paper, we report on an experimental evaluation of EMMA on 16 998 pre-classified messages. The aim of the evaluation was to show that the Ripple Down Rule technique used in EMMA applies to large-scale data sets in realistic organizational contexts. The results showed conclusively that EMMA attained the agreed success criteria for the evaluation and that the knowledge acquisition method used in EMMA outperforms standard machine learning methods.