Learning to filter spam emails: An ensemble learning approach

  • Authors:
  • Mehrnoush Famil Saeedian;Hamid Beigy

  • Affiliations:
  • Department of Computer Engineering, Sharif University of Technology, Tehran, Iran. E-mail: {saeedian,beigy}@ce.sharif.edu;Department of Computer Engineering, Sharif University of Technology, Tehran, Iran. E-mail: {saeedian,beigy}@ce.sharif.edu

  • Venue:
  • International Journal of Hybrid Intelligent Systems
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Most email users have experienced spam problems, which have been addressed as text classification problem. In this paper, we propose a novel spam detection method which uses an ensemble of classifiers based on subsampling and dynamic weighted voting techniques. Since there is diversity in genre of emails' contents, the proposed method finds different topics in emails by using a clustering algorithm. The proposed algorithm first extracts disjoint clusters of emails, and then a classifier is trained on each cluster, and finally decisions of classifiers are combined using dynamic weighted majority techniques. In order to classify a new input sample, first it is compared with all cluster centers and its similarity to each cluster is identified; then the classifiers in the vicinity of the input sample obtain greater weights for the final decision of the ensemble. Finally, the outputs of the classifiers are combined using weighted voting with weights calculated from the similarity of the input sample with cluster centers. The experimental results show that the proposed algorithm outperforms pure SVM and the related ensemble based classifiers.