Data Mining by Means of Binary Representation: A Model for Similarity and Clustering

  • Authors:
  • Zippy Erlich;Roy Gelbard;Israel Spiegler

  • Affiliations:
  • Computer Science Department, The Open University, Tel Aviv 61392, Israel;Technology and Information Systems Department, The Leon Recanati Graduate School of Business Administration, Tel Aviv University, Tel Aviv 69978, Israel;Technology and Information Systems Department, The Leon Recanati Graduate School of Business Administration, Tel Aviv University, Tel Aviv 69978, Israel

  • Venue:
  • Information Systems Frontiers
  • Year:
  • 2002

Quantified Score

Hi-index 0.00

Visualization

Abstract

In this paper we outline a new method for clustering that is based on a binary representation of data records. The binary database relates each entity to all possible attribute values (domain) that entity may assume. The resulting binary matrix allows for similarity and clustering calculation by using the positive (‘1’ bits) of the entity vector. We formulate two indexes: Pair Similarity Index (PSI) to measure similarity between two entities and Group Similarity Index (GSI) to measure similarity within a group of entities. A threshold factor for each attribute domain is defined that is dependent on the domain but independent of the number of entities in the group. The similarity measure provides simplicity of storage and efficiency of calculation. A comparison of our similarity index to other indexes is made. Experiments with sample data indicate a 48% improvement of group similarity over standard methods pointing to the potential and merit of the binary approach to clustering and data mining.