Efficient privacy-preserving similar document detection

  • Authors:
  • Mummoorthy Murugesan;Wei Jiang;Chris Clifton;Luo Si;Jaideep Vaidya

  • Affiliations:
  • Department of Computer Science, Purdue University, West Lafayette, USA 47907;Department of Computer Science, Missouri University of Science and Technology, Rolla, USA 65409;Department of Computer Science, Purdue University, West Lafayette, USA 47907;Department of Computer Science, Purdue University, West Lafayette, USA 47907;MSIS Department, Rutgers University, Newark, USA 07102

  • Venue:
  • The VLDB Journal — The International Journal on Very Large Data Bases
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

Similar document detection plays important roles in many applications, such as file management, copyright protection, plagiarism prevention, and duplicate submission detection. The state of the art protocols assume that the contents of files stored on a server (or multiple servers) are directly accessible. However, this makes such protocols unsuitable for any environment where the documents themselves are sensitive and cannot be openly read. Essentially, this assumption limits more practical applications, e.g., detecting plagiarized documents between two conferences, where submissions are confidential. We propose novel protocols to detect similar documents between two entities where documents cannot be openly shared with each other. The similarity measure used can be a simple cosine similarity on entire documents or on document fragments, enabling detection of partial copying. We conduct extensive experiments to show the practical value of the proposed protocols. While the proposed base protocols are much more efficient than the general secure multiparty computation based solutions, they are still slow for large document sets. We then investigate a clustering based approach that significantly reduces the running time and achieves over 90% of accuracy in our experiments. This makes secure similar document detection both practical and feasible.