Is data clustering in adversarial settings secure?

  • Authors:
  • Battista Biggio;Ignazio Pillai;Samuel Rota Bulò;Davide Ariu;Marcello Pelillo;Fabio Roli

  • Affiliations:
  • Università di Cagliari, Cagliari, Italy;Università di Cagliari, Cagliari, Italy;FBK-irst, Trento, Italy;Università di Cagliari, Cagliari, Italy;Università Ca' Foscari di Venezia, Venice, Italy;Università di Cagliari, Cagliari, Italy

  • Venue:
  • Proceedings of the 2013 ACM workshop on Artificial intelligence and security
  • Year:
  • 2013

Quantified Score

Hi-index 0.00

Visualization

Abstract

Clustering algorithms have been increasingly adopted in security applications to spot dangerous or illicit activities. However, they have not been originally devised to deal with deliberate attack attempts that may aim to subvert the clustering process itself. Whether clustering can be safely adopted in such settings remains thus questionable. In this work we propose a general framework that allows one to identify potential attacks against clustering algorithms, and to evaluate their impact, by making specific assumptions on the adversary's goal, knowledge of the attacked system, and capabilities of manipulating the input data. We show that an attacker may significantly poison the whole clustering process by adding a relatively small percentage of attack samples to the input data, and that some attack samples may be obfuscated to be hidden within some existing clusters. We present a case study on single-linkage hierarchical clustering, and report experiments on clustering of malware samples and handwritten digits.