On the design and execution of cyber-security user studies: methodology, challenges, and lessons learned

Authors:
Malek Ben Salem;Salvatore J. Stolfo
Affiliations:
Computer Science Department, Columbia University, New York, New York;Computer Science Department, Columbia University, New York, New York
Venue:
CSET'11 Proceedings of the 4th conference on Cyber security experimentation and test
Year:
2011

Citing 2
Cited 0

Decoy document deployment for effective masquerade attack detection

DIMVA'11 Proceedings of the 8th international conference on Detection of intrusions and malware, and vulnerability assessment
Modeling user search behavior for masquerade detection

RAID'11 Proceedings of the 14th international conference on Recent Advances in Intrusion Detection

Quantified Score

Hi-index	0.00

Visualization

Abstract

Real-world data collection poses an important challenge in the security field. Insider and masquerader attack data collection poses even a greater challenge. Very few organizations acknowledge such breaches because of liability concerns and potential implications on their market value. This caused the scarcity of real-world data sets that could be used to study insider and masquerader attacks. Moreover, user studies conducted to collect such data lack rigor in their design and execution. In this paper, we present the methodology followed to conduct a user study and build a data set for evaluating masquerade attack detection techniques. We discuss the design, technical, and procedural challenges encountered during our own masquerade data gathering project, and share some of the lessons learned from this several-year project.