tsdb: a compressed database for time series

  • Authors:
  • Luca Deri;Simone Mainardi;Francesco Fusco

  • Affiliations:
  • Institute of Informatics and Telematics, CNR, Pisa, Italy and ntop, Pisa, Italy;Institute of Informatics and Telematics, CNR, Pisa, Italy and Department of Information Engineering, University of Pisa, Pisa, Italy;IBM Zürich Research Laboratory, Rüschlikon, Switzerland

  • Venue:
  • TMA'12 Proceedings of the 4th international conference on Traffic Monitoring and Analysis
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

Large-scale network monitoring systems require efficient storage and consolidation of measurement data. Relational databases and popular tools such as the Round-Robin Database show their limitations when handling a large number of time series. This is because data access time greatly increases with the cardinality of data and number of measurements. The result is that monitoring systems are forced to store very few metrics at low frequency in order to grant data access within acceptable time boundaries. This paper describes a novel compressed time series database named tsdb whose goal is to allow large time series to be stored and consolidated in realtime with limited disk space usage. The validation has demonstrated the advantage of tsdb over traditional approaches, and has shown that tsdb is suitable for handling a large number of time series.