RDIF a preprocessing filter for HDF5

  • Authors:
  • Raka Jovanovic;Rudolph A. Lorentz

  • Affiliations:
  • Texas AM University At Qatar, Doha, Qatar;Texas AM University At Qatar, Doha, Qatar

  • Venue:
  • AMERICAN-MATH'10 Proceedings of the 2010 American conference on Applied mathematics
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

The aim of this paper is to provide the users of the data format HDF5 with a preprocessor package for lossless compression for all of its predefined numerical data types. Combining this package with the built in compression filters generally compresses the data better than any of them individually, while not being essentially slower than the standard compression filter. In addition, it is as easy to use as any of the built in filters. We have tested the increase in compression ratio that occurs when this new filter (RDIF) is combined with compression filters that are a part of HDF5 like SZIP and GZIP.