Arithmetic coding for data compression
Communications of the ACM
Tetrahedral mesh compression with the cut-border machine
VIS '99 Proceedings of the conference on Visualization '99: celebrating ten years
Near-optimal connectivity encoding of 2-manifold polygon meshes
Graphical Models - Special issue: Processing on large polygonal meshes
Lossless Compression of High-volume Numerical Data from Simulations
DCC '00 Proceedings of the Conference on Data Compression
JPEG2000 Extensions for Bit Plane Coding of Floating Point Data
DCC '03 Proceedings of the Conference on Data Compression
Optimal Alphabet Partitioning for Semi-Adaptive Coding of Sources of Unknown Sparse Distributions
DCC '03 Proceedings of the Conference on Data Compression
An Efficient Algorithm for Lossless Compression of IEEE Float Audio
DCC '04 Proceedings of the Conference on Data Compression
Length-Limited Variable-to-Variable Length Codes For High-Performance Entropy Coding
DCC '04 Proceedings of the Conference on Data Compression
TetStreamer: Compressed Back-to-Front Transmission of Delaunay Tetrahedra Meshes
DCC '05 Proceedings of the Data Compression Conference
Tera-Scalable Algorithms for Variable-Density Elliptic Hydrodynamics with Spectral Accuracy
SC '05 Proceedings of the 2005 ACM/IEEE conference on Supercomputing
Fast Lossless Compression of Scientific Floating-Point Data
DCC '06 Proceedings of the Data Compression Conference
Streaming compression of tetrahedral volume meshes
GI '06 Proceedings of Graphics Interface 2006
Streaming compression of triangle meshes
SGP '05 Proceedings of the third Eurographics symposium on Geometry processing
Efficient data reduction and cache-coherent techniques toward real-time performance
ACM SIGGRAPH 2007 courses
JPEG2000 compatible lossless coding of floating-point data
Journal on Image and Video Processing
Random-Accessible Compressed Triangle Meshes
IEEE Transactions on Visualization and Computer Graphics
Floating-point buffer compression in a unified codec architecture
Proceedings of the 23rd ACM SIGGRAPH/EUROGRAPHICS symposium on Graphics hardware
Using Arithmetic Coding for Reduction of Resulting Simulation Data Size on Massively Parallel GPGPUs
Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface
RDIF a preprocessing filter for HDF5
AMERICAN-MATH'10 Proceedings of the 2010 American conference on Applied mathematics
Wavelet compression with set partitioning for low bandwidth telemetry from AUVs
Proceedings of the Fifth ACM International Workshop on UnderWater Networks
BEMC: a searchable, compressed representation for large seismic wavefields
SSDBM'10 Proceedings of the 22nd international conference on Scientific and statistical database management
Compressing the incompressible with ISABELA: in-situ reduction of spatio-temporal data
Euro-Par'11 Proceedings of the 17th international conference on Parallel processing - Volume Part I
Complexity analysis of adaptive binary arithmetic coding software implementations
NEW2AN'11/ruSMART'11 Proceedings of the 11th international conference and 4th international conference on Smart spaces and next generation wired/wireless networking
Lossless compression of variable-precision floating-point buffers on GPUs
I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games
State Trajectory Compression for Optimal Control with Parabolic PDEs
SIAM Journal on Scientific Computing
Variable bit rate GPU texture decompression
EGSR'11 Proceedings of the Twenty-second Eurographics conference on Rendering
A GPU-supported lossless compression scheme for rendering time-varying volume data
VG'10 Proceedings of the 8th IEEE/EG international conference on Volume Graphics
McrEngine: a scalable checkpointing system using data-aware aggregation and compression
SC '12 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
In-situ sampling of a large-scale particle simulation for interactive visualization and analysis
EuroVis'11 Proceedings of the 13th Eurographics / IEEE - VGTC conference on Visualization
The alpha parallelogram predictor: A lossless compression method for motion capture data
Information Sciences: an International Journal
ARC'13 Proceedings of the 9th international conference on Reconfigurable Computing: architectures, tools, and applications
Assessing the effects of data compression in simulations using physically motivated metrics
SC '13 Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis
McrEngine: A scalable checkpointing system using data-aware aggregation and compression
Scientific Programming - Selected Papers from Super Computing 2012
| Hi-index | 0.00 |
Large scale scientific simulation codes typically run on a cluster of CPUs that write/read time steps to/from a single file system. As data sets are constantly growing in size, this increasingly leads to I/O bottlenecks. When the rate at which data is produced exceeds the available I/O bandwidth, the simulation stalls and the CPUs are idle. Data compression can alleviate this problem by using some CPU cycles to reduce the amount of data needed to be transfered. Most compression schemes, however, are designed to operate offline and seek to maximize compression, notthroughput.Furthermore, they often require quantizing floating-point values onto a uniform integer grid, which disqualifies their use in applications where exact values must be retained. We propose a simple scheme for lossless, online compression of floating-point data that transparently integrates into the I/O ofmany applications.A plug-in scheme for data-dependent prediction makes our scheme applicable to a wide variety of data used invisualization, such as unstructured meshes, point sets, images, and voxel grids. We achieve state-of-the-art compression rates and speeds, the latter in part due to an improved entropy coder. We demonstrate that this significantly accelerates I/O throughput in real simulation runs. Unlike previous schemes, our method also adapts well to variable-precision floating-point and integer data.