zfp

This is zfp, an open source C/C++ library for compressed numerical arrays that support high throughput read and write random access. zfp was written by Peter Lindstrom at Lawrence Livermore National Laboratory, and is loosely based on the algorithm described in the following paper: Peter Lindstrom "Fixed-Rate Compressed Floating-Point Arrays" IEEE Transactions on Visualization and Computer Graphics, 20(12):2674-2683, December 2014 doi:10.1109/TVCG.2014.2346458 zfp was originally designed for floating-point data only, but has been extended to also support integer data, and could for instance be used to compress images and quantized volumetric data. To achieve high compression ratios, zfp uses lossy but optionally error-bounded compression. Although bit-for-bit lossless compression of floating-point data is not always possible, zfp is usually accurate to within machine epsilon in near-lossless mode. zfp works best for 2D and 3D arrays that exhibit spatial coherence, such as smooth fields from physics simulations, images, regularly sampled terrain surfaces, etc. Although zfp also provides a 1D array class that can be used for 1D signals such as audio, or even unstructured floating-point streams, the compression scheme has not been well optimized for this use case, and rate and quality may not be competitive with floating-point compressors designed specifically for 1D streams.

Releases Overview