No Travel? No Problem.

Remote Participation
Productive and Performant Generic Lossy Data Compression with LibPressio
Event Type
Workshop
Tags
Online Only
Applications
Big Data
Data Analytics
Data Management
Registration Categories
W
TimeSunday, 14 November 20219:35am - 10am CST
LocationOnline
DescriptionIn recent years, lossless and lossy compressors have been developed to cope with the ever increasing volume of scientific floating point data. However not all compression techniques are appropriate for all datasets, and determining which one to use can be time consuming requiring code modifications and trial and error. We present LibPressio -- a generic library for the compression of dense tensors that minimizes the code changes scientists need to make to take advantage of new and improved compression techniques. We compare LibPressio to 9 different completing libraries and measure the overhead of their design decisions as well as overall run time overhead showing insignificant overhead. We further show a improvement in usability as measured by a reduction in lines of code compared to native code by 50-90%.
Back To Top Button