Multi-threaded compression of Earth observation time-series data

作     者：D.Swanepoel F.van den Bergh 

作者机构：Remote Sensing Research UnitMeraka InstituteCSIRPretoriaSouth Africa 

出 版 物：《International Journal of Digital Earth》 (国际数字地球学报（英文）)

年 卷 期：2017年第10卷第12期

页      面：1214-1230页

核心收录：

学科分类：0809[工学-电子科学与技术（可授工学、理学学位）] 08[工学] 

主　　题：Data compression multithreading time-series HDF HDF5 MODIS 

摘      要：Earth observation data are typically compressed using general-purpose single-threaded compression algorithms that operate at a fraction of the bandwidth of modern storage and processing *** present evidence that recently developed multi-threaded compression codecs offer substantial benefits over widely used single-threaded codecs in terms of compression efficiency when applied to a selection of moderate resolution imaging spectroradiometer(MODIS)datasets stored in the HDF5 *** codecs from the LZ77 and Rice families are shown to vary in efficacy when applied to different MODIS data products,highlighting the need for compression strategies to be tailored to different classes of *** also introduce LPC-Rice,a new multi-threaded codec,that performs particularly well when applied to time-series data.