is partial gz decompression possible?

前端 未结 3 1253
天涯浪人
天涯浪人 2020-12-31 11:15

For working with images that are stored as .gz files (my image processing software can read .gz files for shorter/smaller disk time/space) I need to check the header of each

3条回答
  •  清酒与你
    2020-12-31 11:36

    Yes, it is possible.

    But don't reinvent the wheel, the HDF5 database supports different compression algorithms (gz among them) and you can address different pieces. It is compatible with Linux and Windows and there are wrappers to many languages. It also supports reading and decompressing in parallel, that is very useful if you use high compression rates.

    Here is a comparison of read speed using different compression algorithms from Python through PyTables:

    Plot

提交回复
热议问题