How to open and read LZMA file in-memory

Question

I have a giant file, let\'s call it one-csv-file.xz. It is an XZ-compressed CSV file.

How can I open and parse through the file without first decomp

Answer 1

You can iterate through an LZMAFile object

import lzma  # python 3, try lzmaffi in python 2
with open('one-csv-file.xz') as compressed:
    with lzma.LZMAFile(compressed) as uncompressed:
        for line in uncompressed:
            do_stuff_with(line)