Store mongodb data in compressed format

Question

I am using mongodb to store raw HTML data of web pages using scrapy framework. In one day of web scraping 25GB disk space is filled up. Is there a way to store raw data in c

Answer 1

Starting with 2.8 version of Mongo, you can use compression. You will have 3 levels of compression with WiredTiger engine, mmap (which is default in 2.6 does not provide compression):

• None
• snappy (by default)
• zlib

Here is an example of how much space will you be able to save for 16 GB of data:

data is taken from this article.