XGBoost: Creating DMatrix explodes memory usage sometimes

Question

I have a large 5GB dataset stored as a pandas dataframe in a parquet format. When I load it into a XGBoost DMatrix, sometimes the memory usage explodes and it causes a crash