Spark Parquet Statistics(min/max) integration

Question

I have been looking into how Spark stores statistics (min/max) in Parquet as well as how it uses the info for query optimization. I have got a few questions. First setup: Sp

Answer 1

This has been resolved in Spark-2.4.0 version. In here they have upgraded parquet version from 1.8.2 to 1.10.0.

[SPARK-23972] Update Parquet from 1.8.2 to 1.10.0

With these all column types, whether they are Int/String/Decimal will contain min/max statistics.