Fast Parquet row count in Spark

Question

The Parquet files contain a per-block row count field. Spark seems to read it at some point (SpecificParquetRecordReaderBase.java#L151).

I tried this in spark-

Answer 1

We can also use

java.text.NumberFormat.getIntegerInstance.format(sparkdf.count)