Spark: failed to save dataframe as avro to Google Cloud Storage

Question

I\'m trying to save 37Gb of data to GCS bucket in avro format.

My cluster consists of: 15 workers with 4 cores and 15Gb RAM, 1 master with 4 cores and 15Gb RAM.

<