Exporting nested fields with invalid characters from Spark 2 to Parquet [duplicate]

Answer 1

I solved the problem this way:

df.toDF(df
    .schema
    .fieldNames
    .map(name => "[ ,;{}()\\n\\t=]+".r.replaceAllIn(name, "_")): _*)

where I replaced all incorrect symbols by "_".