Spark Dataframe validating column names for parquet writes (scala)

Question

I\'m processing events using Dataframes converted from a stream of JSON events which eventually gets written out as as Parquet format.

However, some of the JSON eve

Answer 1

Try to use regular expression for replacing of bad symbols. Check my answer.