Derive multiple columns from a single column in a Spark DataFrame

Question

I have a DF with a huge parseable metadata as a single string column in a Dataframe, lets call it DFA, with ColmnA.

I would like to break this column, ColmnA into mu

Answer 1

This can be easily achieved by using pivot function

df4.groupBy("year").pivot("course").sum("earnings").collect()