Removing Blank fields from Spark Dataframe

Question

I use spark structured streaming to consume a kafka topic which has several type of message(different schema of each type). I define a schema which has all fields for diffe