In the SparkSQL 1.6 API (scala) Dataframe has functions for intersect and except, but not one for difference. Obviously, a combination of union and
SparkSQL
Dataframe
why not the below?
df1.except(df2)