What is going wrong with `unionAll` of Spark `DataFrame`?

前端 未结 5 629
误落风尘
误落风尘 2020-11-29 07:19

Using Spark 1.5.0 and given the following code, I expect unionAll to union DataFrames based on their column name. In the code, I\'m using some FunSuite for pass

5条回答
  •  粉色の甜心
    2020-11-29 08:19

    This issue is getting fixed in spark2.3. They are adding support of unionByName in the dataset.

    https://issues.apache.org/jira/browse/SPARK-21043
    

提交回复
热议问题