What is going wrong with `unionAll` of Spark `DataFrame`?

前端 未结 5 631
误落风尘
误落风尘 2020-11-29 07:19

Using Spark 1.5.0 and given the following code, I expect unionAll to union DataFrames based on their column name. In the code, I\'m using some FunSuite for pass

5条回答
  •  既然无缘
    2020-11-29 08:20

    As discussed in SPARK-9813, it seems like as long as the data types and number of columns are the same across frames, the unionAll operation should work. Please see the comments for additional discussion.

提交回复
热议问题