Spark Streaming: Could not compute split, block not found

前端 未结 3 420
感动是毒
感动是毒 2021-01-01 23:59

I am trying to use Spark Streaming with Kafka (version 1.1.0) but the Spark job keeps crashing due to this error:

14/11/21 12:39:23 ERROR TaskSetManager: Tas         


        
3条回答
  •  长发绾君心
    2021-01-02 00:23

    have you tried with inputs.persist(StorageLevel.MEMORY_AND_DISK_SER).

    E.g. http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-Could-not-compute-split-block-not-found-td11186.html

提交回复
热议问题