Spark ExecutorLostFailure

Question

I\'m trying to run spark 1.5 on mesos in cluster mode. I\'m able to launch the dispatcher and to run the spark-submit. But when I do so, the spark driver fails with the followin

Answer 1

In your event logs or UI check for large GC times. If you have a persist, removing it can free up more memory for your executors (at the expense of running stages more than once). If you are using a broadcast, see if you can reduce its footprint. Or just add more memory.