How DAG works under the covers in RDD?

Question

The Spark research paper has prescribed a new distributed programming model over classic Hadoop MapReduce, claiming the simplification and vast performance boost in many cas

Answer 1

Beginning Spark 1.4 visualization of data has been added through the following three components where it also provide a clear graphical representation of DAG.

• Timeline view of Spark events

• Execution DAG

• Visualization of Spark Streaming statistics

Refer to link for more information.