I have created a session in the main()
function, like this:
val sparkSession = SparkSession.builder.master(\"local[*]\").appName(\"Simple Applic
When SparkSession
variable has been defined as
val sparkSession = SparkSession.builder.master("local[*]").appName("Simple Application").getOrCreate()
This variable is going to point/refer
to only one SparkSession
as its a val
. And you can always pass to different classes for them to access as well as
val newClassCall = new NewClass(sparkSession)
Now you can use the same sparkSession
in that new class as well.