How can I get the current SparkSession in any place of the codes?

Question

I have created a session in the main() function, like this:

val sparkSession = SparkSession.builder.master(\"local[*]\").appName(\"Simple Applic         


        

Answer 1

Since 2.2.0 you can access the active SparkSession through:

/**
 * Returns the active SparkSession for the current thread, returned by the builder.
 *
 * @since 2.2.0
 */
def getActiveSession: Option[SparkSession] = Option(activeThreadSession.get)

or default SparkSession:

/**
 * Returns the default SparkSession that is returned by the builder.
 *
 * @since 2.2.0
 */
def getDefaultSparkSession: Option[SparkSession] = Option(defaultSession.get)