How to set and get static variables from spark?

Question

I have a class as this:

public class Test {
    private static String name;

    public static String getName() {
        return name;
    }

    public stati         


        

Answer 1

I would like to add one more approach this makes sense only when if you have a few variables which cab ne passed in runtime as arguments.

spark Configuration --> --conf "spark.executor.extraJavaOptions=-DcutomField=${value}" and when you need data in transformations you can call System.getProperty("cutomField");

you can find more details here

Note: above discussed does not make sense when we have a significant number of variables . in those cases, I would prefer @Daniel Langdon approaches.