How to load java properties file and use in Spark?
问题 I want to store the Spark arguments such as input file, output file into a Java property files and pass that file into Spark Driver. I'm using spark-submit for submitting the job but couldn't find a parameter to pass the properties file. Have you got any suggestions? 回答1: here i found one solution: props file : (mypropsfile.conf) // note: prefix your key with "spark." else props will be ignored. spark.myapp.input /input/path spark.myapp.output /output/path launch $SPARK_HOME/bin/spark-submit