How to resolve external packages with spark-shell when behind a corporate proxy?

Question

I would like to run spark-shell with a external package behind a corporate proxy. Unfortunately external packages passed via --packages option are not resolved.

Answer 1

Add

spark.driver.extraJavaOptions=-Dhttp.proxyHost= -Dhttp.proxyPort= -Dhttps.proxyHost= -Dhttps.proxyPort=

to $SPARK_HOME/conf/spark-defaults.conf works for me.