How to resolve external packages with spark-shell when behind a corporate proxy?

前端 未结 7 1149
有刺的猬
有刺的猬 2020-12-15 07:20

I would like to run spark-shell with a external package behind a corporate proxy. Unfortunately external packages passed via --packages option are not resolved.

7条回答
  •  盖世英雄少女心
    2020-12-15 08:01

    This worked for me in spark 1.6.1:

    bin\spark-shell --driver-java-options "-Dhttp.proxyHost= -Dhttp.proxyPort= -Dhttps.proxyHost= -Dhttps.proxyPort=" --packages 
    

提交回复
热议问题