How to run a script in PySpark

后端 未结 5 2039
太阳男子
太阳男子 2020-12-14 15:59

I\'m trying to run a script in the pyspark environment but so far I haven\'t been able to. How can I run a script like python script.py but in pyspark? Thanks

5条回答
  •  我在风中等你
    2020-12-14 16:48

    Spark environment provides a command to execute the application file, be it in Scala or Java(need a Jar format), Python and R programming file. The command is,

    $ spark-submit --master .py.

    I'm running spark in windows 64bit architecture system with JDK 1.8 version.

    P.S find a screenshot of my terminal window. Code snippet

提交回复
热议问题