Toree on Jupyter for Spark 2.2.0

◇◆丶佛笑我妖孽 提交于 2020-01-01 19:40:10

问题


OS X El Capitan 10.11.6
Spark 2.2.0 (local)
Scala 2.11.8

I'm using Jupyter via my install of anaconda3. My understanding is that the latest production release of Toree does not support either Spark 2.0+ or Scala 11. However I have found several references (1, 2) where you can clone incubator-toree from github and manually set the version of Spark.

In my mac terminal, this is the code I've used:

git clone https://github.com/apache/incubator-toree
cd incubator-toree

Then, the line make clean release APACHE_SPARK_VERSION=2.2.0 gives me the following error:

rm -r dist
rm: dist: No such file or directory
make: [clean-dist] Error 1 (ignored)
APACHE_SPARK_VERSION=2.2.0 VERSION=0.2.0.dev1-incubating IS_SNAPSHOT=true sbt clean
/bin/sh: sbt: command not found
make: *** [clean] Error 127

I'm looking for guidance around this error.


回答1:


Install the developer snapshots using by running following commands

pip install https://dist.apache.org/repos/dist/dev/incubator/toree/0.2.0/snapshots/dev1/toree-pip/toree-0.2.0.dev1.tar.gz

This version supports spark-2.2.0



来源:https://stackoverflow.com/questions/46747583/toree-on-jupyter-for-spark-2-2-0

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!