apache-zeppelin

No interpreters available in Zeppelin

笑着哭i 提交于 2019-12-03 01:19:59
I have just installed the following on my Mac (Yosemite 10.10.3): oracle java 1.8 update 45 scala 2.11.6 spark 1.4 (precompiled release: http://d3kbcqa49mib13.cloudfront.net/spark-1.4.0-bin-hadoop2.6.tgz ) zeppelin from source ( https://github.com/apache/incubator-zeppelin ) no additional config, just copied created zeppelin-env.sh and zeppelin-site.xml from templates. no edits. I Followed the installation guidelines: https://zeppelin.incubator.apache.org/docs/install/install.html I have build zeppelin without problems: mvn clean install -DskipTests Started it ./bin/zeppelin-daemon.sh start

Getting error while running spark programs in Apache Zeppelin in Windows 10 or 7

半世苍凉 提交于 2019-12-02 19:15:05
问题 I am new to Apache Zeppelin. Installed 0.8.0 and using 7000 port to access Zeppelin. Configured few paths as mentioned below. JAVA_HOME: C:\Program Files\Java\jdk1.8.0_144 HADOOP_HOME: C:\winutils ZEPPELIN_HOME: C:\zeppelin\zeppelin-0.8.0-bin-all\zeppelin-0.8.0-bin-all all these variables are included in path variable and respective bin folders Tried to run spark program and getting the below error. Tried with multiple options to fix it, but unable. Please help. Spark Program: %spark println

Getting error while running spark programs in Apache Zeppelin in Windows 10 or 7

拜拜、爱过 提交于 2019-12-02 07:32:45
I am new to Apache Zeppelin. Installed 0.8.0 and using 7000 port to access Zeppelin. Configured few paths as mentioned below. JAVA_HOME: C:\Program Files\Java\jdk1.8.0_144 HADOOP_HOME: C:\winutils ZEPPELIN_HOME: C:\zeppelin\zeppelin-0.8.0-bin-all\zeppelin-0.8.0-bin-all all these variables are included in path variable and respective bin folders Tried to run spark program and getting the below error. Tried with multiple options to fix it, but unable. Please help. Spark Program: %spark println(sc.appName) Error: DEBUG [2018-07-29 00:06:05,371] ({pool-2-thread-2} RemoteInterpreterManagedProcess

How to convert a mllib matrix to a spark dataframe?

岁酱吖の 提交于 2019-12-02 07:29:34
I want to pretty print the result of a correlation in a zeppelin notebook: val Row(coeff: Matrix) = Correlation.corr(data, "features").head One of the ways to achieve this is to convert the result into a DataFrame with each value in a separate column and call z.show() . However, looking into the Matrix api I don't see any way to do this. Is there another straight forward way to achieve this? Edit: The dataframe has 50 columns. Just converting to a string would not help as the output get truncated. Using the toString method should be the easiest and fastest way if you simply want to print the

How to group time column into 5 second intervals and count rows using Presto?

泄露秘密 提交于 2019-12-02 07:04:08
I am using Presto and Zeppelin. There are a lot of raw datas. I have to summarize those datas. I wanna group time every 5 seconds. serviceType logType date ------------------------------------------------------ service1 log1 2017-10-24 23:00:23.206 service1 log1 2017-10-24 23:00:23.207 service1 log1 2017-10-24 23:00:25.206 service2 log1 2017-10-24 23:00:24.206 service1 log2 2017-10-24 23:00:27.206 service1 log2 2017-10-24 23:00:29.302 then the result serviceType logType date cnt -------------------------------------------------------------- service1 log1 2017-10-24 23:00:20 2 service2 log1

Zeppeling throwing NullPointerException while configuring

时光毁灭记忆、已成空白 提交于 2019-12-02 05:43:50
I am trying to set up zeppelin-0.8.0 on my windos 8 r2 OS. I have already running spark on my console i.e. SPARK_HOME and JAVA_HOME, HADOOP_HOME set up and running fine. But while I am trying to execute printl("hello") in zeppelin spark interpreter it is throwing bellow error ... I already set SPARK_HOME and JAVA_HOME in zeppelin-env.cmd file. Error DEBUG [2019-01-22 10:05:34,129] ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:153) - callbackServer is serving now INFO [2019-01-22 10:05:34,143] ({pool-2-thread-2} RemoteInterpreterManagedProcess.java[start]:190) - Run interpreter

How can I pass datasets between %pyspark interpreter and %python interpreters in Zeppelin?

泪湿孤枕 提交于 2019-12-02 05:20:06
I'm writing a code where I'm fetching a dataset using an internal library and %pyspark interpreter. However I am unable to pass the dataset to %python interpreter. I tried using string variables and it is working fine, but with dataset I'm using the following code to put dataset in a zeppelin context- z.put("input_data",input_data) and it is throwing the following error: AttributeError: 'DataFrame' object has no attribute '_get_object_id' . Can you please tell me how can I do this? Thanks in advance. You can put the result in ResourcePool via print it to %table. %python print('%table a\tb\n408

Are there better interface to add Highcharts support to Zeppelin

我的梦境 提交于 2019-12-01 23:30:20
Apache Zeppelin has good support for AngularJS . While there is a gap between Scala and Javascript. I am trying to add Highcharts support to Zeppelin to fill in this gap. The main goal is to plot it simply directly from Spark DataFrame . After couple round refactor, I come up with the following interface. github.com/knockdata/zeppelin-highcharts Here are two options. Which option is better? Option A This is an example to plot highcharts. highcharts(bank, "marital", List("name" -> "age", "y" -> avg(col("balance")), "orderBy" -> col("age")), new Title("Marital Job Average Balance").x(-20), new

Apache zeppelin tutorial, error “sql interpreter not found”

巧了我就是萌 提交于 2019-12-01 16:26:01
In the " Zeppelin tutorial " notebook, I can't use the %sql interpreter . It will output " sql interpreter not found ". But the spark commands work fine, as well as %md and %sh . Here's the log : ERROR [2015-10-20 10:13:35,045] ({qtp885851948-51} NotebookServer.java[runParagraph]:615) - Exception from run org.apache.zeppelin.interpreter.InterpreterException: sql interpreter not found at org.apache.zeppelin.notebook.NoteInterpreterLoader.get(NoteInterpreterLoader.java:148) at org.apache.zeppelin.notebook.Note.run(Note.java:282) at org.apache.zeppelin.socket.NotebookServer.runParagraph

Apache zeppelin tutorial, error “sql interpreter not found”

跟風遠走 提交于 2019-12-01 15:05:03
问题 In the " Zeppelin tutorial " notebook, I can't use the %sql interpreter . It will output " sql interpreter not found ". But the spark commands work fine, as well as %md and %sh . Here's the log : ERROR [2015-10-20 10:13:35,045] ({qtp885851948-51} NotebookServer.java[runParagraph]:615) - Exception from run org.apache.zeppelin.interpreter.InterpreterException: sql interpreter not found at org.apache.zeppelin.notebook.NoteInterpreterLoader.get(NoteInterpreterLoader.java:148) at org.apache