ibm-cloud

Spark Hive reporting pyspark.sql.utils.AnalysisException: u'Table not found: XXX' when run on yarn cluster

|▌冷眼眸甩不掉的悲伤 提交于 2019-12-19 11:22:58
问题 I'm attempting to run a pyspark script on BigInsights on Cloud 4.2 Enterprise that accesses a Hive table. First I create the hive table: [biadmin@bi4c-xxxxx-mastermanager ~]$ hive hive> CREATE TABLE pokes (foo INT, bar STRING); OK Time taken: 2.147 seconds hive> LOAD DATA LOCAL INPATH '/usr/iop/4.2.0.0/hive/doc/examples/files/kv1.txt' OVERWRITE INTO TABLE pokes; Loading data to table default.pokes Table default.pokes stats: [numFiles=1, numRows=0, totalSize=5812, rawDataSize=0] OK Time taken:

How can I trace rules in the Business Rules service on Bluemix?

℡╲_俬逩灬. 提交于 2019-12-18 09:54:08
问题 I am using the Business Rules service on Bluemix, and it does not seem to use the Decision Warehouse. Is there another way to trace the rule firing? 回答1: As you noticed, the Decision Warehouse is not a feature within the Business Rules service. Also, rule traces are disabled. You can add trace filter tags to the payload request. Use the REST form ( &trace=true ) to view the trace filter tags: https://brsv2- instanceID . domain /DecisionService/run.jsp?path=/ ruleApp /1.0/ ruleset /1.0&trace

Can I change owner of directory that is mounted on volume in IBM containers?

南笙酒味 提交于 2019-12-17 16:45:28
问题 I'm trying to launch postgres in IBM containers. I have just created volume by: $ cf ic volume create pgdata Then mount it: $ cf ic run --volume pgdata:/var/pgsql -p 22 registry.ng.bluemix.net/ruimo/pgsql944-cli After logging into container through ssh, I found the mounted directory is owned by root: drwxr-xr-x 3 root root 4096 Jul 8 08:20 pgsql Since postgres does not permit to run by root, I want to change the owner of this directory. But I cannot change the owner of this directory: # chown

How to measure the execution time of a query on Spark

别来无恙 提交于 2019-12-17 09:51:52
问题 I need to measure the execution time of query on Apache spark (Bluemix). What I tried: import time startTimeQuery = time.clock() df = sqlContext.sql(query) df.show() endTimeQuery = time.clock() runTimeQuery = endTimeQuery - startTimeQuery Is it a good way? The time that I get looks too small relative to when I see the table. 回答1: Update: No, using time package is not the best way to measure execution time of Spark jobs. The most convenient and exact way I know of is to use the Spark History

How do I add an action to watson conversation response?

帅比萌擦擦* 提交于 2019-12-17 07:55:32
问题 I've created intent, entity and dialog without a problem. But right now I'm trying to make it so when the user send "goodbye", the application would close. According to the doc, I'll have to name an action that goes along with an intent. How do I do that? Is it through code or through the conversation workspace platform? 回答1: You can use context variables or action variables for that. How to use context variables? Add in your Advance response the "context" and the values, check my example. I

How do I add an action to watson conversation response?

非 Y 不嫁゛ 提交于 2019-12-17 07:55:12
问题 I've created intent, entity and dialog without a problem. But right now I'm trying to make it so when the user send "goodbye", the application would close. According to the doc, I'll have to name an action that goes along with an intent. How do I do that? Is it through code or through the conversation workspace platform? 回答1: You can use context variables or action variables for that. How to use context variables? Add in your Advance response the "context" and the values, check my example. I

IoTP boilerplate Node RED complains about unsupported version of Node.js

我们两清 提交于 2019-12-16 18:04:42
问题 I opened my Node RED flow editor from an existing instance of the Watson IoTP and saw a warning about unsupported version of Node.js. "Using an unsupported version of Node.js You should upgrade to the latest Node.js LTS release" How do I fix this ? 回答1: When a boilerplate application is created, it is a snapshot of the application boilerplate at that time. Unless you maintain it, nothing changes. The warning is indicating that the Node RED version itself has updated (and is now warning about

complex db2/sql query with time-sampling, group, map, join and csv export

人走茶凉 提交于 2019-12-14 03:04:44
问题 I have data in a table (named: TESTING) on a dashDB2 on IBM bluemix (Db2 Warehouse on Cloud) which is looking like this: ID TIMESTAMP NAME VALUE abc 2017-12-21 19:55:38.762 test1 123 abc 2017-12-21 19:55:42.762 test2 456 abc 2017-12-21 19:57:38.762 test1 789 abc 2017-12-21 19:58:38.762 test3 345 def 2017-12-21 19:59:38.762 test1 678 I am looking for a query that: samples the data (for each NAME) to a given timeformat (ex. to a 1 minute based timestamp) VALUES in same timerange (in same minute

Has anyone heard about a replacement for the Concept Expansion service? [closed]

谁说胖子不能爱 提交于 2019-12-14 00:58:05
问题 Closed. This question is off-topic. It is not currently accepting answers. Want to improve this question? Update the question so it's on-topic for Stack Overflow. Closed 3 years ago . I have been learning about the IBM Watson services and Bluemix over the last few months. I had previously looked at the Concept Expansion service but when I returned to the page where this service is described, I found the message from IBM that this service was being withdrawn: Has anyone seen or heard of an

Not able to push my local app to bluemix

烂漫一生 提交于 2019-12-14 00:53:54
问题 I had an app running on another bluemix account. I wanted to copy the app and run it in another bluemix account. So I downloaded code from github repo., but when I am trying to push this app to another account I am seeing following error. Note : I used cf push to push the downloaded app. Any help ? Log : 2014-12-16T14:49:15.41+0530 [API] OUT Updated app with guid e2fca26a-c62d-47 5d-8c21-8e959ae6632c ({"state"=>"STOPPED"}) 2014-12-16T14:49:42.10+0530 [DEA] OUT Got staging request for app with