apache-nifi

How does one setup a Distributed Map Cache for NiFi?

由 ↘锁芯ラ 提交于 2019-11-28 08:44:43
问题 I'm brand new to NiFi and simply playing around with processors. I'm trying to incorporate Wait and Notify processors in my testing, but I have to setup a Distributed Map Cache (server and client?). The NiFi documentation assumes a level of understanding that I do not have. I've installed memcached on my computer (macOS) and verified that it's running on Port 11211 (default). I've created a DistributedMapCacheClientService and DistributedMapCacheServer under NiFi's CONTROLLER SERVICES , but I

Kafka Avro Consumer with Decoder issues

由 有些话、适合烂在心里 提交于 2019-11-28 00:02:31
When I attempted to run Kafka Consumer with Avro over the data with my respective schema,it returns an error of "AvroRuntimeException: Malformed data. Length is negative: -40" . I see others have had similar issues converting byte array to json , Avro write and read , and Kafka Avro Binary *coder . I have also referenced this Consumer Group Example , which have all been helpful, however no help with this error thus far.. It works up until this part of code (line 73) Decoder decoder = DecoderFactory.get().binaryDecoder(byteArrayInputStream, null); I have tried other decoders and printed out the

Python Script using ExecuteStreamCommand

由 馋奶兔 提交于 2019-11-27 05:10:43
After doing my best to find previous questions and examples relevant to this question, and still not finding the answers that I'm looking for I figured that I would submit a question myself. ExecuteStreamCommand seems like the perfect processor for me due to the following reasons: I am able to execute any Python script and avoid Jython (in a similar fashion as ExecuteScript). Jython is not an option for me. I can take in FlowFiles. This is necessary as my script is made to consume the output of a previous processor. Furthermore I like the idea of keeping the data under "NiFi management". It

Python error in Apache NiFi: Import Error: No module named Pandas

由 半腔热情 提交于 2019-11-26 23:41:57
问题 I'm new to NiFi. I'm trying to execute a Python script using ExecuteScript processor. When I tried a simple script which has no import commands it ran fine and showed output in nifi.StdOut. When I tried to run a script which includes import commands like import pandas . It showing the below error: Import Error: No module named Pandas I tried providing the path of the pkgs in the Module directory in properties. But it doesn't workout. Any help would be appreciated! 回答1: I believe the issue is

Python Script using ExecuteStreamCommand

由 别来无恙 提交于 2019-11-26 11:26:57
问题 After doing my best to find previous questions and examples relevant to this question, and still not finding the answers that I\'m looking for I figured that I would submit a question myself. ExecuteStreamCommand seems like the perfect processor for me due to the following reasons: I am able to execute any Python script and avoid Jython (in a similar fashion as ExecuteScript). Jython is not an option for me. I can take in FlowFiles. This is necessary as my script is made to consume the output
订阅 apache-nifi