apache-nifi

I have the below flow set up for reading json data and convert it to csv using the convertRecord processor. However, the output flowfile is only populated with single record (I am assuming only the first record) instead of all the records. Can someone help provide the correct configuration? Source json data: {"creation_Date": "2018-08-19", "Hour_of_day": 7, "log_count": 2136} {"creation_Date": "2018-08-19", "Hour_of_day": 17, "log_count": 606} {"creation_Date": "2018-08-19", "Hour_of_day": 14, "log_count": 1328} {"creation_Date": "2018-08-19", "Hour_of_day": 20, "log_count": 363} flow:

I'm have a csv file which contains hundred thousands of rows and below are some sample lines.., 1,Ni,23,28-02-2015 12:22:33.2212-02 2,Fi,21,28-02-2015 12:22:34.3212-02 3,Us,33,30-03-2015 12:23:35-01 4,Uk,34,31-03-2015 12:24:36.332211-02 I need to get the last column of csv data which is in wrong datetime format. So I need to get default datetimeformat( "YYYY-MM-DD hh:mm:ss[.nnn]" ) from last column of the data. I have tried the following script to get lines from it and write into flow file. import json import java.io from org.apache.commons.io import IOUtils from java.nio.charset import

I have a csv file say with 100+ columns and I want to extract only specific 60 columns as a subset(both column name + its value). I know we can use Extract Text processors. Can anyone tell me what regular expression to write ? Ex- Lets say from the given snapshot I only want NiFi to Extract 'BMS_sw_micro', 'BMU_Dbc_Dbg_Micro', 'BMU_Dbc_Fia_Micro' columns i.e. Extract only column 'F,L,O'. any help is much appreciated! As I said in the comment, you can Count the number of commas before the text, you want to match and use that in the RegEx, like this: /(?<=^([^,]+?,){5})[^,]+/ What the RegEx do

I have two payloads and want to merge them into single JSON object (streaming join). At few places people are suggesting to use AttributesToJSON, but as one of the JSON does not have fix set of attributes I guess that would not be possible. First payload is { "title":"API-Actions Documentation", "title_link":"https://api.slack.com/", "author_name":"name", "author_link":"http://flickr.com/bobby/", "author_icon":"http://flickr.com/icons/bobby.jpg", "text":"Optional", "image_url":"http://my-website.com/path/to/image.jpg", "thumb_url":"http://example.com/path/to/thumb.png", "footer":null, "pretext

Is it possible to use xmlHttpRequest in NIFI processor to invoke remote rest service? In my case the ExecuteScript processor (using Javascript) can't evaluate XMLHttpRequest ; is there any similar solution I can use to get response data? var OutputStreamCallback = Java.type("org.apache.nifi.processor.io.OutputStreamCallback"); var StandardCharsets = Java.type("java.nio.charset.StandardCharsets"); Date.prototype.isValid = function () { return (Object.prototype.toString.call(this) === "[object Date]") && !isNaN(this.getTime()); }; var flowFile = session.get(); if (flowFile != null) { var