apache-minifi

MiNiFi - NiFi Connection Failure: Unknown Host Exception : Able to telnet host from the machine where MiNiFi is running

試著忘記壹切 提交于 2019-12-24 21:00:26
问题 I am running MiNiFi in a Linux Box (gateway server) which is behind my company's firewall. My NiFi is running on an AWS EC2 cluster (running in standalone mode). I am trying to send data from the Gateway to NiFi running in AWS EC2. From gateway, I am able to telnet to EC2 node with the public DNS and the remote port which I have configured in the nifi.properties file nifi.properties # Site to Site properties nifi.remote.input.host=ec2-xxx.us-east-2.compute.amazonaws.com nifi.remote.input

Distribution of content among cluster nodes within edge NiFi processors

只愿长相守 提交于 2019-12-13 04:17:23
问题 I was exploring NiFi documentation. I must agree that it is one of the well documented open-source projects out there. My understanding is that the processor runs on all nodes of the cluster. However, I was wondering about how the content is distributed among cluster nodes when we use content pulling processors like FetchS3Object, FetchHDFS etc. In processor like FetchHDFS or FetchSFTP, will all nodes make connection to the source? Does it split the content and fetch from multiple nodes or

Wait-Notify for parallel & sequential processing in Nifi

人走茶凉 提交于 2019-12-11 02:39:01
问题 I have a requirement where I need to execute 4 jobs parallel and when same items job is done in all 4 processors parallely then trigger the next processor for this I have used wait-notify Flow is like 4 parallel jobs -> notify (release signal identifier = ${itemid}, signal counter name = ${processorname}) -> wait (release signal identifier = ${itemid}, target signal count = 4) and wait relationship is connected to the same wait processor-> next processor This works for first time but I have