Apache NiFi For Importing Data From RDMBS to HDFS - Performance Comparison with SQOOP

删除回忆录丶 提交于 2019-12-11 16:03:45

问题


We are exploring Apache NiFi as a general purpose data ingestion tool for our enterprise requirements.

One typical data ingestion requirement is moving data from RDBMS systems to HDFS.

I was able to build RDBMS to HDFS data movement flow in NiFi using GenerateTableFetch and ExecuteSQL Processors provided by NiFi and everything worked fine for smaller tables.

But, I couldn't test the flow for bigger tables as I was using a standalone distribution.

Has anyone done a performance comparison of NiFi with SQOOP for similar requirements ?

来源:https://stackoverflow.com/questions/56126682/apache-nifi-for-importing-data-from-rdmbs-to-hdfs-performance-comparison-with

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!