问题
I use NiFi(one instance) CaptureMySQLChange(binlog) + EvaludateJsonPath + JoltTransformJSON + PutDatabaseRecord to sync data from one table to another, both tables are on different databases but on same mysql instance. I use insert into table_a select * from table_b limit 5000; to batch insert 5000 rows, nifi takes about 7 minutes to sync all 5000 rows, is it normal or slow for nifi? If slow, how should I do to improve performance?
jvm setting:
java.arg.2=-Xms4g
java.arg.3=-Xmx8g
Processor setting:
timer-driven scheduling, concurrent tasks=1(to re-execute sql in order), Run Schedule=0 sec, Penalty Duration=10 sec, Yield Duration=1 sec
queue setting:
Back Pressure Object Threshold=100_000, Size Threshold=2g FirstInFirstOutPrioritizer
来源：https://stackoverflow.com/questions/56166048/how-to-improve-nifi-performance-when-sync-data-in-mysql