Flume to migrate data from MySQL to Hadoop

前端 未结 5 1039
深忆病人
深忆病人 2021-01-07 04:58

Please share your thoughts.

The requirement is to migrate the data in MySQL db to Hadoop/HBase for analytic purposes.

The data should be migrated real time o

5条回答
  •  暖寄归人
    2021-01-07 05:49

    I use flume to store data both on HDSF and in MySQL. For latter I use JDBC com.stratio.ingestion.sink.jdbc.JDBCsink. But I am not very satisfied with it performance. Since you need to migrate data from MySQL I would suggest using Sqoop. Another option is to use Flume to send data both to MySQL and HBase/Hadoop, thus you won't need to copy from MySQL to Hadoop/

提交回复
热议问题