参考学习路径
参考 https://www.cnblogs.com/Java-Starter/p/10869324.html
https://www.imooc.com/article/265952
https://www.imooc.com/article/259830
https://www.imooc.com/article/details/id/50892
https://www.imooc.com/article/45108
B站的
https://search.bilibili.com/video?keyword=datax
https://www.bilibili.com/video/av75226648?from=search&seid=8848553852603897194
job demo
sliceRecordCount: 100000
表示 将数据 发送 10W次到 streamreader 里面
setting 必须有， 但是 setting 里面可以没有内容。
一般配置speed 或者 channel
注意 如果是 stream的话 channel 设置多少次就会 重复执行多少遍。
比如 channel=2 ，如果 ssliceRecordCount: 10 ,那么最终会 执行 20次 。正常应该是 10次的
speed 里面的 byte 意思是 一次并发 控制多少个字节
errorLimit 处理失败 处理策略：
percentage ： 0.02 表示 失败比例不能超过 百分之2 ， 如果超过了比例那么整个任务失败停止，否则就当成功
record ：0 表示 失败次数的 0次
mysqlreader
hdfswriter
mysqlwriter
datax 并发与任务分片策略的配置以及使用
如果以上都看了一下的话，大概也知道 datax 是什么东西了，看起来datax的 设计思想还是比较容易理解的。
但是 如果设置 并发？
官方上面的配置 例子：
DataX调度流程：
举例来说，用户提交了一个DataX作业，并且配置了20个并发，目的是将一个100张分表的mysql数据同步到odps里面。 DataX的调度决策思路是：
DataXJob根据分库分表切分成了100个Task。
根据20个并发，DataX计算共需要分配4个TaskGroup。
4个TaskGroup平分切分好的100个Task，每一个TaskGroup负责以5个并发共计运行25个Task。
为什么 可以根据 并发数 就可以知道 多少个 taskGroup ?
因为每个 taskgroup 的并发执行任务数默认是 5
即 20/5 =4 所以就是 4个 任务组了 但是 在job.json 里面 的 setting 可以配置 speed 的 byte , channel , record 三种。
他们又是怎么配置？ 规则是怎样？ 这点官方文档上面似乎并没有提及
参考 https://xiaozhuanlan.com/topic/7860594132
提升每个channel的速度
在DataX内部对每个Channel会有严格的速度控制，分两种，一种是控制每秒同步的记录数，另外一种是每秒同步的字节数，默认的速度限制是1MB/s，可以根据具体硬件情况设置这个byte速度或者record速度，一般设置byte速度，比如：我们可以把单个Channel的速度上限配置为5MB
*优化2：提升DataX Job内Channel并发数 并发数=taskGroup的数量每一个TaskGroup并发执行的Task数 (默认单个任务组的并发数量为5)。
提升job内Channel并发有三种配置方式：
1.配置全局Byte限速以及单Channel Byte限速，Channel个数 = 全局Byte限速 / 单Channel Byte限速
2.配置全局Record限速以及单Channel Record限速，Channel个数 = 全局Record限速 / 单Channel Record限速
3. 直接配置Channel个数.上面的网友已经写得很明白了。
我的建议是 三种配置方式不要混着使用， 最后是 每次只 配置其中一种即可。
否则会容易出现 效果和配置的不一样的。
配置 反例 一起配置 byte 和 channel
{
"job": {
"content": [{
"reader": {
"name": "mysqlreader",
"parameter": {
"column": [
"id", "name"
],
"connection": [{
"jdbcUrl": ["jdbc:mysql://192.168.132.242:3306/newpearl_db_dev"],
"table": ["dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand"
,"dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand"
]
}],
"password": "3!spPY(7rK1p-3L",
"username": "dev"
}
},
"writer": {
"name": "streamwriter",
"parameter": {
"print": true,
"encoding": "UTF-8"
}
}
}],
"setting": {
"speed": {
"channel": "10",
"byte":10485760
}
}
}
}
以上 我假设 有 20 张 分表。 想 并发处理 10 ，而 现在 byte 大小
控制台执行：
15:56:35.222 [main] INFO com.alibaba.datax.core.Engine - DATAX.HOME:F:\oumin\buildSoft\data\datax\datax
15:56:36.038 [main] INFO c.a.datax.common.statistics.VMInfo - VMInfo# operatingSystem class => sun.management.OperatingSystemImpl
15:56:36.046 [main] INFO com.alibaba.datax.core.Engine - the machine info =>
osInfo: Oracle Corporation 1.8 25.73-b02
jvmInfo: Windows 10 amd64 10.0
cpu num: 8
totalPhysicalMemory: -0.00G
freePhysicalMemory: -0.00G
maxFileDescriptorCount: -1
currentOpenFileDescriptorCount: -1
GC Names [PS MarkSweep, PS Scavenge]
MEMORY_NAME | allocation_size | init_size
PS Eden Space | 2,685.00MB | 128.50MB
Code Cache | 240.00MB | 2.44MB
Compressed Class Space | 1,024.00MB | 0.00MB
PS Survivor Space | 21.00MB | 21.00MB
PS Old Gen | 5,455.00MB | 341.50MB
Metaspace | -0.00MB | 0.00MB
15:56:36.097 [main] INFO com.alibaba.datax.core.Engine -
{
"content":[
{
"reader":{
"name":"mysqlreader",
"parameter":{
"column":[
"id",
"name"
],
"connection":[
{
"jdbcUrl":[
"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev"
],
"table":[
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand",
"dw_om_brand"
]
}
],
"password":"***************",
"username":"dev"
}
},
"writer":{
"name":"streamwriter",
"parameter":{
"encoding":"UTF-8",
"print":true
}
}
}
],
"setting":{
"speed":{
"byte":10485760,
"channel":"10"
}
}
}
15:56:36.098 [main] DEBUG com.alibaba.datax.core.Engine - {"common":{"column":{"dateFormat":"yyyy-MM-dd","datetimeFormat":"yyyy-MM-dd HH:mm:ss","encoding":"utf-8","extraFormats":["yyyyMMdd"],"timeFormat":"HH:mm:ss","timeZone":"GMT+8"}},"core":{"container":{"job":{"id":0,"reportInterval":10000},"taskGroup":{"channel":5},"trace":{"enable":"false"}},"dataXServer":{"address":"http://localhost:7001/api","reportDataxLog":false,"reportPerfLog":false,"timeout":10000},"statistics":{"collector":{"plugin":{"maxDirtyNumber":10,"taskClass":"com.alibaba.datax.core.statistics.plugin.task.StdoutPluginCollector"}}},"transport":{"channel":{"byteCapacity":67108864,"capacity":512,"class":"com.alibaba.datax.core.transport.channel.memory.MemoryChannel","flowControlInterval":20,"speed":{"byte":-1,"record":-1}},"exchanger":{"bufferSize":32,"class":"com.alibaba.datax.core.plugin.BufferedRecordExchanger"}}},"entry":{"jvm":"-Xms1G -Xmx1G"},"job":{"content":[{"reader":{"name":"mysqlreader","parameter":{"column":["id","name"],"connection":[{"jdbcUrl":["jdbc:mysql://192.168.132.242:3306/newpearl_db_dev"],"table":["dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand"]}],"password":"3!spPY(7rK1p-3L","username":"dev"}},"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}}],"setting":{"speed":{"byte":10485760,"channel":"10"}}},"plugin":{"reader":{"mysqlreader":{"class":"com.alibaba.datax.plugin.reader.mysqlreader.MysqlReader","description":"useScene: prod. mechanism: Jdbc connection using the database, execute select sql, retrieve data from the ResultSet. warn: The more you know about the database, the less problems you encounter.","developer":"alibaba","name":"mysqlreader","path":"F:\\oumin\\buildSoft\\data\\datax\\datax\\plugin\\reader\\mysqlreader"}},"writer":{"streamwriter":{"class":"com.alibaba.datax.plugin.writer.streamwriter.StreamWriter","description":{"mechanism":"use datax framework to transport data to stream.","useScene":"only for developer test.","warn":"Never use it in your real job."},"developer":"alibaba","name":"streamwriter","path":"F:\\oumin\\buildSoft\\data\\datax\\datax\\plugin\\writer\\streamwriter"}}}}
15:56:36.211 [main] WARN com.alibaba.datax.core.Engine - prioriy set to 0, because NumberFormatException, the value is: null
15:56:36.214 [main] INFO c.a.d.common.statistics.PerfTrace - PerfTrace traceId=job_0, isEnable=false, priority=0
15:56:36.214 [main] INFO c.a.datax.core.job.JobContainer - DataX jobContainer starts job.
15:56:36.215 [main] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do preHandle ...
15:56:36.215 [main] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do init ...
15:56:36.846 [job-0] INFO c.a.d.p.r.r.u.OriginalConfPretreatmentUtil - Available jdbcUrl:jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true.
15:56:36.867 [job-0] INFO c.a.d.p.r.r.u.OriginalConfPretreatmentUtil - table:[dw_om_brand] has columns:[id,name,brand_code,brand_intro,brand_img,company_id,company_name,website,create_time,modify_time,removed,pc_domain,h5_domain,wx_pa_name,wx_pa_qrcode_img,wx_pa_app_id,wx_pa_app_secret,wx_pc_app_id,wx_pc_app_secret,wx_m_app_id,wx_m_app_secret,wx_mp_name,wx_mp_qrcode_img,wx_mp_app_id,wx_mp_app_secret,kk_app_id,kk_app_secret].
15:56:36.867 [job-0] DEBUG c.a.d.p.r.r.CommonRdbmsReader$Job - After job init(), job config now is:[
{"column":"id,name","columnList":["id","name"],"connection":[{"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","table":["dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand","dw_om_brand"]}],"fetchSize":-2147483648,"isTableMode":true,"password":"3!spPY(7rK1p-3L","tableNumber":20,"username":"dev"}
]
15:56:36.919 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do prepare ...
15:56:36.919 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Reader.Job [mysqlreader] do prepare work .
15:56:36.920 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Writer.Job [streamwriter] do prepare work .
15:56:36.920 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do split ...
15:56:36.921 [job-0] INFO c.a.datax.core.job.JobContainer - Job set Max-Byte-Speed to 10485760 bytes.
15:56:36.928 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Reader.Job [mysqlreader] splits to [20] tasks.
15:56:36.929 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Writer.Job [streamwriter] splits to [20] tasks.
15:56:36.929 [job-0] DEBUG c.a.datax.core.job.JobContainer - transformer configuration: null
15:56:36.964 [job-0] DEBUG c.a.datax.core.job.JobContainer - contentConfig configuration: [{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":0,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":1,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":2,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":3,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":4,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":5,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":6,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":7,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":8,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":9,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":10,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":11,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":12,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":13,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":14,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":15,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":16,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":17,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":18,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":19,"writer":{"name":"streamwriter","parameter":{"$ref":"$[0].internal.writer.parameter"}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.tableNumber","reader.parameter.table","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]}]
15:56:36.965 [job-0] INFO c.a.datax.core.job.JobContainer - jobContainer starts to do schedule ...
15:56:36.987 [job-0] INFO c.a.datax.core.job.JobContainer - Scheduler starts [1] taskGroups.
15:56:36.991 [job-0] INFO c.a.datax.core.job.JobContainer - Running by standalone Mode.
15:56:37.017 [taskGroup-0] DEBUG c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0]'s task configs[[{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":0,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":1,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":2,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":3,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":4,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":5,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":6,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":7,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":8,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":9,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":10,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":11,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":12,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":13,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":14,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":15,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":16,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":17,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":18,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]},{"internal":{"reader":{"name":"mysqlreader","parameter":{"column":"id,name","columnList":["id","name"],"fetchSize":-2147483648,"isTableMode":true,"jdbcUrl":"jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true","loadBalanceResourceMark":"192.168.132.242","password":"3!spPY(7rK1p-3L","querySql":"select id,name from dw_om_brand ","table":"dw_om_brand","tableNumber":20,"username":"dev"}},"taskId":19,"writer":{"name":"streamwriter","parameter":{"encoding":"UTF-8","print":true}}},"keys":["writer.parameter.print","reader.parameter.columnList[1]","reader.parameter.columnList[0]","reader.parameter.column","writer.parameter.encoding","reader.parameter.fetchSize","reader.parameter.jdbcUrl","reader.parameter.password","writer.name","reader.parameter.querySql","reader.parameter.loadBalanceResourceMark","reader.parameter.table","reader.parameter.tableNumber","reader.name","reader.parameter.isTableMode","reader.parameter.username","taskId"],"secretKeyPathSet":[]}]]
15:56:37.017 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroupId=[0] start [1] channels for [20] tasks.
15:56:37.033 [job-0] DEBUG c.a.d.c.j.s.AbstractScheduler - com.alibaba.datax.core.statistics.communication.Communication@2f7c2f4f[
counter={}
state=RUNNING
throwable=<null>
timestamp=1575532597013
message={}
]
15:56:37.072 [taskGroup-0] INFO c.a.d.core.transport.channel.Channel - Channel set byte_speed_limit to -1, No bps activated.
15:56:37.072 [taskGroup-0] INFO c.a.d.core.transport.channel.Channel - Channel set record_speed_limit to -1, No tps activated.
15:56:37.085 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[0] attemptCount[1] is started
15:56:37.085 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.085 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.086 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.086 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.111 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.111 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.111 [0-0-0-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.143 [0-0-0-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.145 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:37.145 [0-0-0-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.146 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.146 [0-0-0-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.185 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[0] is successed, used[102]ms
15:56:37.186 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[1] attemptCount[1] is started
15:56:37.186 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.186 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.186 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.186 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.186 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.186 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.186 [0-0-1-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.216 [0-0-1-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.218 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.219 [0-0-1-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.219 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.219 [0-0-1-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.286 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[1] is successed, used[101]ms
15:56:37.287 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[2] attemptCount[1] is started
15:56:37.287 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.287 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.287 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.287 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.287 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.287 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.287 [0-0-2-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.309 [0-0-2-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.312 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:37.312 [0-0-2-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.312 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.312 [0-0-2-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.387 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[2] is successed, used[100]ms
15:56:37.388 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[3] attemptCount[1] is started
15:56:37.388 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.388 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.388 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.388 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.388 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.388 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.388 [0-0-3-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.409 [0-0-3-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.412 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.412 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.412 [0-0-3-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.412 [0-0-3-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.488 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[3] is successed, used[100]ms
15:56:37.489 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[4] attemptCount[1] is started
15:56:37.489 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.489 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.489 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.489 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.489 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.489 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.489 [0-0-4-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.511 [0-0-4-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.513 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:37.514 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.514 [0-0-4-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.514 [0-0-4-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.589 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[4] is successed, used[100]ms
15:56:37.590 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[5] attemptCount[1] is started
15:56:37.590 [0-0-5-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.590 [0-0-5-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.590 [0-0-5-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.590 [0-0-5-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.590 [0-0-5-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.590 [0-0-5-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.590 [0-0-5-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.614 [0-0-5-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.616 [0-0-5-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.616 [0-0-5-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.616 [0-0-5-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.616 [0-0-5-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.690 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[5] is successed, used[100]ms
15:56:37.691 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[6] attemptCount[1] is started
15:56:37.691 [0-0-6-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.691 [0-0-6-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.691 [0-0-6-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.691 [0-0-6-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.691 [0-0-6-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.691 [0-0-6-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.691 [0-0-6-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.704 [0-0-6-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.706 [0-0-6-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:37.706 [0-0-6-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.706 [0-0-6-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.706 [0-0-6-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.791 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[6] is successed, used[100]ms
15:56:37.792 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[7] attemptCount[1] is started
15:56:37.792 [0-0-7-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.792 [0-0-7-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.792 [0-0-7-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.792 [0-0-7-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.792 [0-0-7-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.792 [0-0-7-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.792 [0-0-7-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.806 [0-0-7-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.807 [0-0-7-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:37.807 [0-0-7-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.808 [0-0-7-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.808 [0-0-7-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.892 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[7] is successed, used[100]ms
15:56:37.893 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[8] attemptCount[1] is started
15:56:37.893 [0-0-8-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.893 [0-0-8-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.893 [0-0-8-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.893 [0-0-8-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.893 [0-0-8-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.893 [0-0-8-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.893 [0-0-8-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.925 [0-0-8-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:37.927 [0-0-8-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:37.927 [0-0-8-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:37.927 [0-0-8-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:37.927 [0-0-8-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:37.993 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[8] is successed, used[100]ms
15:56:37.994 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[9] attemptCount[1] is started
15:56:37.994 [0-0-9-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:37.994 [0-0-9-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:37.994 [0-0-9-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:37.994 [0-0-9-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:37.994 [0-0-9-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:37.994 [0-0-9-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:37.995 [0-0-9-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.006 [0-0-9-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.007 [0-0-9-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.008 [0-0-9-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.008 [0-0-9-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.008 [0-0-9-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.094 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[9] is successed, used[100]ms
15:56:38.095 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[10] attemptCount[1] is started
15:56:38.095 [0-0-10-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.095 [0-0-10-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.095 [0-0-10-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.095 [0-0-10-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.095 [0-0-10-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.095 [0-0-10-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.095 [0-0-10-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.121 [0-0-10-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.123 [0-0-10-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.123 [0-0-10-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.123 [0-0-10-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.123 [0-0-10-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.195 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[10] is successed, used[100]ms
15:56:38.196 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[11] attemptCount[1] is started
15:56:38.196 [0-0-11-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.196 [0-0-11-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.196 [0-0-11-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.196 [0-0-11-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.196 [0-0-11-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.196 [0-0-11-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.196 [0-0-11-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.215 [0-0-11-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.217 [0-0-11-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:38.217 [0-0-11-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.217 [0-0-11-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.217 [0-0-11-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.296 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[11] is successed, used[100]ms
15:56:38.297 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[12] attemptCount[1] is started
15:56:38.297 [0-0-12-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.297 [0-0-12-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.304 [0-0-12-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.304 [0-0-12-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.304 [0-0-12-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.305 [0-0-12-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.305 [0-0-12-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.315 [0-0-12-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.316 [0-0-12-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.316 [0-0-12-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.316 [0-0-12-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.316 [0-0-12-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.404 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[12] is successed, used[107]ms
15:56:38.405 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[13] attemptCount[1] is started
15:56:38.405 [0-0-13-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.405 [0-0-13-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.405 [0-0-13-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.405 [0-0-13-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.405 [0-0-13-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.405 [0-0-13-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.405 [0-0-13-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.428 [0-0-13-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.430 [0-0-13-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.430 [0-0-13-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.430 [0-0-13-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.430 [0-0-13-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.505 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[13] is successed, used[100]ms
15:56:38.506 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[14] attemptCount[1] is started
15:56:38.506 [0-0-14-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.506 [0-0-14-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.506 [0-0-14-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.506 [0-0-14-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.506 [0-0-14-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.506 [0-0-14-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.506 [0-0-14-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.539 [0-0-14-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.541 [0-0-14-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.541 [0-0-14-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.541 [0-0-14-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.541 [0-0-14-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.606 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[14] is successed, used[100]ms
15:56:38.607 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[15] attemptCount[1] is started
15:56:38.607 [0-0-15-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.607 [0-0-15-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.607 [0-0-15-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.607 [0-0-15-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.607 [0-0-15-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.607 [0-0-15-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.608 [0-0-15-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.629 [0-0-15-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.631 [0-0-15-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:38.631 [0-0-15-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.631 [0-0-15-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.631 [0-0-15-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.707 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[15] is successed, used[100]ms
15:56:38.708 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[16] attemptCount[1] is started
15:56:38.708 [0-0-16-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.708 [0-0-16-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.708 [0-0-16-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.708 [0-0-16-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.708 [0-0-16-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.708 [0-0-16-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.708 [0-0-16-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.730 [0-0-16-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.732 [0-0-16-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.732 [0-0-16-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.732 [0-0-16-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.732 [0-0-16-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.808 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[16] is successed, used[101]ms
15:56:38.809 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[17] attemptCount[1] is started
15:56:38.809 [0-0-17-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.809 [0-0-17-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.809 [0-0-17-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.809 [0-0-17-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.809 [0-0-17-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.809 [0-0-17-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.809 [0-0-17-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.830 [0-0-17-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.832 [0-0-17-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.833 [0-0-17-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.833 [0-0-17-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.833 [0-0-17-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:38.909 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[17] is successed, used[101]ms
15:56:38.910 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[18] attemptCount[1] is started
15:56:38.910 [0-0-18-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:38.911 [0-0-18-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:38.911 [0-0-18-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:38.911 [0-0-18-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:38.911 [0-0-18-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:38.911 [0-0-18-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:38.911 [0-0-18-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.925 [0-0-18-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:38.926 [0-0-18-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:38.926 [0-0-18-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:38.926 [0-0-18-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:38.926 [0-0-18-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:39.010 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[18] is successed, used[100]ms
15:56:39.011 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[19] attemptCount[1] is started
15:56:39.011 [0-0-19-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do init ...
15:56:39.011 [0-0-19-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do init ...
15:56:39.011 [0-0-19-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do prepare ...
15:56:39.011 [0-0-19-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do prepare ...
15:56:39.011 [0-0-19-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to read ...
15:56:39.011 [0-0-19-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to write ...
15:56:39.011 [0-0-19-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Begin to read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
15:56:39.034 [0-0-19-reader] INFO c.a.d.p.r.r.CommonRdbmsReader$Task - Finished read record by Sql: [select id,name from dw_om_brand
] jdbcUrl:[jdbc:mysql://192.168.132.242:3306/newpearl_db_dev?yearIsDateType=false&zeroDateTimeBehavior=convertToNull&tinyInt1isBit=false&rewriteBatchedStatements=true].
1 冠珠陶瓷
2 萨米特陶瓷
3 金朝阳陶瓷
4 蒙地卡罗陶瓷
7 格莱斯瓷砖
8 惠万家陶瓷
9 路易摩登陶瓷
10 新明珠酒业
11 爱窝荟
12 酒业商城
13 新明珠陶瓷
15:56:39.039 [0-0-19-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do post ...
15:56:39.039 [0-0-19-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do post ...
15:56:39.039 [0-0-19-reader] DEBUG c.a.d.c.t.runner.ReaderRunner - task reader starts to do destroy ...
15:56:39.039 [0-0-19-writer] DEBUG c.a.d.c.t.runner.WriterRunner - task writer starts to do destroy ...
15:56:39.112 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] taskId[19] is successed, used[101]ms
15:56:39.112 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroup[0] completed it's tasks.
15:56:47.062 [job-0] DEBUG c.a.d.c.j.s.AbstractScheduler - com.alibaba.datax.core.statistics.communication.Communication@7880cdf3[
counter={writeSucceedRecords=240, readSucceedRecords=220, totalErrorBytes=0, writeSucceedBytes=1360, byteSpeed=0, totalErrorRecords=0, recordSpeed=0, waitReaderTime=27518593, writeReceivedBytes=1360, stage=20, waitWriterTime=632890, percentage=1.0, totalReadRecords=220, writeReceivedRecords=240, readSucceedBytes=1360, totalReadBytes=1360}
state=SUCCEEDED
throwable=<null>
timestamp=1575532607062
message={}
]
15:56:47.064 [job-0] INFO c.a.d.c.s.c.c.j.StandAloneJobContainerCommunicator - Total 220 records, 1360 bytes | Speed 136B/s, 22 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.001s | All Task WaitReaderTime 0.028s | Percentage 100.00%
15:56:47.064 [job-0] INFO c.a.d.c.j.s.AbstractScheduler - Scheduler accomplished all tasks.
15:56:47.064 [job-0] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do post ...
15:56:47.064 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Writer.Job [streamwriter] do post work.
15:56:47.064 [job-0] INFO c.a.datax.core.job.JobContainer - DataX Reader.Job [mysqlreader] do post work.
15:56:47.064 [job-0] DEBUG c.a.datax.core.job.JobContainer - jobContainer starts to do postHandle ...
15:56:47.064 [job-0] INFO c.a.datax.core.job.JobContainer - DataX jobId [0] completed successfully.
15:56:47.065 [job-0] INFO c.a.d.c.container.util.HookInvoker - No hook invoked, because base dir not exists or is a file: F:\oumin\buildSoft\data\datax\datax\hook
15:56:47.066 [job-0] INFO c.a.datax.core.job.JobContainer -
[total cpu info] =>
averageCpu | maxDeltaCpu | minDeltaCpu
-1.00% | -1.00% | -1.00%
[total gc info] =>
NAME | totalGCCount | maxDeltaGCCount | minDeltaGCCount | totalGCTime | maxDeltaGCTime | minDeltaGCTime
PS MarkSweep | 0 | 0 | 0 | 0.000s | 0.000s | 0.000s
PS Scavenge | 1 | 1 | 1 | 0.006s | 0.006s | 0.006s
15:56:47.066 [job-0] INFO c.a.datax.core.job.JobContainer - PerfTrace not enable!
15:56:47.066 [job-0] INFO c.a.d.c.s.c.c.j.StandAloneJobContainerCommunicator - Total 220 records, 1360 bytes | Speed 136B/s, 22 records/s | Error 0 records, 0 bytes | All Task WaitWriterTime 0.001s | All Task WaitReaderTime 0.028s | Percentage 100.00%
15:56:47.067 [job-0] INFO c.a.datax.core.job.JobContainer -
任务启动时刻 : 2019-12-05 15:56:36
任务结束时刻 : 2019-12-05 15:56:47
任务总计耗时 : 10s
任务平均流量 : 136B/s
记录写入速度 : 22rec/s
读出记录总数 : 220
读写失败总数 : 0
通过 打印信息 这里
15:56:37.017 [taskGroup-0] INFO c.a.d.c.taskgroup.TaskGroupContainer - taskGroupId=[0] start [1] channels for [20] tasks.
可以看到 并没有 和我想得一样 有 2个 taskGroup （正常应该： 20/5=2 ） 这里 只是 1个 任务组，而且 channel 也是 1
也就是 并没有 并发 读取 20张表，而是一张表 串行去读取了。
这里 因为配置了byte ，而且byte 很大， 因此忽略了 channl 配置了。
如果 去掉 byte 配置， 就 会发现 会按预期 进行 执行了。而且 两个 taskGroup , 每个 taskGroup 并发数是 5
来源：oschina
链接：https://my.oschina.net/ouminzy/blog/3137634