记一次 MySQL主从复制 从库主键冲突 导致从库中继日志持续增大

问题描述

同事反馈 MySQL主从复制主键冲突 ， 导致从库大量relay中继日志  持续增长  导空间不足

查看从库复制状态

master

10.23.234.140
mysql> show master status\G;
*************************** 1. row ***************************
             File: mysql-bin.000489
         Position: 903623288
     Binlog_Do_DB: 
 Binlog_Ignore_DB: mysql,information_schema,performation_schema,sys
Executed_Gtid_Set: 
1 row in set (0.02 sec)

ERROR: 
No query specified


slave
10.23.234.141
mysql> show slave status\G
*************************** 1. row ***************************
               Slave_IO_State: Waiting for master to send event
                  Master_Host: 10.23.234.140
                  Master_User: repl
                  Master_Port: 3306
                Connect_Retry: 60
              Master_Log_File: mysql-bin.000489
          Read_Master_Log_Pos: 901597779
               Relay_Log_File: dazjjkap002l-relay-bin.001300
                Relay_Log_Pos: 20368
        Relay_Master_Log_File: mysql-bin.000434
             Slave_IO_Running: Yes
            Slave_SQL_Running: No
              Replicate_Do_DB: 
          Replicate_Ignore_DB: 
           Replicate_Do_Table: 
       Replicate_Ignore_Table: 
      Replicate_Wild_Do_Table: 
  Replicate_Wild_Ignore_Table: 
                   Last_Errno: 1062
                   Last_Error: Could not execute Write_rows event on table zabbix.trends_uint; Duplicate entry '116720-1577656800' for key 'PRIMARY', Error_code: 1062; handler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.000434, end_log_pos 921050053
                 Skip_Counter: 0
          Exec_Master_Log_Pos: 921049777
              Relay_Log_Space: 59258018270
              Until_Condition: None
               Until_Log_File: 
                Until_Log_Pos: 0
           Master_SSL_Allowed: No
           Master_SSL_CA_File: 
           Master_SSL_CA_Path: 
              Master_SSL_Cert: 
            Master_SSL_Cipher: 
               Master_SSL_Key: 
        Seconds_Behind_Master: NULL
Master_SSL_Verify_Server_Cert: No
                Last_IO_Errno: 0
                Last_IO_Error: 
               Last_SQL_Errno: 1062
               Last_SQL_Error: Could not execute Write_rows event on table zabbix.trends_uint; Duplicate entry '116720-1577656800' for key 'PRIMARY', Error_code: 1062; handler error HA_ERR_FOUND_DUPP_KEY; the event's master log mysql-bin.000434, end_log_pos 921050053
  Replicate_Ignore_Server_Ids: 
             Master_Server_Id: 140
                  Master_UUID: 732ed5a8-713d-11e9-853c-005056ad4fcf
             Master_Info_File: /var/lib/mysql/master.info
                    SQL_Delay: 0
          SQL_Remaining_Delay: NULL
      Slave_SQL_Running_State: 
           Master_Retry_Count: 86400
                  Master_Bind: 
      Last_IO_Error_Timestamp: 
     Last_SQL_Error_Timestamp: 200119 10:47:40
               Master_SSL_Crl: 
           Master_SSL_Crlpath: 
           Retrieved_Gtid_Set: 
            Executed_Gtid_Set: 
                Auto_Position: 0
         Replicate_Rewrite_DB: 
                 Channel_Name: 
           Master_TLS_Version: 
1 row in set (0.00 sec)

mysql> 

问题定位从库主键冲突 导致从库的SQL线程停止，但是IO线程正常，从主库上复制过来的SQL没有及时在从库还原，导致越来越占磁盘！！！

从库增加2个参数

slave-skip-errors = 1062
binlog_format=mixed

重启slave上的数据库，SQL线程和IO线程恢复YES

参考

https://blog.csdn.net/wanglei_storage/article/details/51733168

https://blog.csdn.net/taijianyu/article/details/5452316

来源：oschina

链接：https://my.oschina.net/kcw/blog/3161075