mysql主从error29_Coordinator stopped because there were error(s) in the worker(s) mysql主从失败问题...
1.主从不同步，查看主从状态显示
mysql> show slave status \G
*************************** 1. row ***************************
Slave_IO_State: Waiting for master to send event
Master_Host: xx.xx.xx.xx
Master_User: slave
Master_Port: 3306
Connect_Retry: 60
Master_Log_File: mysql-bin.000023
Read_Master_Log_Pos: 766919772
Relay_Log_File: relay-bin.000002
Relay_Log_Pos: 320
Relay_Master_Log_File: mysql-bin.000023
Slave_IO_Running: Yes
Slave_SQL_Running: No
Replicate_Do_DB:
Replicate_Ignore_DB:
Replicate_Do_Table:
Replicate_Ignore_Table:
Replicate_Wild_Do_Table:
Replicate_Wild_Ignore_Table:
Last_Errno: 1032
Last_Error: Coordinator stopped because there were error(s) in the worker(s). The most recent failure being: Worker 1 failed executing transaction '0eb171ef-86ba-11ea-87b8-6c0b849b4343:2942675' at master log mysql-bin.000023, end_log_pos 766429911. See error log and/or performance_schema.replication_applier_status_by_worker table for more details about this failure or others, if any.
Skip_Counter: 0
2.根据上面报错中提示查看performance_schema.replication_applier_status_by_worker表中详细信息。
select * from performance_schema.replication_applier_status_by_worker\G
*************************** 1. row ***************************
CHANNEL_NAME:
WORKER_ID: 1
THREAD_ID: NULL
SERVICE_STATE: OFF
LAST_SEEN_TRANSACTION: 0eb171ef-86ba-11ea-87b8-6c0b849b4343:2942675
LAST_ERROR_NUMBER: 1032
LAST_ERROR_MESSAGE: Worker 1 failed executing transaction '0eb171ef-86ba-11ea-87b8-6c0b849b4343:2942675' at master log mysql-bin.000023, end_log_pos 766429911; Could not execute Update_rows event on table aischedule.execution_flows; Can't find record in 'execution_flows', Error_code: 1032; handler error HA_ERR_KEY_NOT_FOUND; the event's master log mysql-bin.000023, end_log_pos 766429911
LAST_ERROR_TIMESTAMP: 2020-06-02 12:42:01
3.检查发现是不能更新aischedule.execution_flows表中的数据。去主库根据binlog定位数据库操作记录。
mysqlbinlog --no-defaults -v -v --base64-output=decode-rows /data/logs/mysql-bin.000023 | grep -A 20 '766429911'
#200602 12:37:22 server id 65 end_log_pos 766429911 CRC32 0x95a2abf1 Update_rows: table id 111 flags: STMT_END_F
### UPDATE `aischedule`.`execution_flows`
### WHERE
### @1=291046 /* INT meta=0 nullable=0 is_null=0 */
### @2=16 /* INT meta=0 nullable=0 is_null=0 */
### @3=1 /* INT meta=0 nullable=0 is_null=0 */
### @4='basic' /* VARSTRING(512) meta=512 nullable=0 is_null=0 */
### @5=20 /* TINYINT meta=0 nullable=1 is_null=0 */
### @6='root' /* VARSTRING(256) meta=256 nullable=1 is_null=0 */
### @7=1591072582036 /* LONGINT meta=0 nullable=1 is_null=0 */
### @8=-1 (18446744073709551615) /* LONGINT meta=0 nullable=1 is_null=0 */
### @9=-1 (18446744073709551615) /* LONGINT meta=0 nullable=1 is_null=0 */
### @10=-1 (18446744073709551615) /* LONGINT meta=0 nullable=1 is_null=0 */
### @11=2 /* TINYINT meta=0 nullable=1 is_null=0 */
### @12='\x1f8\x00\x00\x00\x00\x00\x00\x0010D\x1c\x0dP*b9X\x10>($}b�=7H\x0a\x27\x19x180d\x0912O\x1612ߒb=A\x0e\x02)lA1517 089\x11i\x0dҖ,x19\x15\x06N\x05ccx0bZsv\x1a\x120c\x08ㆮ\x05x1305x5c@H\x03x11\x06\x19u�\x0bbvD1b$?\x108Ca302j\x07x0b{̒^\x5ce=ϱ1d\x100eliy%jxJ"06f\x15x097x11\x11*Īd\x09x1chS:;.8K9ڻ@nc>?\x0fˮxl8\x09rT2r$x039<2x0ex1eI4\x1f&\x17v\x04\x00\x00' /* LONGBLOB/LONGTEXT meta=4 nullable=1 is_null=0 */
### @13=2 /* INT meta=0 nullable=1 is_null=0 */
### @14=NULL /* INT meta=0 nullable=1 is_null=1 */
### @15=5 /* TINYINT meta=0 nullable=0 is_null=0 */
### SET
### @1=291046 /* INT meta=0 nullable=0 is_null=0 */
### @2=16 /* INT meta=0 nullable=0 is_null=0 */
4.根据@1=291046，在从库中发现没有这条记录。