SST failing, foreign key issue?
Hello! Last night one node in a two node cluster left for some reason. Not sure why, but when trying to rejoin the cluster I get these errors:
``` Aug 29 14:48:00 localhost mysqld[17831]: 2019-08-29 14:48:00 1 [ERROR] InnoDB: Table `thedatabase`.`websites` contains unrecognizable instant ALTER metadata Aug 29 14:48:00 localhost mysqld[17831]: 2019-08-29 14:48:00 1 [ERROR] Slave SQL: Could not execute Write_rows_v1 event on table thedatabase.analytics; Cannot add or update a child row: a foreign key constraint fails (`thedatabase`.`analytics`, CONSTRAINT `analytics_website_uuid_foreign` FOREIGN KEY (`website_uuid`) REFERENCES `websites` (`uuid`) ON DELETE CASCADE), Error_code: 1452; handler error HA_ERR_NO_REFERENCED_ROW; the event's master log FIRST, end_log_pos 1765, Internal MariaDB error code: 1452 Aug 29 14:48:00 localhost mysqld[17831]: 2019-08-29 14:48:00 1 [Warning] WSREP: Event 3 Write_rows_v1 apply failed: 151, seqno 976491 ```
That looks like a foreign key issue. Sure enough, there were a few orphaned rows in the offending table. I deleted them and checked the other tables for similar issues, everything looked good so I attempted to tell the offline server to rejoin. No dice, same exact error.
Any tips on resolving this?