The Ultimate Guide to High Availability with MariaDB
This is a read-only copy of the MariaDB Knowledgebase generated on 2024-11-16. For the latest, interactive version please visit https://mariadb.com/kb/.

Galera errors in mysqld.log but works OK

I have a 3 node Galera cluster that I am testing. It generally works OK, and I have been doing various failure / recovery tests as part of a certification project. I continuously get 3 error messages even though it is working OK. I'd like to eliminate any unnecessary error messages so that DBAs would not taking time to resolve this in a production situation. Here is a sampling of the three errors: I included a bit before and after the error for context:

2016-04-06 11:01:22 140287919777536 [Note] WSREP: Quorum results:
        version    = 3,
        component  = PRIMARY,
        conf_id    = 26,
        members    = 3/3 (joined/total),
        act_id     = 8017357,
        last_appl. = 0,
        protocols  = 0/7/3 (gcs/repl/appl),
        group UUID = db762c6b-e246-11e5-90df-4adee5e6b24e
2016-04-06 11:01:22 140287919777536 [Note] WSREP: Flow-control interval: [28, 28]
2016-04-06 11:01:22 140290187433728 [Note] WSREP: New cluster view: global state: db762c6b-e246-11e5-90df-4adee5e6b24e:8017357, view# 27: Primary, number of nodes: 3, my index: 2, protocol version 3
ERROR 1045 (28000): Access denied for user 'root'@'localhost' (using password: YES)
2016-04-06 11:01:22 140290187433728 [ERROR] WSREP: Process completed with error: /opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306: 1 (Operation not permitted)
2016-04-06 11:01:22 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06 11:01:22 140290187433728 [Note] WSREP: REPL Protocols: 7 (3, 2)
2016-04-06 11:01:22 140287985837824 [Note] WSREP: Service thread queue flushed.
2016-04-06 11:01:22 140290187433728 [Note] WSREP: Assign initial position for certification: 8017357, protocol version: 3
2016-04-06 11:01:22 140287985837824 [Note] WSREP: Service thread queue flushed.
2016-04-06 16:18:22 140287930267392 [Note] WSREP: (8180e0ba, 'tcp://0.0.0.0:4567') turning message relay requesting on, nonlive peers: tcp://10.242.60.235:4567

I grepped for just one of the errors so you can get an idea of the frequency:

2016-04-06  1:58:15 140290151147264 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 1 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06  2:15:49 140290151147264 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06  2:15:49 140290151147264 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Donor"
2016-04-06  3:40:41 140287908230912 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced"
2016-04-06  9:28:48 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 1 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06  9:29:00 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06 10:05:09 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 1 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06 10:07:34 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06 11:01:10 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 1 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
2016-04-06 11:01:22 140290187433728 [ERROR] WSREP: Notification command failed: 1 (Operation not permitted): "/opt/app/mysql/product/mariadb-10.1.12-linux-x86_64/support-files/wsrep_notify --status Synced --uuid db762c6b-e246-11e5-90df-4adee5e6b24e --primary yes --index 2 --members 06e16ae0-fb9b-11e5-8ae2-76e1f955bae1/zlx70604.vci.att.com/130.9.221.48:3306,7971bcf3-fb9d-11e5-a402-96244ac79f12/zlxv8400.vci.att.com/10.242.60.235:3306,8180e0ba-fb2b-11e5-8251-a3c484f45bc7/zlx70605.vci.att.com/130.9.221.46:3306"
mysql@zlx70605 /opt/app/mysql

Answer Answered by Aditya Anchuri in this comment.

Hi, what user are you running the mysqld process as? Looks like your wsrep_notify script is not executable by that user. Please refer to: http://galeracluster.com/documentation-webpages/notificationcmd.html

Content reproduced on this site is the property of its respective owners, and this content is not reviewed in advance by MariaDB. The views, information and opinions expressed by this content do not necessarily represent those of MariaDB or any other party.