Details
-
Bug
-
Status: Done
-
Medium
-
Resolution: Cannot Reproduce
-
None
-
None
-
None
-
None
-
Centos 7.6
Description
I am currently doing a test for the PXC 8.0.15 release. I tried to create a 3-node cluster but essentially trying to bootstrap one node and followed by another node. However, when I have already a bootstrap node, my 2nd node cannot join to create a cluster. Hence, got this weird error:
2019-10-21T06:01:09.834851Z 0 [Warning] [MY-010084] [Server] options --log-slow-admin-statements, --log-queries-not-using-indexes and --log-slow-slave-statements have no effect if --slow-query-log is not set
2019-10-21T06:01:09.835434Z 0 [System] [MY-010116] [Server] /opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/bin/mysqld (mysqld 8.0.15-5-27dev.4.2) starting as process 6238
2019-10-21T06:01:09.865507Z 0 [Warning] [MY-000000] [Galera] Fail to access the file (/var/lib/mysql//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
2019-10-21T06:01:09.873774Z 0 [Warning] [MY-000000] [Galera] (2dc8d23c, 'tcp://0.0.0.0:4567') address 'tcp://192.168.10.110:4567' points to own listening address, blacklisting
2019-10-21T06:01:15.033833Z 0 [ERROR] [MY-000000] [WSREP-SST] ******************* FATAL ERROR **********************
2019-10-21T06:01:15.034909Z 0 [ERROR] [MY-000000] [WSREP-SST] Did not receive expected file from donor: 'wsrep_state.dat'
2019-10-21T06:01:15.035232Z 0 [ERROR] [MY-000000] [WSREP-SST] Line 2072
2019-10-21T06:01:15.036142Z 0 [ERROR] [MY-000000] [WSREP-SST] ******************************************************
2019-10-21T06:01:15.036672Z 0 [ERROR] [MY-000000] [WSREP-SST] Cleanup after exit with status:32
2019-10-21T06:01:15.053608Z 0 [Warning] [MY-000000] [Galera] 1.0 (192.168.10.120): State transfer to 0.0 (192.168.10.110) failed: -32 (Broken pipe)
2019-10-21T06:01:15.053683Z 0 [ERROR] [MY-000000] [Galera] gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1129: Will never receive state. Need to abort.
2019-10-21T06:01:15.167480Z 0 [ERROR] [MY-000000] [WSREP] Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '192.168.10.110' --datadir '/var/lib/mysql/' --basedir '/opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/' --plugindir '/opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/lib/mysql/plugin/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '6238' --mysqld-version '8.0.15-5-27dev.4.2' '' : 32 (Broken pipe)
2019-10-21T06:01:15.167615Z 0 [ERROR] [MY-000000] [WSREP] Failed to read uuid:seqno from joiner script.
2019-10-21T06:01:15.167663Z 0 [ERROR] [MY-000000] [WSREP] SST script aborted with error 32 (Broken pipe)
2019-10-21T06:01:15.168308Z 3 [ERROR] [MY-000000] [Galera] Application received wrong state:
{{ Received: 00000000-0000-0000-0000-000000000000}}
{{ Required: 43801daf-f3c3-11e9-b8d8-9e6c8e624001}}
2019-10-21T06:01:15.168383Z 3 [ERROR] [MY-000000] [Galera] Application state transfer failed. This is unrecoverable condition, restart required.
The problem is that, it doesn't tell or provide any hint of what problem causing the broken pipe. PATH shows that I have correctly set up and even running wsrep_sst_xtrabackup-v2 does not show any problem.