Uploaded image for project: 'Percona XtraDB Cluster'
  1. Percona XtraDB Cluster
  2. PXC-2681

PXC 8.0 Did not receive expected file from donor: 'wsrep_state.dat'

Details

    • Bug
    • Status: Done
    • Medium
    • Resolution: Cannot Reproduce
    • None
    • None
    • None
    • None
    • Centos 7.6

    Description

      I am currently doing a test for the PXC 8.0.15 release. I tried to create a 3-node cluster but essentially trying to bootstrap one node and followed by another node. However, when I have already a bootstrap node, my 2nd node cannot join to create a cluster. Hence, got this weird error:

       

      2019-10-21T06:01:09.834851Z 0 [Warning] [MY-010084] [Server] options --log-slow-admin-statements, --log-queries-not-using-indexes and --log-slow-slave-statements have no effect if --slow-query-log is not set
      2019-10-21T06:01:09.835434Z 0 [System] [MY-010116] [Server] /opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/bin/mysqld (mysqld 8.0.15-5-27dev.4.2) starting as process 6238
      2019-10-21T06:01:09.865507Z 0 [Warning] [MY-000000] [Galera] Fail to access the file (/var/lib/mysql//gvwstate.dat) error (No such file or directory). It is possible if node is booting for first time or re-booting after a graceful shutdown
      2019-10-21T06:01:09.873774Z 0 [Warning] [MY-000000] [Galera] (2dc8d23c, 'tcp://0.0.0.0:4567') address 'tcp://192.168.10.110:4567' points to own listening address, blacklisting
      2019-10-21T06:01:15.033833Z 0 [ERROR] [MY-000000] [WSREP-SST] ******************* FATAL ERROR **********************
      2019-10-21T06:01:15.034909Z 0 [ERROR] [MY-000000] [WSREP-SST] Did not receive expected file from donor: 'wsrep_state.dat'
      2019-10-21T06:01:15.035232Z 0 [ERROR] [MY-000000] [WSREP-SST] Line 2072
      2019-10-21T06:01:15.036142Z 0 [ERROR] [MY-000000] [WSREP-SST] ******************************************************
      2019-10-21T06:01:15.036672Z 0 [ERROR] [MY-000000] [WSREP-SST] Cleanup after exit with status:32
      2019-10-21T06:01:15.053608Z 0 [Warning] [MY-000000] [Galera] 1.0 (192.168.10.120): State transfer to 0.0 (192.168.10.110) failed: -32 (Broken pipe)
      2019-10-21T06:01:15.053683Z 0 [ERROR] [MY-000000] [Galera] gcs/src/gcs_group.cpp:gcs_group_handle_join_msg():1129: Will never receive state. Need to abort.
      2019-10-21T06:01:15.167480Z 0 [ERROR] [MY-000000] [WSREP] Process completed with error: wsrep_sst_xtrabackup-v2 --role 'joiner' --address '192.168.10.110' --datadir '/var/lib/mysql/' --basedir '/opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/' --plugindir '/opt/Percona-XtraDB-Cluster_8.0.15.5-27dev.4.2_Linux.x86_64.ssl102/lib/mysql/plugin/' --defaults-file '/etc/my.cnf' --defaults-group-suffix '' --parent '6238' --mysqld-version '8.0.15-5-27dev.4.2' '' : 32 (Broken pipe)
      2019-10-21T06:01:15.167615Z 0 [ERROR] [MY-000000] [WSREP] Failed to read uuid:seqno from joiner script.
      2019-10-21T06:01:15.167663Z 0 [ERROR] [MY-000000] [WSREP] SST script aborted with error 32 (Broken pipe)
      2019-10-21T06:01:15.168308Z 3 [ERROR] [MY-000000] [Galera] Application received wrong state:
      {{ Received: 00000000-0000-0000-0000-000000000000}}
      {{ Required: 43801daf-f3c3-11e9-b8d8-9e6c8e624001}}
      2019-10-21T06:01:15.168383Z 3 [ERROR] [MY-000000] [Galera] Application state transfer failed. This is unrecoverable condition, restart required.

       

      The problem is that, it doesn't tell or provide any hint of what problem causing the broken pipe. PATH shows that I have correctly set up and even running wsrep_sst_xtrabackup-v2 does not show any problem. 

       

       

       

      Attachments

        1. donor.log
          2 kB
          Paul Namuag
        2. joiner.log
          20 kB
          Paul Namuag

        Activity

          People

            Unassigned Unassigned
            standardkeyboard Paul Namuag
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - Not Specified
                Not Specified
                Logged:
                Time Spent - 20 minutes
                20m

                Smart Checklist