Uploaded image for project: 'Percona XtraDB Cluster'
  1. Percona XtraDB Cluster
  2. PXC-917

PXC joiner node stuck in "State transfer in progress, setting sleep higher"

    XMLWordPrintable

    Details

    • Type: New Feature
    • Status: Done
    • Priority: Medium
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      PXC joiner node is stuck in "State transfer in progress, setting sleep higher" if the following are configured:

       

      [mysqld]
      early-plugin-load=keyring_file.so
      keyring_file_data=/var/lib/mysql-keyring/keyring
      [xtrabackup]
      keyring_file_data=/var/lib/mysql-keyring/keyring
      

      This does not happen upon initialization of the datadir, this only happens when a node is re-joined to the cluster even if only only one record is changed. It does not matter if the change is to an encrypted table or not.

      How to repeat:

      Assume you have a running 3-node cluster, with encrypted tablespace enabled as above.

      1. shutdown node3
      2. insert one record on any table on node1 or node2
      3. start node3 and let it join the cluster, node3 will stay stuck trying to complete the state transfer ....
      [root@pxc_enc_3 ~]# service mysql start
      Starting MySQL (Percona XtraDB Cluster)...State transfer in progress, setting sleep higher
      ........................................................^C

       

      To resolve, one has to rm the contents of the datadir on node3 and upon restart of mysqld it would re-initialize the datadir and would then join the cluster via SST with no problems.

      If early_plugin_load and keyring_file_data is commented out in my.cnf SST/IST works when the above steps are tested.

      [root@pxc_enc_3 ~]# rpm -qa|grep -i percona
      percona-release-0.1-4.noarch
      Percona-XtraDB-Cluster-client-57-5.7.19-29.22.3.el6.x86_64
      Percona-XtraDB-Cluster-shared-57-5.7.19-29.22.3.el6.x86_64
      Percona-Server-shared-51-5.1.73-rel14.12.625.rhel6.x86_64
      Percona-XtraDB-Cluster-server-57-5.7.19-29.22.3.el6.x86_64
      percona-xtrabackup-24-2.4.8-1.el6.x86_64

        Smart Checklist

          Attachments

          1. donor-node.log
            3 kB
          2. joiner-my.cnf
            2 kB
          3. joiner-node.log
            4 kB

            Issue Links

              Activity

                People

                Assignee:
                krunal.bauskar Krunal Bauskar (Inactive)
                Reporter:
                jericho.rivera Jericho Rivera
                Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                  Dates

                  Created:
                  Updated:
                  Resolved: