Uploaded image for project: 'Percona Operator for MySQL based on Percona XtraDB Cluster'
  1. Percona Operator for MySQL based on Percona XtraDB Cluster
  2. K8SPXC-424

Haproxy can spawn check_pxc.sh more than once that makes logs unreadable

Details

    Description

      root      4493  0.0  0.0 110112  5124 ?        Sl   06:44   0:01  \_ containerd-shim -namespace moby -workdir /var/lib/containerd/io.containerd.runtime.v1.linux/moby/103eae0fc42d73b1c5b2182c
      docker    4529  0.0  0.0  69528 10284 ?        Ss   06:44   0:00  |   \_ haproxy -sf 13 -x /var/run/haproxy.sock -W -db -f /etc/haproxy/haproxy-global.cfg -f /etc/haproxy/pxc/haproxy.cfg -p 
      docker    5659 10.6  0.0 1175508 6968 ?        Sl   06:46  34:03  |       \_ haproxy -sf 13 -x /var/run/haproxy.sock -W -db -f /etc/haproxy/haproxy-global.cfg -f /etc/haproxy/pxc/haproxy.cfg
      docker    9841  0.0  0.0  11888  2868 ?        S    12:07   0:00  |           \_ /bin/bash /usr/local/bin/check_pxc.sh NOT_USED NOT_USED 192.168.80.26 3306
      docker    9845  0.0  0.0  11888  1804 ?        S    12:07   0:00  |           |   \_ /bin/bash /usr/local/bin/check_pxc.sh NOT_USED NOT_USED 192.168.80.26 3306
      docker    9847  0.0  0.0  23028  1288 ?        S    12:07   0:00  |           |       \_ /usr/bin/coreutils --coreutils-prog-shebang=timeout /usr/bin/timeout 10 /usr/bin/mysql -nNE -umonitor
      docker    9855  0.0  0.0  62396  7404 ?        S    12:07   0:00  |           |       |   \_ /usr/bin/mysql -nNE -umonitor -h 192.168.80.26 -P 3306 -e SHOW STATUS LIKE 'wsrep_local_state';SH
      docker    9849  0.0  0.0   9180  1084 ?        S    12:07   0:00  |           |       \_ /usr/bin/grep -A 1 -E wsrep_local_state$|pxc_maint_mode$|wsrep_cluster_status$
      docker    9851  0.0  0.0  17648  1220 ?        S    12:07   0:00  |           |       \_ /usr/bin/sed -n -e 2p -e 5p -e 8p
      docker    9853  0.0  0.0  23028  1388 ?        S    12:07   0:00  |           |       \_ /usr/bin/coreutils --coreutils-prog-shebang=tr /usr/bin/tr \n  
      docker    9842  0.0  0.0  11888  2864 ?        S    12:07   0:00  |           \_ /bin/bash /usr/local/bin/check_pxc.sh NOT_USED NOT_USED 192.168.80.26 3306
      docker    9846  0.0  0.0  11888  1804 ?        S    12:07   0:00  |               \_ /bin/bash /usr/local/bin/check_pxc.sh NOT_USED NOT_USED 192.168.80.26 3306
      docker    9848  0.0  0.0  23028  1408 ?        S    12:07   0:00  |                   \_ /usr/bin/coreutils --coreutils-prog-shebang=timeout /usr/bin/timeout 10 /usr/bin/mysql -nNE -umonitor
      docker    9856  0.0  0.0  62396  7416 ?        S    12:07   0:00  |                   |   \_ /usr/bin/mysql -nNE -umonitor -h 192.168.80.26 -P 3306 -e SHOW STATUS LIKE 'wsrep_local_state';SH
      docker    9850  0.0  0.0   9180  1088 ?        S    12:07   0:00  |                   \_ /usr/bin/grep -A 1 -E wsrep_local_state$|pxc_maint_mode$|wsrep_cluster_status$
      docker    9852  0.0  0.0  17648  1228 ?        S    12:07   0:00  |                   \_ /usr/bin/sed -n -e 2p -e 5p -e 8p
      docker    9854  0.0  0.0  23028  1428 ?        S    12:07   0:00  |                   \_ /usr/bin/coreutils --coreutils-prog-shebang=tr /usr/bin/tr \n  
      

      Logs:

      + PXC_NODE_STATUS=($(MYSQL_PWD="${MONITOR_PASSWORD}" $MYSQL_CMDLINE -h $PXC_SERVER_IP -P $PXC_SERVER_PORT         -e "SHOW STATUS LIKE 'wsrep_local_state';SHOW VARIABLES LIKE 'pxc_maint_mode';SHOW GLOBAL STATUS LIKE 'wsrep_cluster_status';"         | /usr/bin/grep -A 1 -E 'wsrep_local_state$|pxc_maint_mode$|wsrep_cluster_status$' | /usr/bin/sed -n -e '2p' -e '5p' -e '8p' | /usr/bin/tr '\n' ' '))
      ++ MYSQL_PWD=eYyIyNxvbVNWsDfK9
      ++ /usr/bin/timeout 10 /usr/bin/mysql -nNE -umonitor -h 192.168.80.26 -P 3306 -e 'SHOW STATUS LIKE '\''wsrep_local_state'\'';SHOW VARIABLES LIKE '\''pxc_maint_mode'\'';SHOW GLOBAL STATUS LIKE '\''wsrep_cluster_status'\'';'
      ++ /usr/bin/grep -A 1 -E 'wsrep_local_state$|pxc_maint_mode$|wsrep_cluster_status$'
      ++ MYSQL_PWD=eYyIyNxvbVNWsDfK9
      ++ /usr/bin/timeout 10 /usr/bin/mysql -nNE -umonitor -h 192.168.80.26 -P 3306 -e 'SHOW STATUS LIKE '\''wsrep_local_state'\'';SHOW VARIABLES LIKE '\''pxc_maint_mode'\'';SHOW GLOBAL STATUS LIKE '\''wsrep_cluster_status'\'';'
      ++ /usr/bin/grep -A 1 -E 'wsrep_local_state$|pxc_maint_mode$|wsrep_cluster_status$'
      ++ /usr/bin/sed -n -e 2p -e 5p -e 8p
      ++ /usr/bin/sed -n -e 2p -e 5p -e 8p
      ++ /usr/bin/tr '\n' ' '
      ++ /usr/bin/tr '\n' ' '
      **ERRORERROR 2003 (HY000) 2003 (HY000): Can't connect to MySQL server on '192.168.80.26' (113)**
      : Can't connect to MySQL server on '192.168.80.26' (113)
      + [[ '' == \P\r\i\m\a\r\y ]]
      + [[ '' == \P\r\i\m\a\r\y ]]
      + echo 'PXC node 192.168.80.26 is not ok'
      + echo 'PXC node 192.168.80.26 is not ok'
      + exit 1
      + exit 1
      

      Attachments

        Issue Links

          Activity

            People

              slava.sarzhan Slava Sarzhan
              iwo.panowicz Iwo Panowicz
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 3 hours, 10 minutes
                  3h 10m

                  Smart Checklist