Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-7116

Dashboards: Incorrect STARTUP state on MongoDB ReplSet Summary dashboard

Details

    • 5
    • Yes
    • Yes
    • [obsolete] C/S Core

    Description

      Problem:

      Since v.2.10 till now MongoDB ReplSet Summary Dashbord  shows incorrect replset member's state: STARTUP instead of PRIMARY

      After downgrade to pmm2-client 2.9.1 everything is fine
       

       How to test

      1. Start a sandbox like mongodb_exporter's sandbox.

      cd /tmp/
      git clone https://github.com/percona/mongodb_exporter.git
      cd mongodb_exporter/
      # get your host LAN IP address
      hostname -I | awk '{print $1}'
      make test-cluster

      2. Start the feature build's pmm server:

      IMAGE='perconalab/pmm-server-fb:PR-2102-5fb2f62'
      docker create -v /srv --name pmm-data ${IMAGE} /bin/true
      docker run -d \
          -p 80:80 \
          -p 443:443 \
          --volumes-from pmm-data \
          --name pmm-server \
          -e PERCONA_TEST_DBAAS=1 \
          -e PERCONA_TEST_VERSION_SERVICE_URL=https://check-dev.percona.com/versions/v1 \
          ${IMAGE}
      

      3. Add MongoDB instances to pmm

      docker exec -ti pmm-server bash
      # this step is optional to avoid passing --server-insecure-tls --server-url=https://admin:[email protected]:443 to all requests
      pmm-admin config --server-insecure-tls --server-url=https://admin:[email protected]:443
      # Add the instances
      pmm-admin add mongodb --host <host_ip_address_from_step_1> --port 17001 --service-name=mongors1-1 --skip-connection-check
      pmm-admin add mongodb --host <host_ip_address_from_step_1> --port 17002 --service-name=mongors1-2 --skip-connection-check
      pmm-admin add mongodb --host <host_ip_address_from_step_1> --port 17003 --service-name=mongors1-3 --skip-connection-check
      

       h3. 4. Wait a couple of minutes to collect some metrics

      5. Stop a mongodb instance

      From the docker host (your local machine)

      docker stop mongo-1-1
      

      6. Check replicaset status dashboard

      In PMM's replicaset dashboard (http://localhost/graph/d/mongodb-replicaset-summary/mongodb-replset-summary) the state for the instance we took down in step 5 should say "Exporter is not connected"


       

      Attachments

        1. image-2020-12-07-15-07-50-185.png
          image-2020-12-07-15-07-50-185.png
          25 kB
        2. image-2020-12-14-14-44-11-222.png
          image-2020-12-14-14-44-11-222.png
          37 kB
        3. image-2020-12-21-17-53-03-984.png
          image-2020-12-21-17-53-03-984.png
          158 kB
        4. image-2020-12-21-17-56-40-981.png
          image-2020-12-21-17-56-40-981.png
          166 kB
        5. image-2020-12-21-17-58-31-466.png
          image-2020-12-21-17-58-31-466.png
          166 kB
        6. image-2020-12-21-17-59-09-878.png
          image-2020-12-21-17-59-09-878.png
          166 kB
        7. image-2021-08-06-10-11-44-920.png
          image-2021-08-06-10-11-44-920.png
          657 kB
        8. image-2021-12-30-12-48-04-246.png
          image-2021-12-30-12-48-04-246.png
          111 kB
        9. image-2021-12-30-12-50-00-146.png
          image-2021-12-30-12-50-00-146.png
          422 kB
        10. image-2021-12-30-14-24-24-201.png
          image-2021-12-30-14-24-24-201.png
          77 kB
        11. mongo_rplset.png
          mongo_rplset.png
          178 kB
        12. null_status_STARTUP.png
          null_status_STARTUP.png
          183 kB
        13. pmm_2.10.0_mogodb_rplset.png
          pmm_2.10.0_mogodb_rplset.png
          172 kB
        14. pmm_2.11.1_mrplset.png
          pmm_2.11.1_mrplset.png
          205 kB
        15. pmm_2.11.1_mrplset.png
          pmm_2.11.1_mrplset.png
          205 kB
        16. pmm_2.12.0_issue1_3hours.png
          pmm_2.12.0_issue1_3hours.png
          170 kB
        17. pmm_2.12.0_issue2_1hour.png
          pmm_2.12.0_issue2_1hour.png
          188 kB
        18. pmm_2.12.0_mongodb_rplset.png
          pmm_2.12.0_mongodb_rplset.png
          177 kB
        19. pmm_2.12.0_replset_with_Arbiter.png
          pmm_2.12.0_replset_with_Arbiter.png
          198 kB
        20. pmm_2.120_issue3_5mins.png
          pmm_2.120_issue3_5mins.png
          188 kB
        21. pmm_2.9.0_mrplset.png
          pmm_2.9.0_mrplset.png
          195 kB
        22. pmm2.12.png
          pmm2.12.png
          178 kB
        23. pmm2.9.1.png
          pmm2.9.1.png
          174 kB
        24. pmm-agent.tar.gz
          77 kB
        25. pmm-server_2021-10-07_11-12.zip
          81 kB
        26. Screenshot_20210104_190550.png
          Screenshot_20210104_190550.png
          120 kB
        27. Screenshot_20211025_102255.png
          Screenshot_20211025_102255.png
          92 kB
        28. Screenshot_20211025_131316.png
          Screenshot_20211025_131316.png
          90 kB
        29. Screenshot 2021-09-30 at 11.44.04.png
          Screenshot 2021-09-30 at 11.44.04.png
          394 kB
        30. Screenshot 2021-10-07 at 14.09.54.png
          Screenshot 2021-10-07 at 14.09.54.png
          402 kB
        31. Screenshot 2021-10-07 at 16.22.02.png
          Screenshot 2021-10-07 at 16.22.02.png
          361 kB
        32. Screenshot from 2020-12-23 14-38-13.png
          Screenshot from 2020-12-23 14-38-13.png
          100 kB
        33. Screenshot from 2021-12-30 14-13-38.png
          Screenshot from 2021-12-30 14-13-38.png
          162 kB
        34. Screenshot from 2021-12-30 14-13-38-1.png
          Screenshot from 2021-12-30 14-13-38-1.png
          162 kB
        35. started_2_mongodb_services_after10mins.png
          started_2_mongodb_services_after10mins.png
          147 kB
        36. started_2_mongodb_services_after10mins-1.png
          started_2_mongodb_services_after10mins-1.png
          147 kB
        37. stooped_2_mongod_services.png
          stooped_2_mongod_services.png
          158 kB
        38. summary_ip-10-178-2-178_us-east-2_compute_internal_2021_10_07_16_10_51.zip
          86 kB
        39. syslog
          81 kB

        Issue Links

          Activity

            People

              Unassigned Unassigned
              carlos.salguero Carlos Salguero (Inactive)
              Votes:
              1 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Smart Checklist