Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-5524

Prometheus alerting rule changes needs docker restart to activate

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Medium
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 2.4.0
    • Fix Version/s: 2.7.0
    • Component/s: docker, PMM ManageD
    • Labels:
      None
    • Environment:

      docker container with 2.3.0 pmm-server:2
      alertmanager in another docker container

    • Story Points:
      0
    • Sprint:
      Platform Sprint 12, Platform Sprint 16, Platform Sprint 17, Platform Sprint 18
    • Needs Review:
      Yes
    • Needs QA:
      Yes
    • Needs Packaging:
      No
    • Needs Doc:
      No

      Description

      STR:

      1. Install PMM2 2.3.0
      2. Configure Alertmanager (run was-staging-start job with --setup-alertmanager option)
      3. Open PMM settings page
      4. Add alert manager url and rule
      5. Apply changes
      6. Check PMM_Server/prometheus/rule page. Added rule should be displayed
      7. Open Pmm Settings page
      8. Change Alertmanager rule and submit the form
      9. Check again PMM_Server/prometheus/rule page
        Expected result: the new rule is displayed

      Given result: The old rule is displayed

      Expected results: Prometheus alerting rules changes shouldn't need docker restart
       
       

       

      See Smart Checklist.

      Original report:
      Hello
      following yout blog about alertmanager I tried it.

      Starting with the mentioned Postgres down rule I got it working, but any changes to the alertmanager rules in the GUI did not fire on the testet values.

      In the comments of the blog article I found "try to look http:///prometheus
      This worked with the docker container on https://<pmmserver>:8443/prometheus and there only the Postgres Down Rule was mentioned. After docker stop/start the new rules also are mentioned.

      Please make prometheus reloading the alertmanager rules after the "Aplly Alertmanager Settings" button in pmm-settings is pressed and the rules are valid.

      Thanks again for the PMM itself. Very helpful tool.

      Hubertus

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              hubi_oediv Hubertus Krogmann
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 1 hour, 20 minutes
                  1h 20m

                    Smart Checklist