Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-5244

High memory consumption with a large number of the agent sending data to the PMM Server simultaneously

Details

    • Bug
    • Status: Done
    • Medium
    • Resolution: Done
    • None
    • 2.2.1
    • QAN API
    • 1
    • Yes
    • Yes
    • Yes
    • No

    Description

      qan-api2 inserts all CollectRequest's MetricsBucket in a single batch. That's better than store each bucket individually, but not good enough when there are 10-20 pmm-agents reporting data in the same moment as it effectively uses one ClickHouse connection per pmm-agent, consuming much memory.

      DoD

      • qan-api2 uses less ClickHouse connections, consumes less memory, and does not loose data.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              alexey.palazhchenko Alexey Palazhchenko (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 2 days, 2 hours, 48 minutes
                  2d 2h 48m

                  Smart Checklist