Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-5244

High memory consumption with a large number of the agent sending data to the PMM Server simultaneously

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 2.2.1
    • Component/s: QAN API
    • Labels:
    • Story Points:
      1
    • Sprint:
      Platform Sprint 7, Platform Sprint 8
    • Needs Review:
      Yes
    • Needs QA:
      Yes
    • Needs Packaging:
      No
    • Needs Doc:
      Yes

      Description

      qan-api2 inserts all CollectRequest's MetricsBucket in a single batch. That's better than store each bucket individually, but not good enough when there are 10-20 pmm-agents reporting data in the same moment as it effectively uses one ClickHouse connection per pmm-agent, consuming much memory.

      DoD

      • qan-api2 uses less ClickHouse connections, consumes less memory, and does not loose data.

        Attachments

          Issue Links

            Activity

              People

              Assignee:
              Unassigned
              Reporter:
              alexey.palazhchenko Alexey Palazhchenko (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Dates

                Created:
                Updated:
                Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 2 days, 2 hours, 48 minutes
                  2d 2h 48m

                    Smart Checklist