Uploaded image for project: 'Percona Monitoring and Management'
  1. Percona Monitoring and Management
  2. PMM-5244

High memory consumption with a large number of the agent sending data to the PMM Server simultaneously

    Details

    • Type: Bug
    • Status: Done
    • Priority: Medium
    • Resolution: Done
    • Affects Version/s: None
    • Fix Version/s: 2.2.1
    • Component/s: QAN API
    • Labels:
    • Story Points:
      1
    • Sprint:
      Platform Sprint 7, Platform Sprint 8
    • Needs Review:
      Yes
    • Needs QA:
      Yes
    • Needs Packaging:
      No
    • Needs Doc:
      Yes

      Description

      qan-api2 inserts all CollectRequest's MetricsBucket in a single batch. That's better than store each bucket individually, but not good enough when there are 10-20 pmm-agents reporting data in the same moment as it effectively uses one ClickHouse connection per pmm-agent, consuming much memory.

      DoD

      • qan-api2 uses less ClickHouse connections, consumes less memory, and does not loose data.

        Smart Checklist

          Attachments

            Issue Links

              Activity

                People

                • Assignee:
                  dmitriy.kostiuk Dmitriy Kostiuk
                  Reporter:
                  alexey.palazhchenko Alexey Palazhchenko
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  2 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Time Tracking

                    Estimated:
                    Original Estimate - Not Specified
                    Not Specified
                    Remaining:
                    Remaining Estimate - Not Specified
                    Not Specified
                    Logged:
                    Time Spent - 2 days, 2 hours, 48 minutes
                    2d 2h 48m