Uploaded image for project: 'Percona XtraBackup'
  1. Percona XtraBackup
  2. PXB-1691

OOM error when backing up using --lock-ddl-per-table

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Done
    • Priority: Medium
    • Resolution: Fixed
    • Affects Version/s: 2.4.12, 8.0.4
    • Fix Version/s: 2.4.13, 8.0.5
    • Component/s: None
    • Labels:
      None

      Description

       

      Issue

      Xtrabackup errors with an out of memory message and a reference to a partitioned table.

      Versions 

      • mysql Ver 14.14 Distrib 5.7.21-20
      • xtrabackup version 2.4.12 based on MySQL server 5.7.19 Linux (x86_64) (revision id: 170eb8c)

      Log Error output

      181018 14:07:21 >> log scanned up to (186038457510)
      181018 14:07:22 >> log scanned up to (186038457811)
      181018 14:07:23 >> log scanned up to (186038458205)
      xtrabackup: Out of memory (Needed 1583040 bytes)
      Error: failed to fetch query result SELECT * FROM lol_store.transaction_syncs#P#p20180725 LIMIT 1: MySQL client ran out of memory

       

      Observations

      We also noticed the xtrabackup process uses a large amount of memory

      IF you take the SQL in the xtrabackup log output and run and run `SELECT * FROM lol_store.transaction_syncs#P#p20180725 LIMIT 1:` it will scan all (hundreds of the partitions) 

      I did not understand why the syntax in the log output from xtrabackup was not 

      `SELECT id FROM lol_store.transaction_syncs partition (p20180725) LIMIT 1;`

       

      Contacts

      awhitwham@riotgames.com

      cbegin@riotgames.com

       

       

       

        Smart Checklist

          Attachments

            Activity

              People

              • Assignee:
                sergei.glushchenko Sergei Glushchenko
                Reporter:
                adrianwhitwham adrian whitwham
              • Votes:
                1 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0 minutes
                  0m
                  Logged:
                  Time Spent - 1 day, 1 hour
                  1d 1h