Uploaded image for project: 'Percona Server for MySQL'
  1. Percona Server for MySQL
  2. PS-5379

Slow startup after an upgrade from MySQL 5.7 to MySQL 8.

Details

    • Bug
    • Status: Done
    • Low
    • Resolution: Fixed
    • 8.0.13-4, 8.0.15-6, Not 5.6.x, Not 5.7.x
    • 8.0.19-10
    • None
    • Ubuntu 18.04 LTS

    Description

      After an upgrade from MySQL 5.7 to 8, the startup time increased from <1 minute to 20-40 minutes. The startup procedure freezes at "(mysqld 8.0.13-4) starting as process" .

      During the freeze, the process CPU usage is more or less idle while the storage (HDD RAID array) is overloaded, doing 100-200 read requests/second (average 3-6MB/s). Since RAID array is capable of over 1000 read requests per second when doing multithread reads, this suggests the internal job is single threaded. The disk and cpu usage pattern are strikingly similar with the ones experienced during upgrade.

      The database has over 70K tables and is very large. All tables are using InnoDB. Before upgrade, restart cycle was constant to less than 3 minutes. Configuration parameters were kept the same with the except of InnoDB buffer which was doubled in size. To be noted that server is configured not to dump or load any part of InnoDB buffer during shutdown/startup

      Attachments

        1. debug-logs.txt
          17 kB
        2. ms_8_0_13.log
          214 kB
        3. my.cnf
          1 kB
        4. ps_8_0_13.log
          194 kB
        5. PS-5379_mysql_log_slow_startup.log
          19 kB
        6. PS-5379_ps57_ps80_startup_perf.txt
          3 kB
        7. PS-5379_upsteam_mysql_8_0_14_mysql_startup.log
          8 kB

        Activity

          People

            Unassigned Unassigned
            sergiuhlihor Sergiu Hlihor
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Smart Checklist