Uploaded image for project: 'Percona Server'
  1. Percona Server
  2. PS-3896

Loss of Percona Server data



    • Type: Bug
    • Status: Incomplete
    • Priority: High
    • Resolution: Unresolved
    • Affects Version/s: 5.7.19-17
    • Fix Version/s: None
    • Component/s: None
    • Labels:
    • Environment:

      Linux CentOS7 3.10.0-693.17.1.el7.x86_64 #1 SMP Thu Jan 25 20:13:58 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux


      Yesterday my server suddenly alerted. I found that my database is not connected. Go in to check and find out that my database seems to be reset. All databases are lost. The data file and auto.conf are also just generated. Carefully examined the server to eliminate the possibility of hacker attacks. I posted the log of this point. Note that UTC time is not the same as Beijing time.

      2018-03-14T00:03:18.100305Z 0 [ERROR] [FATAL] InnoDB: Native Linux AIO interface. io_submit() call failed when resubmitting a partial I/O request on the file ./ibtmp1.
      2018-03-14 08:03:18 0x7f296ec96700 InnoDB: Assertion failure in thread 139815929079552 in file ut0ut.cc line 917
      InnoDB: We intentionally generate a memory trap.
      InnoDB: Submit a detailed bug report to http://bugs.mysql.com.
      InnoDB: If you get repeated assertion failures or crashes, even
      InnoDB: immediately after the mysqld startup, there may be
      InnoDB: corruption in the InnoDB tablespace. Please refer to
      InnoDB: http://dev.mysql.com/doc/refman/5.7/en/forcing-innodb-recovery.html
      InnoDB: about forcing recovery.
      00:03:18 UTC - mysqld got signal 6 ;
      This could be because you hit a bug. It is also possible that this binary
      or one of the libraries it was linked against is corrupt, improperly built,
      or misconfigured. This error can also be caused by malfunctioning hardware.
      Attempting to collect some information that could help diagnose the problem.
      As this is a crash and something is definitely wrong, the information
      collection process might fail.
      Please help us make Percona Server better by reporting any
      bugs at http://bugs.percona.com/
      It is possible that mysqld could use up to 
      key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 1164251 K bytes of memory
      Hope that's ok; if not, decrease some variables in the equation.
      Thread pointer: 0x0
      Attempting backtrace. You can use the following information to find out
      where mysqld died. If you see no messages after this, something went
      terribly wrong...
      stack_bottom = 0 thread_stack 0x40000
      You may download the Percona Server operations manual by visiting
      http://www.percona.com/software/percona-server/. You may find information
      in the manual which will help you identify the cause of the crash.
      2018-03-14T00:03:27.106529Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
      2018-03-14T00:03:36.780102Z 0 [Warning] InnoDB: New log files created, LSN=45790
      2018-03-14T00:03:37.260990Z 0 [Warning] InnoDB: Creating foreign key constraint system tables.
      2018-03-14T00:03:37.441043Z 0 [Warning] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 25131c66-271b-11e8-9b42-525400c45bd1.
      2018-03-14T00:03:37.468416Z 0 [Warning] Gtid table is not ready to be used. Table 'mysql.gtid_executed' cannot be opened.
      2018-03-14T00:03:37.677388Z 0 [Warning] CA certificate ca.pem is self signed.
      2018-03-14T00:03:37.778419Z 1 [Note] A temporary password is generated for root@localhost: 5#ahmXKydC7o
      2018-03-14T00:03:44.676210Z 0 [Warning] TIMESTAMP with implicit DEFAULT value is deprecated. Please use --explicit_defaults_for_timestamp server option (see documentation for more details).
      2018-03-14T00:03:44.678311Z 0 [Note] /usr/sbin/mysqld (mysqld 5.7.19-17) starting as process 24263 ...
      2018-03-14T00:03:44.707348Z 0 [Note] InnoDB: PUNCH HOLE support available
      2018-03-14T00:03:44.707411Z 0 [Note] InnoDB: Mutexes and rw_locks use GCC atomic builtins
      2018-03-14T00:03:44.707416Z 0 [Note] InnoDB: Uses event mutexes
      2018-03-14T00:03:44.707421Z 0 [Note] InnoDB: GCC builtin __atomic_thread_fence() is used for memory barrier
      2018-03-14T00:03:44.707424Z 0 [Note] InnoDB: Compressed tables use zlib 1.2.7
      2018-03-14T00:03:44.707435Z 0 [Note] InnoDB: Using Linux native AIO
      2018-03-14T00:03:44.707791Z 0 [Note] InnoDB: Number of pools: 1
      2018-03-14T00:03:44.707926Z 0 [Note] InnoDB: Using CPU crc32 instructions
      2018-03-14T00:03:44.712030Z 0 [Note] InnoDB: Initializing buffer pool, total size = 3G, instances = 2, chunk size = 128M
      2018-03-14T00:03:44.802193Z 0 [Note] InnoDB: Completed initialization of buffer pool
      2018-03-14T00:03:44.828578Z 0 [Note] InnoDB: If the mysqld execution user is authorized, page cleaner thread priority can be changed. See the man page of setpriority().
      2018-03-14T00:03:44.875594Z 0 [Note] InnoDB: Crash recovery did not find the parallel doublewrite buffer at /data/mysql/xb_doublewrite
      2018-03-14T00:03:44.879913Z 0 [Note] InnoDB: Highest supported file format is Barracuda.
      2018-03-14T00:03:45.099819Z 0 [Note] InnoDB: Created parallel doublewrite buffer at /data/mysql/xb_doublewrite, size 7864320 bytes
      2018-03-14T00:03:45.363332Z 0 [Note] InnoDB: Creating shared tablespace for temporary tables
      2018-03-14T00:03:45.363438Z 0 [Note] InnoDB: Setting file './ibtmp1' size to 12 MB. Physically writing the file full; Please wait ...
      2018-03-14T00:03:45.646066Z 0 [Note] InnoDB: File './ibtmp1' size is now 12 MB.
      2018-03-14T00:03:45.647094Z 0 [Note] InnoDB: 96 redo rollback segment(s) found. 96 redo rollback segment(s) are active.
      2018-03-14T00:03:45.647109Z 0 [Note] InnoDB: 32 non-redo rollback segment(s) are active.
      2018-03-14T00:03:45.647613Z 0 [Note] InnoDB: Waiting for purge to start
      2018-03-14T00:03:45.700289Z 0 [Note] InnoDB: Percona XtraDB (http://www.percona.com) 5.7.19-17 started; log sequence number 2544743
      2018-03-14T00:03:45.701256Z 0 [Note] InnoDB: Loading buffer pool(s) from /data/mysql/ib_buffer_pool
      2018-03-14T00:03:45.701782Z 0 [Note] Plugin 'FEDERATED' is disabled.
      2018-03-14T00:03:45.794880Z 0 [Note] Found ca.pem, server-cert.pem and server-key.pem in data directory. Trying to enable SSL support using them.
      2018-03-14T00:03:45.794945Z 0 [Note] Skipping generation of SSL certificates as certificate files are present in data directory.
      2018-03-14T00:03:45.803261Z 0 [Warning] CA certificate ca.pem is self signed.
      2018-03-14T00:03:45.803375Z 0 [Note] Skipping generation of RSA key pair as key files are present in data directory.
      2018-03-14T00:03:45.803858Z 0 [Note] Server hostname (bind-address): '*'; port: 3306
      2018-03-14T00:03:45.803903Z 0 [Note] IPv6 is available.
      2018-03-14T00:03:45.803919Z 0 [Note] - '::' resolves to '::';
      2018-03-14T00:03:45.803973Z 0 [Note] Server socket created on IP: '::'.
      2018-03-14T00:03:45.884458Z 0 [Note] InnoDB: Buffer pool(s) load completed at 180314 8:03:45
      2018-03-14T00:03:45.911596Z 0 [Note] Event Scheduler: Loaded 0 events
      2018-03-14T00:03:45.911881Z 0 [Note] /usr/sbin/mysqld: ready for connections.
      Version: '5.7.19-17' socket: '/var/lib/mysql/mysql.sock' port: 3306 Percona Server (GPL), Release 17, Revision e19a6b7b73f
      2018-03-14T00:03:45.911904Z 0 [Note] Executing 'SELECT * FROM INFORMATION_SCHEMA.TABLES;' to get a list of tables using the deprecated partition engine. You may use the startup option '--disable-partition-engine-check' to skip this check. 
      2018-03-14T00:03:45.911911Z 0 [Note] Beginning of list of non-natively partitioned tables
      2018-03-14T00:03:45.923210Z 0 [Note] End of list of non-natively partitioned tables
      2018-03-14T00:03:47.523311Z 3 [Warning] IP address '' could not be resolved: Name or service not known
      2018-03-14T00:03:47.543031Z 5 [Warning] IP address '' could not be resolved: Name or service not known
      2018-03-14T01:52:33.497460Z 0 [Note] Giving 0 client threads a chance to die gracefully
      2018-03-14T01:52:33.497498Z 0 [Note] Shutting down slave threads
      2018-03-14T01:52:33.497512Z 0 [Note] Forcefully disconnecting 0 remaining clients
      2018-03-14T01:52:33.497522Z 0 [Note] Event Scheduler: Purging the queue. 0 events
      2018-03-14T01:52:33.497585Z 0 [Note] Binlog end
      2018-03-14T01:52:33.498848Z 0 [Note] Shutting down plugin 'validate_password'
      2018-03-14T01:52:33.498883Z 0 [Note] Shutting down plugin 'ngram'
      2018-03-14T01:52:33.498889Z 0 [Note] Shutting down plugin 'ARCHIVE'
      2018-03-14T01:52:33.498894Z 0 [Note] Shutting down plugin 'partition'
      2018-03-14T01:52:33.498899Z 0 [Note] Shutting down plugin 'BLACKHOLE'
      2018-03-14T01:52:33.498906Z 0 [Note] Shutting down plugin 'PERFORMANCE_SCHEMA'
      2018-03-14T01:52:33.498944Z 0 [Note] Shutting down plugin 'MRG_MYISAM'
      2018-03-14T01:52:33.498951Z 0 [Note] Shutting down plugin 'CSV'


        Smart Checklist




              • Assignee:
                becivells WenZhi Lee
              • Votes:
                0 Vote for this issue
                2 Start watching this issue


                • Created:

                  Time Tracking

                  Original Estimate - Not Specified
                  Not Specified
                  Remaining Estimate - 0 minutes
                  Time Spent - 15 minutes