Uploaded image for project: 'Percona Server for MySQL'
  1. Percona Server for MySQL
  2. PS-7923

Assertion `owned_gtids.is_owned_by(thd->owned_gtid, thd->thread_id())' failed.

Details

    Description

      Server fails to start during crash recovery. The server needs to be started with

      ./bin/mysqld --early-plugin-load=keyring_file.so --keyring_file_data=keyring --gtid-mode=ON --enforce-gtid-consistency=ON --basedir=$basedir --datadir=$datadir --core-file --port=$port --socket=$socket --log-error=/tmp/707625/1/log/master.err --log-error-verbosity=3

      From session 1: Continuosly run the below DDL in single thread

      ALTER TABLESPACE mysql ENCRYPTION=Y/N;

      From session 2: Kill the server

      kill -9 $pid

      Try to perform crash recovery, the server will not start. below is the stack trace:

      #0  __pthread_kill (threadid=<optimized out>, signo=6) at ../sysdeps/unix/sysv/linux/pthread_kill.c:56
      #1  0x00005569c838602f in my_write_core (sig=6) at /home/mohit.joshi/mysql-8.0/mysys/stacktrace.cc:409
      #2  0x00005569c6ecb63f in handle_fatal_signal (sig=6) at /home/mohit.joshi/mysql-8.0/sql/signal_handler.cc:194
      #3  <signal handler called>
      #4  __GI_raise ([email protected]=6) at ../sysdeps/unix/sysv/linux/raise.c:50
      #5  0x00007f7f0f08e859 in __GI_abort () at abort.c:79
      #6  0x00007f7f0f08e729 in __assert_fail_base (fmt=0x7f7f0f224588 "%s%s%s:%u: %s%sAssertion `%s' failed.\n%n", 
          assertion=0x5569c9f81398 "owned_gtids.is_owned_by(thd->owned_gtid, thd->thread_id())", 
          file=0x5569c9f803f8 "/home/mohit.joshi/mysql-8.0/sql/rpl_gtid_state.cc", line=863, function=<optimized out>) at assert.c:92
      #7  0x00007f7f0f09ff36 in __GI___assert_fail (assertion=0x5569c9f81398 "owned_gtids.is_owned_by(thd->owned_gtid, thd->thread_id())", 
          file=0x5569c9f803f8 "/home/mohit.joshi/mysql-8.0/sql/rpl_gtid_state.cc", line=863, 
          function=0x5569c9f81360 "void Gtid_state::update_gtids_impl_own_gtid(THD*, bool)") at assert.c:101
      #8  0x00005569c7f69d13 in Gtid_state::update_gtids_impl_own_gtid (this=0x5569cf6fbc10, thd=0x7f7e6c000be0, is_commit=true)
          at /home/mohit.joshi/mysql-8.0/sql/rpl_gtid_state.cc:863
      #9  0x00005569c7f67199 in Gtid_state::update_commit_group (this=0x5569cf6fbc10, first_thd=0x7f7e6c000be0)
          at /home/mohit.joshi/mysql-8.0/sql/rpl_gtid_state.cc:196
      #10 0x00005569c7edfbe5 in MYSQL_BIN_LOG::process_commit_stage_queue (this=0x5569cbd21160 <mysql_bin_log>, thd=0x7f7e6c000be0, 
          first=0x7f7e6c000be0) at /home/mohit.joshi/mysql-8.0/sql/binlog.cc:8729
      #11 0x00005569c7ee1740 in MYSQL_BIN_LOG::ordered_commit (this=0x5569cbd21160 <mysql_bin_log>, thd=0x7f7e6c000be0, all=true, 
          skip_commit=false) at /home/mohit.joshi/mysql-8.0/sql/binlog.cc:9262
      #12 0x00005569c7edf201 in MYSQL_BIN_LOG::commit (this=0x5569cbd21160 <mysql_bin_log>, thd=0x7f7e6c000be0, all=true)
          at /home/mohit.joshi/mysql-8.0/sql/binlog.cc:8470
      #13 0x00005569c67e7dce in ha_commit_trans (thd=0x7f7e6c000be0, all=true, ignore_global_read_lock=false)
          at /home/mohit.joshi/mysql-8.0/sql/handler.cc:1789
      #14 0x00005569c6e5b3cc in trans_commit (thd=0x7f7e6c000be0, ignore_global_read_lock=false)
          at /home/mohit.joshi/mysql-8.0/sql/transaction.cc:246
      #15 0x00005569c6db8719 in (anonymous namespace)::complete_stmt<Sql_cmd_alter_tablespace::execute(THD*)::<lambda()> >(THD *, handlerton *, Sql_cmd_alter_tablespace::<lambda()> &&, bool, bool) (thd=0x7f7e6c000be0, hton=0x5569cf7cd360, dr=..., using_trans=true, 
          dont_write_to_binlog=false) at /home/mohit.joshi/mysql-8.0/sql/sql_tablespace.cc:183
      #16 0x00005569c6db5066 in Sql_cmd_alter_tablespace::execute (this=0x7f7e6c00bcb8, thd=0x7f7e6c000be0)
          at /home/mohit.joshi/mysql-8.0/sql/sql_tablespace.cc:1060
      #17 0x00005569c6c96406 in mysql_execute_command (thd=0x7f7e6c000be0, first_level=false) at /home/mohit.joshi/mysql-8.0/sql/sql_parse.cc:4720
      #18 0x00005569c6cdf91a in (anonymous namespace)::Execute_sql_statement::execute_server_code (this=0x7f7e997f8f10, thd=0x7f7e6c000be0)
          at /home/mohit.joshi/mysql-8.0/sql/sql_prepare.cc:2284
      #19 0x00005569c6ce1f5a in Prepared_statement::execute_server_runnable (this=0x7f7e997f8bd0, server_runnable=0x7f7e997f8f10)
          at /home/mohit.joshi/mysql-8.0/sql/sql_prepare.cc:3125
      #20 0x00005569c6ce361f in Ed_connection::execute_direct (this=0x7f7e997f8f90, server_runnable=0x7f7e997f8f10)
          at /home/mohit.joshi/mysql-8.0/sql/sql_prepare.cc:3669
      #21 0x00005569c6ce34cf in Ed_connection::execute_direct (this=0x7f7e997f8f90, sql_text=...)
          at /home/mohit.joshi/mysql-8.0/sql/sql_prepare.cc:3643
      #22 0x00005569c80f2ab0 in dd::execute_query (thd=0x7f7e6c000be0, q_buf="ALTER TABLESPACE mysql ENCRYPTION = 'N'")
          at /home/mohit.joshi/mysql-8.0/sql/dd/impl/utils.cc:47
      #23 0x00005569c80da9e6 in dd::alter_tablespace_encryption (thd=0x7f7e6c000be0, tablespace_name=0x7f7efe77d330 "mysql", encryption=false)
          at /home/mohit.joshi/mysql-8.0/sql/dd/impl/dictionary_impl.cc:779
      #24 0x00005569c8ade694 in resume_alter_encrypt_tablespace (thd=0x7f7e6c000be0)
          at /home/mohit.joshi/mysql-8.0/storage/innobase/fsp/fsp0fsp.cc:4779
      #25 0x00005569c8adeba6 in fsp_init_resume_alter_encrypt_tablespace () at /home/mohit.joshi/mysql-8.0/storage/innobase/fsp/fsp0fsp.cc:4831
      #26 0x00005569c8638ad0 in std::__invoke_impl<void, void (*&)()> (
          [email protected]: 0x5569c8adeb6b <fsp_init_resume_alter_encrypt_tablespace()>) at /usr/include/c++/9/bits/invoke.h:60
      #27 0x00005569c8638a86 in std::__invoke<void (*&)()> ([email protected]: 0x5569c8adeb6b <fsp_init_resume_alter_encrypt_tablespace()>)
          at /usr/include/c++/9/bits/invoke.h:95
      #28 0x00005569c8638a50 in std::_Bind<void (*())()>::__call<void>(std::tuple<>&&, std::_Index_tuple<>) (this=0x7f7e997f9bc0, __args=...)
          at /usr/include/c++/9/functional:400
      #29 0x00005569c86389d9 in std::_Bind<void (*())()>::operator()<, void>() (this=0x7f7e997f9bc0) at /usr/include/c++/9/functional:484
      #30 0x00005569c8638931 in Runnable::operator()<void (*)()> (this=0x5569cf8f6520, 
          [email protected]: 0x5569c8adeb6b <fsp_init_resume_alter_encrypt_tablespace()>)
          at /home/mohit.joshi/mysql-8.0/storage/innobase/include/os0thread-create.h:101
      #31 0x00005569c8638826 in std::__invoke_impl<void, Runnable, void (*)()> (__f=...) at /usr/include/c++/9/bits/invoke.h:60
      #32 0x00005569c8638781 in std::__invoke<Runnable, void (*)()> (__fn=...) at /usr/include/c++/9/bits/invoke.h:95
      #33 0x00005569c86386d1 in std::thread::_Invoker<std::tuple<Runnable, void (*)()> >::_M_invoke<0ul, 1ul> (this=0x5569cf8f6518)
          at /usr/include/c++/9/thread:244
      #34 0x00005569c8638673 in std::thread::_Invoker<std::tuple<Runnable, void (*)()> >::operator() (this=0x5569cf8f6518)
          at /usr/include/c++/9/thread:251
      #35 0x00005569c8638644 in std::thread::_State_impl<std::thread::_Invoker<std::tuple<Runnable, void (*)()> > >::_M_run (this=0x5569cf8f6510)
          at /usr/include/c++/9/thread:195
      #36 0x00007f7f0f4bede4 in ?? () from /lib/x86_64-linux-gnu/libstdc++.so.6
      #37 0x00007f7f0f264609 in start_thread (arg=<optimized out>) at pthread_create.c:477
      #38 0x00007f7f0f18b293 in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:95
      

      Attachments

        1. bug_7923.test
          0.7 kB
        2. bug_7923-master.opt
          0.2 kB
        3. debug_point.diff
          0.7 kB

        Issue Links

          Activity

            People

              rinat.ibragimov Rinat Ibragimov
              mohit.joshi Mohit Joshi
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - Not Specified
                  Not Specified
                  Logged:
                  Time Spent - 7 hours, 10 minutes
                  7h 10m

                  Smart Checklist