Uploaded image for project: 'Percona Server'
  1. Percona Server
  2. PS-4631

rocksdb.index_merge_rocksdb2 is unstable

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: On Hold
    • Priority: Medium
    • Resolution: Unresolved
    • Affects Version/s: 8.0
    • Fix Version/s: None
    • Component/s: MyRocks
    • Labels:

      Description

      Couple of different failures which are not at all consistent :

       

      CURRENT_TEST: rocksdb.index_merge_rocksdb2
      --- /home/glorch/dev/PS-8.0/percona-server-install-8.0/mysql-test/suite/rocksdb/r/index_merge_rocksdb2.result 2018-07-26 22:59:28.000000000 +0300
      +++ /home/glorch/dev/PS-8.0/percona-server-install-8.0/mysql-test/var/2/log/index_merge_rocksdb2.reject 2018-07-27 00:34:43.734015581 +0300
      @@ -2010,7 +2010,7 @@
       );
       id select_type table partitions  type  possible_keys key key_len ref rows  filtered  Extra
       1  UPDATE  t1  NULL  index NULL  PRIMARY 4 NULL  2 100.00  Using where
      -2  DEPENDENT SUBQUERY  t2  NULL  index_subquery  col_int_key,col_time_key  col_int_key 4 func  1 5.00  Using where
      +2  DEPENDENT SUBQUERY  t2  NULL  index_subquery  col_int_key,col_time_key  col_int_key 4 func  3 2.08  Using where
       UPDATE t1 SET col_time_nokey = 25 
       WHERE (col_varchar_key, col_varchar_nokey) IN ( 
       SELECT col_int_key, col_int_key
      
      mysqltest: Result content mismatch
      

      And an assertion that I do not believe is specific to this test but noting it here anyway. It will likely get tracked in its own issue :

      URRENT_TEST: rocksdb.index_merge_rocksdb2
      mysqltest: In included file ./include/index_merge1.inc at line 342:
      included from /home/glorch/dev/PS-8.0/percona-server-install-8.0/mysql-test/suite/rocksdb/t/index_merge_rocksdb2.test at line 37:
      At line 342: query 'analyze table t2' failed: 2013: Lost connection to MySQL server during query
      
      The result from queries just before the failure was:
      < snip >
      select * from t0 where key1 < 3 or key8 < 2 order by key1;
      key1    key2    key3    key4    key5    key6    key7    key8
      1       1       1       1       1       1       1       1023
      2       2       2       2       2       2       2       1022
      1023    1023    1023    1023    1023    1023    1023    1
      1024    1024    1024    1024    1024    1024    1024    0
      explain
      select * from t0 where key1 < 3 or key8 < 2 order by key1;
      id      select_type     table   partitions      type    possible_keys   key     key_len ref     rows    filtered        Extra
      1       SIMPLE  t0      NULL    index_merge     i1,i8   i1,i8   4,4     NULL    #       100.00  Using sort_union(i1,i8); Using where; Using filesort
      Warnings:
      Note    1003    /* select#1 */ select `test`.`t0`.`key1` AS `key1`,`test`.`t0`.`key2` AS `key2`,`test`.`t0`.`key3` AS `key3`,`test`.`t0`.`key4` AS `key4`,`test`.`t0`.`key5` AS `key5`,`test`.`t0`.`key6` AS `key6`,`test`.`t0`.`key7` AS `key7`,`test`.`t0`.`key8` AS `key8` from `test`.`t0` where ((`test`.`t0`.`key1` < 3) or (`test`.`t0`.`key8` < 2)) order by `test`.`t0`.`key1`
      # 9. Check that index_merge cost is compared to 'index' where possible
      create table t2 like t0;
      insert into t2 select * from t0;
      alter table t2 add index i1_3(key1, key3);
      alter table t2 add index i2_3(key2, key3);
      alter table t2 drop index i1;
      alter table t2 drop index i2;
      alter table t2 add index i321(key3, key2, key1);
      safe_process[30081]: Child process: 30082, exit: 1
      
      
      Server [mysqld.1 - pid: 29982, winpid: 29982, exit: 256] failed during test run
      Server log from this test:
      ----------SERVER LOG START-----------
      2018-07-27T17:05:08.209591Z 0 [Warning] [MY-010099] [Server] Insecure configuration for --secure-file-priv: Data directory is accessible through --secure-file-priv. Consider choosing a different directory.
      2018-07-27T17:05:08.209619Z 0 [Warning] [MY-010101] [Server] Insecure configuration for --secure-file-priv: Location is accessible to all OS users. Consider choosing a different directory.
      2018-07-27T17:05:08.209652Z 0 [System] [MY-010116] [Server] /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld (mysqld 8.0.11-debug) starting as process 29984
      2018-07-27T17:05:10.003393Z 0 [Warning] [MY-010075] [Server] No existing UUID has been found, so we assume that this is the first time that this server has been started. Generating a new UUID: 380e29a6-91bf-11e8-be20-f8633ff37609.
      2018-07-27T17:05:10.006696Z 0 [Warning] [MY-010068] [Server] CA certificate /home/glorch/dev/PS-8.0/percona-server-install-8.0/mysql-test/std_data/cacert.pem is self signed.
      2018-07-27T17:05:10.015168Z 0 [Warning] [MY-011071] [Server] unknown variable 'loose-tokudb-cache-size=512M'
      2018-07-27T17:05:10.094454Z 0 [System] [MY-010931] [Server] /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld: ready for connections. Version: '8.0.11-debug'  socket: '/home/glorch/dev/PS-8.0/percona-server-install-8.0/mysql-test/var/tmp/1/mysqld.1.sock'  port: 13000  Source distribution.
      mysqld: /home/glorch/dev/PS-8.0/percona-server/storage/rocksdb/rocksdb/utilities/transactions/write_prepared_txn_db.cc:391: void rocksdb::WritePreparedTxnDB::RollbackPrepared(uint64_t, uint64_t): Assertion `snapshots.size() == 0' failed.
      17:05:11 UTC - mysqld got signal 6 ;
      This could be because you hit a bug. It is also possible that this binary
      or one of the libraries it was linked against is corrupt, improperly built,
      or misconfigured. This error can also be caused by malfunctioning hardware.
      Attempting to collect some information that could help diagnose the problem.
      As this is a crash and something is definitely wrong, the information
      collection process might fail.
      
      key_buffer_size=8388608
      read_buffer_size=131072
      max_used_connections=1
      max_threads=151
      thread_count=2
      connection_count=1
      It is possible that mysqld could use up to
      key_buffer_size + (read_buffer_size + sort_buffer_size)*max_threads = 67872 K  bytes of memory
      Hope that's ok; if not, decrease some variables in the equation.
      
      Thread pointer: 0x7f1c1001b900
      Attempting backtrace. You can use the following information to find out
      where mysqld died. If you see no messages after this, something went
      terribly wrong...
      stack_bottom = 7f1cc4784d38 thread_stack 0x46000
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(my_print_stacktrace(unsigned char*, unsigned long)+0x55) [0x40dfbbd]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(handle_fatal_signal+0x424) [0x2e3b9ff]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390) [0x7f1cd303e390]
      /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38) [0x7f1cd1733428]
      /lib/x86_64-linux-gnu/libc.so.6(abort+0x16a) [0x7f1cd173502a]
      /lib/x86_64-linux-gnu/libc.so.6(+0x2dbd7) [0x7f1cd172bbd7]
      /lib/x86_64-linux-gnu/libc.so.6(+0x2dc82) [0x7f1cd172bc82]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(rocksdb::WritePreparedTxnDB::RollbackPrepared(unsigned long, unsigned long)+0x7d) [0x7f1c4e8fc855]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(rocksdb::WritePreparedTxn::RollbackInternal()+0x6d8) [0x7f1c4e8f5dbc]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(rocksdb::PessimisticTransaction::Rollback()+0x84) [0x7f1c4e8b01f2]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(myrocks::Rdb_transaction_impl::rollback()+0xa1) [0x7f1c4e2e226d]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(myrocks::Rdb_transaction::commit()+0x39) [0x7f1c4e2df725]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/lib/plugin/ha_rocksdb.so(+0x9749f8) [0x7f1c4e2a99f8]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(ha_commit_low(THD*, bool, bool)+0x1fc) [0x2fb6f0f]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(MYSQL_BIN_LOG::commit(THD*, bool)+0xebf) [0x3cf19d9]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(ha_commit_trans(THD*, bool, bool)+0x7cc) [0x2fb69c0]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(trans_commit_implicit(THD*, bool)+0x17e) [0x2de7885]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld() [0x32153f6]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(Sql_cmd_analyze_table::execute(THD*)+0x189) [0x3215f07]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(mysql_execute_command(THD*, bool)+0x5900) [0x2c9bb50]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(mysql_parse(THD*, Parser_state*)+0x65e) [0x2c9e0e0]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(dispatch_command(THD*, COM_DATA const*, enum_server_command)+0x13a7) [0x2c93bfc]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld(do_command(THD*)+0x484) [0x2c924b5]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld() [0x2e293cf]
      /home/glorch/dev/PS-8.0/percona-server-install-8.0/bin/mysqld() [0x479363a]
      /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f1cd30346ba]
      /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f1cd180541d]
      
      Trying to get some variables.
      Some pointers may be invalid and cause the dump to abort.
      Query (7f1c103606c8): analyze table t2
      Connection ID (thread ID): 8
      Status: NOT_KILLED
      
      The manual page at http://dev.mysql.com/doc/mysql/en/crashing.html contains
      information that should help you find out what is causing the crash.
      Writing a core file
      safe_process[29982]: Child process: 29984, killed by signal: 6
      ----------SERVER LOG END-------------
      

       

        Attachments

          Activity

            People

            • Assignee:
              george.lorch George Lorch
              Reporter:
              george.lorch George Lorch
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0 minutes
                0m
                Logged:
                Time Spent - 2 hours, 30 minutes
                2h 30m