Details
Description
1. Update rocksdb submodule to 2becafdb43ac2ddced7d4bffec9407b9b89fd2df Fix Appveyor build due to signed/unsigned comparison (v5.8-1846-g2becafdb4)
2. Add new MyRocks variables `rocksdb_delete_cf`, `rocksdb_enable_iterate_bounds`, and `rocksdb_enable_remove_orphaned_dropped_cfs`.
3. Port previously skipped `Support deletion of unused column family from RocksDB` at https://github.com/facebook/mysql-5.6/commit/43a78199188ce46c857e420ab6ed75f8c6b0c9c8
4. Cherry-pick the following commits from `fb-prod201907`:
- 8e61d49c8b81b448d02cf1e4b1a048e1ab78d982 Update rocksdb to latest to include a warning as error fix for platform007
- 14da110d7f97fe6fa28364e21bc3257db8ba0bc2 More robust consistent_snapshot test cases
- 876d9a3fafe36d0cf6b285b1496f1de94eb89739 Change column family handle to shared_ptr and remove metadata for dropping column family and index
- 93871bf0a3d70fdc930f3cf05053398aaaa5bf9f Stress test for delete unused column family feature
- 691f10569685c56eb78eb78f438326b5a88b8a82 Fixed failing tests rocksdb.cons_snapshot_read_committed and rocksdb.cons_snapshot_repeatable_read.
- 8d1e178d8633a81354bd920c08d3f2c103f91303 rocksdb_stress load generator should use SIGKILL to crash the server
- 371194ff674766d0cc1feea9db3cb368864dc3a3 Update rocksdb submodule and switch to gtest-1.8.1 in MyRocks as well to be in sync (#1048)
- 27ccf9eaa57a282dd010c724e9965966b5bcdd07 Fix rocksdb.cons_snapshot_read_committed and rocksdb.cons_snapshot_repeatable_read
- 00672f96b696aecc1de8481e6c04635cdf28cd20 Issue #1044: rocksdb.ttl_primary_read_filtering fails sporadically (#1045)
- 2b1e7918066a967b3a48fe486e5687d786aee052 #1052: ha_rocksdb::records_in_range() vastly overestimates #rows (#1053)
- d0e38cfe94c37b7f2aa59c59c4206dfd2134cd57 Add a switch to toggle rocksdb iterator bounds
- bff48951ac1a9f72ab34c9d252decae5972c1458 Add execution time report for startup
6. Null cherry-picked upstream commits:
- 368d6483c834e93f9da479c1605d4c965b32b0a2 support for exposing admin in user_statistics and adding user_table_statistics
- a3a3dde721b2ac7fca042889cd9f730c665b6870 Revert "support for exposing admin in user_statistics and adding user_table_statistics"
- 9a595a5048d243cc9ebe28042f6d049fd1bf9e8b Fix insert duplicate key race condition
- f5d3989963a7de38deb4cdeca0a54dae9ad9898d slave high priority DDL
- 42ee382420d3c7941f8290ceb45f07e031475123 support for exposing admin in user_statistics and adding user_table_statistics
- 9cc07bf07a97b1d746f9b708c1f49ba55e2c0faa Use column names while applying row changes on slaves
- 8d2480dea549973a48eca25cf87811f4ba015227 Move Rdb_cf_manager lock to private interface.
- f26a184207651034e3935dbe60b99840936c395a MySQL Bypass Change #3 - Query Execution
- ee927e5b8235b77bacfd14cccddead7573d1e07a Make rocksdb.race_duplicate_insert_update stable
- d97c0c628e5dc60abd725f6a7120a8d87b09321e Fix bypass bug in prefix decoding optimization
- ff587c3faa4091fc8866f159c1dfa7c0f114c075 Fix bypass bug in unpack info
- 58edf5a8b41ff243512d7af6acd721280696fb7a Fix flaky testcase rocksdb_rpl.rpl_gtid_crash_safe_wal_corrupt
- 9b7f226385031c3237977b9ec2971cb883b6e50a Fix rocksdb_rpl.rpl_crash_safe_wal_corrupt test
- 182d59c4ecc565658af4b8917835c8a8d95bb36f copy truncated binlog file to tmp dir
- 90f0fbf7e6738729df099374f0d511b81b121d34 Correctly updating the before image inconsistency counter
- 45110dcda266b5cdbdb4324429ae29225a9fee49 Issue790: MultiGet-MRR implementation (#1041)
- be12c8cfb444e21e434efb83d4ff26b812785181 Stabilize rocksdb.rocksdb_mrr
- 235efc6a085185a636958d5df79b31598e7da255 Fix keycache UBSan error
- 8024dee0fb76cbc27e179708ab6bd6b5464dd450 Mysqladmin crash with extended-status
- df15d9b81553603a2eda8f4e0707f3342ba979a2 Revert back to hhvm for mysql repo
- 03919677cb5bf34997e13c384b44dc3cccd41be9 make insert_duplicate_key_update_race test more stable
- 2c2afd33a50a68a2949257d5a17d18f8a828a5c1 make innodb.insert_duplicate_key_update_race more stable
- 765e30dc1582d3258b8b86355a7cffd5c4632557 Better acl lookup
- 80b1959c5899f1c508613fec628b554a6f9fd5f8 Pulling value of RBR column mismatch whitelist from the rli object
- 192a407952716bcd957ca365039a10e1907ad5bb update .jfconfig to support jf submit
- a594fdee8bdb6c0859526ae1d00151717ee0e8f7 update .jfconfig file to pass more info for MySQL 5.6
- 80239b6c7b04acfa8376ddf198828fcb6b98f3ae add skip master info for read_only_msg_extra
- 1835cbc5f549c9bad0a22e24a04cae6e52cabdda Small fix in rpl_wait_for_semi_sync_ack when binlog name exceeds 999999
- 1c40506d15edf5a4f24533c4bbc28ad8c6e60e6c Fixing file pos comparison in signal_semi_sync_ack()
- c29cc2c0315e489bf8c94fe8d97ef6b5d482fb4e Removing unnecessary lambda in signal_semi_sync_ack()
- b840ad762493475075eef9e3f787360b67deca0a support high precision time in show processlist (I_S.processlist)
- 056c8ccc94651aef9b767306cb67f7f9bce601bc Amend the user_table_statistics diff to check aux user connections have been setup
- cfd9b938f5708b999f6992ce8bad3668b799543a let rpl_repl_slave_acl can use binlog
- d6452f0288c956a841d6a5ba255fd6e8bb37f252 fix MTS when HLC is enabled
- e6a4851729b2de23c23fe21c7ce46a61174f842d let admin_port + repl_slave bypass read only database
- 130c294f977677d657068c5abed5fd17be91a97e make sys_vars.all_vars more robust
- 1b23696758d3675350004f7de8536bbf48aa196d Fix corruption caused by CONCAT function
- f2943211bafdb803c94c83806faffd02a323fe41 Remove temporily workaround for using legacy HHVM
- 7bdd211c8eb75740dc881289ef3b3514235f432c Log a error line in flush stage
- b90a32737728b188fbe81e8f2f8b2dc71e349bf1 add ability to track per-database applied hlc
- 5de8b6865532aa8c98e7101db80c252f11211616 Fix bug with COM_RESET_CONNECTION not respecting CLIENT_INTERACTIVE
- ce2f22a8bdd78895d796087b3d09e244a324358f Add an option to mysqlbinlog to abort if invalid events are found on in-use binlogs
- fb2c08ec48daab3a202a0f56a1116cbb06b9322e Abort trxs during idempotent recovery if table doesn't have primary key
- d6201cb2147dba00753da3c42e93f2ac518790ed Fix rpl_recovery.rpl_slave_recovery_with_binlog_checksum
- 8e4765845c510e04777d00a663717e2292aa6831 Extend repal_slave + admin_port to set gtid_next when repaly binlog
- ec039b1a46a69424ecd2b54637399ca2dd6c0e25 handle binlog trimming across file rotation
- d5453bd0ec73c8a876ecb936b5951eb8a4fd6e1e conditionally include mysqld.build_info.cc into mysqld binary
- 8ea1a0591114cab84fdbac90449d03e518501d90 Bug fix: non super admin user connecting to admin port should not be refused by max_nonsuper_connections
- d4d2407ad8c063b7ad890a0552ebaa379f197bf6 Add .clangd to .gitignore
- 8ee8ebe333f2347d56b1ba8292ba86be4edef6cb Can't change ownership of the file during trim binlog
- 9a78c0dbfaeaedfa4412db1ee22ca023809e7064 Ignore blackhole engine tables in idempotent recovery PK check
- 94d516b043ec637a19d3c18e4deeba2c313044ab Fixing rpl_slave_idempotent_recovery_no_pk
- f0c1a59ff2a96975c45fd32e1c7e478a7397e98a wait_for_dep_workers_to_finish should return error
- 716ca07bd5f603d01ae7aaa9802215605056339b Query Normalization and SQL Statistics
- 9420260b936811587e171f615048f20e4d9b1b33 fix failure to start
- 89418a010c0c59dc1f49ad1c0c7f9065c94683cc Static link zstd with xtrabackup as libzstd.so will be removed in platform007
- d65a5629b00bce6610585b2241bb6f7ba09e0257 Track sql statistics for client attributes
- 2fd17e2c8973252b5b93b6c05022bff77adaf07c fix the error code when trying to drop non-existent partitions
- 9451944890fb871c3306fd96cbf52809d28dc23d Clearing coordinator's mem root on every end event
Attachments
Issue Links
- causes
-
PS-6974 Correct instability in the rocksdb.drop_cf_* tests
-
- Done
-
-
PS-6951 Document RocksDB variables: rocksdb_delete_cf, rocksdb_enable_iterate_bounds, and rocksdb_enable_remove_orphaned_dropped_cfs
-
- Done
-
- has to be done after
-
PS-6868 Merge fb-prod201906
-
- Done
-
- relates to
-
-
- On Hold
-
