summaryrefslogtreecommitdiff
path: root/storage/rocksdb/rdb_datadic.cc
Commit message (Collapse)AuthorAgeFilesLines
* cleanup: make dd_frm_type to work as documentedSergei Golubchik2020-07-041-2/+1
| | | | remove redundant argument, return all possible enum values
* MDEV-21831: Assertion `length == pack_length()' failed in ↵Varun Gupta2020-06-111-1/+3
| | | | | | | | Field_inet6::sort_string upon INSERT into RocksDB table For INET6 columns the values are stored as BINARY columns and returned to the client in TEXT format. For rocksdb the indexes store mem-comparable images for columns, so use the pack_length() to store the mem-comparable form for INET6 columns. This would also remain consistent with CHAR columns.
* MDEV-22434 UPDATE on RocksDB table with WITHOUT OVERLAPS failsNikita Malyavin2020-06-051-3/+4
| | | | | | | | | | | | | | | | | | | | Insert worked incorrect as well. RocksDB used table->record[0] internally to store some intermediate results for key conversion, during index searching among other operations. So table->record[0] is spoiled during ha_rnd_index_map in ha_check_overlaps, so in turn the broken record data was inserted. The fix is to store RocksDB intermediate result in its own buffer instead of table->record[0]. `rocksdb` MTR suite is is checked and runs fine. No need for additional tests. The existing overlaps.test covers the case completely. However, I am not going to add anything related to rocksdb to suite, to keep it away from additional dependencies. To run tests with RocksDB engine, one can add following to engines.combinations: [rocksdb] plugin-load=$HA_ROCKSDB_SO default-storage-engine=rocksdb rocksdb
* MDEV-22641: Provide SIMD optimized wrapper for zlib crc32() (#1558)mysqlonarm2020-06-011-4/+5
| | | | | | | | | | | | | | | | | | | | | | Existing implementation used my_checksum (from mysys) for calculating table checksum and binlog checksum. This implementation was optimized for powerpc only and lacked SIMD implementation for x86 (using clmul) and ARM (using ACLE) instead used zlib-crc32. mariabackup had its own copy of the crc32 implementation using hardware optimized implementation only for x86 and lagged hardware based implementation for powerpc and ARM. Patch helps unifies all such calls and help aggregate all of them using an unified interface my_checksum(). Said unification also enables hardware optimized calls for all architecture viz. x86, ARM, POWERPC. Default always fallback to zlib crc32. Thanks to Daniel Black for reviewing, fixing and testing PowerPC changes. Thanks to Marko and Daniel for early code feedback.
* MDEV-21743 Split up SUPER privilege to smaller privilegesAlexander Barkov2020-03-101-1/+1
|
* perfschema memory related instrumentation changesSergei Golubchik2020-03-101-4/+4
|
* Merge 10.4 into 10.5Marko Mäkelä2020-02-071-1/+2
|\
| * Fixed compiler warnings from gcc 7.4.1Monty2020-01-291-1/+2
| | | | | | | | - Fixed possible error in rocksdb/rdb_datadic.cc
* | MDEV-21581 Helper functions and methods for CHARSET_INFOAlexander Barkov2020-01-281-16/+17
|/
* MDEV-17171: RocksDB Tables do not have "Creation Date"Sergei Petrunia2019-11-011-1/+1
| | | | | | | | | | - Add SLEEP() calls to the testcase to make it really test that the time doesn't change. - Always use .frm file creation time as a creation timestamp (attempts to re-use older create_time when the table DDL changes are not good because then create_time will change after server restart) - Use the same method names as the upstream patch does - Use std::atomic for m_update_time
* MDEV-17171: RocksDB Tables do not have "Creation Date"bb-10.3-MDEV-17171Sergei Petrunia2019-11-011-0/+20
| | | | | | Variant#5 of the patch: - take creation date from the .frm file, like InnoDB does - Update_time is in-memory only (like in InnoDB).
* Merge 10.2 into 10.3Marko Mäkelä2019-07-021-912/+988
|\
| * MyRocks: dont show read-Free replication variablesSergei Petrunia2019-06-201-0/+4
| | | | | | | | | | | | | | | | MariaDB doesn't support Read-Free replication, so showing them only causes confusion. Removed variables: - @@rocksdb_read_free_rpl - @@rocksdb_read_free_rpl_tables
| * Merge from MyRocks upstream:Sergei Petrunia2019-06-161-912/+984
| |\ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Copy of commit dcd9379eb5707bc7514a2ff4d9127790356505cb Author: Manuel Ung <mung@fb.com> Date: Fri Jun 14 10:38:17 2019 -0700 Skip valgrind for rocksdb.force_shutdown Summary: This test does unclean shutdown, and leaks memory. Squash with: D15749084 Reviewed By: hermanlee Differential Revision: D15828957 fbshipit-source-id: 30541455d74
| | * Copy ofSergei Petrunia2019-06-151-907/+982
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | commit dcd9379eb5707bc7514a2ff4d9127790356505cb Author: Manuel Ung <mung@fb.com> Date: Fri Jun 14 10:38:17 2019 -0700 Skip valgrind for rocksdb.force_shutdown Summary: This test does unclean shutdown, and leaks memory. Squash with: D15749084 Reviewed By: hermanlee Differential Revision: D15828957 fbshipit-source-id: 30541455d74
* | | Merge branch '10.2' into 10.3Sergei Golubchik2019-03-171-4/+4
|\ \ \ | |/ /
| * | post-merge: gcc 8 warningsSergei Golubchik2019-03-151-4/+4
| | | | | | | | | | | | | | | | | | | | | note: Inherit String from Sql_alloc, to get operators new and new[] in sync in rocksdb gcc was complaining that non-lvalue was cast to const.
* | | Merge 10.2 into 10.3Marko Mäkelä2018-11-061-1/+1
|\ \ \ | |/ / | | | | | | | | | | | | | | | | | | | | | main.derived_cond_pushdown: Move all 10.3 tests to the end, trim trailing white space, and add an "End of 10.3 tests" marker. Add --sorted_result to tests where the ordering is not deterministic. main.win_percentile: Add --sorted_result to tests where the ordering is no longer deterministic.
| * | MDEV-14267: correct FSF addressDaniel Black2018-10-301-1/+1
| | |
* | | Merge 10.2 into 10.3Marko Mäkelä2018-09-061-2/+4
|\ \ \ | |/ /
| * | Merge branch 'merge-myrocks' of github.com:MariaDB/mergetrees into ↵Sergei Petrunia2018-08-281-2/+4
| |\ \ | | |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | bb-10.2-mariarocks-merge Move up-to this revision in the upstream: commit de1e8c7bfe7c875ea284b55040e8f3cd3a56fcc2 Author: Abhinav Sharma <abhinavsharma@fb.com> Date: Thu Aug 23 14:34:39 2018 -0700 Log updates to semi-sync whitelist in the error log Summary: Plugin variable changes are not logged in the error log even when log_global_var_changes is enabled. Logging updates to whitelist will help in debugging. Reviewed By: guokeno0 Differential Revision: D9483807 fbshipit-source-id: e111cda773d
| | * Copy ofSergei Petrunia2018-08-281-2/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | commit de1e8c7bfe7c875ea284b55040e8f3cd3a56fcc2 Author: Abhinav Sharma <abhinavsharma@fb.com> Date: Thu Aug 23 14:34:39 2018 -0700 Log updates to semi-sync whitelist in the error log Summary: Plugin variable changes are not logged in the error log even when log_global_var_changes is enabled. Logging updates to whitelist will help in debugging. Reviewed By: guokeno0 Differential Revision: D9483807 fbshipit-source-id: e111cda773d
* | | Merge branch 'github/10.2' into 10.3Sergei Golubchik2018-05-221-0/+3
|\ \ \ | |/ /
| * | MDEV-15304: Server crash in print_keydup_error / key_unpack or unexpected ↵Sergei Petrunia2018-05-181-0/+3
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | ER_DUP_KEY Fix two issues: 1. Rdb_ddl_manager::rename() loses the value of m_hidden_pk_val. new object used to get 0, which means "not loaded from the db yet". 2. ha_rocksdb::load_hidden_pk_value() uses current transaction (and its snapshot) when loading hidden PK value from disk. This may cause it to load an out-of-date value.
* | | Merge 10.2 into 10.3Marko Mäkelä2018-05-121-10/+186
|\ \ \ | |/ /
| * | Merge branch 'bb-10.2-mariarocks-merge' of github.com:MariaDB/server into 10.2Sergei Petrunia2018-05-071-10/+186
| |\ \ | | | | | | | | | | | | Manually resolved the conflicts
| | * \ Merge from merge-myrocks:Sergei Petrunia2018-01-271-10/+186
| | |\ \ | | | |/ | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | commit 445e518bc7aa5f4bb48d98e798905c9c0b0ce673 Author: Sergei Petrunia <psergey@askmonty.org> Date: Sat Jan 27 10:18:20 2018 +0000 Copy of commit f8f364b47f2784f16b401f27658f1c16eaf348ec Author: Jay Edgar <jkedgar@fb.com> Date: Tue Oct 17 15:19:31 2017 -0700 Add a hashed, hierarchical, wheel timer implementation Summary: In order to implement idle timeouts on detached sessions we need something inside MySQL that is lightweight and can handle calling events in the future wi By default the timers are grouped into 10ms buckets (the 'hashed' part), though the size of the buckets is configurable at the creation of the timer. Eac Reviewed By: djwatson Differential Revision: D6199806 fbshipit-source-id: 5e1590f
| | | * Copy ofSergei Petrunia2018-01-271-10/+186
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | commit f8f364b47f2784f16b401f27658f1c16eaf348ec Author: Jay Edgar <jkedgar@fb.com> Date: Tue Oct 17 15:19:31 2017 -0700 Add a hashed, hierarchical, wheel timer implementation Summary: In order to implement idle timeouts on detached sessions we need something inside MySQL that is lightweight and can handle calling events in the future with very little cost for cancelling or resetting the event. A hashed, hi By default the timers are grouped into 10ms buckets (the 'hashed' part), though the size of the buckets is configurable at the creation of the timer. Each wheel (the 'wheel' part) maintains 256 buckets and cascades to the whe Reviewed By: djwatson Differential Revision: D6199806 fbshipit-source-id: 5e1590f
* | | | Merge 10.2 into 10.3Marko Mäkelä2018-04-231-4/+4
|\ \ \ \ | |/ / /
| * | | MyRocks: MDEV-15911: Reduce debug logging on default levels in error logSergei Petrunia2018-04-191-4/+4
| | | | | | | | | | | | | | | | | | | | | | | | MyRocks internally will print non-critical messages to sql_print_verbose_info() which will do what InnoDB does in similar cases: check if (global_system_variables.log_warnings > 2).
* | | | Merge branch 'bb-10.2-ext' into 10.3Sergei Golubchik2018-02-231-1/+1
|\ \ \ \
| * \ \ \ Merge branch '10.2' into bb-10.2-extSergei Golubchik2018-02-221-1/+1
| |\ \ \ \ | | |/ / /
| | * | | fix compilation wih -DPLUGIN_PARTITION=NOSergei Golubchik2018-02-221-1/+1
| | |/ / | | | | | | | | | | | | rocksdb and spider
* | | | Merge bb-10.2-ext into 10.3Marko Mäkelä2018-01-131-1/+26
|\ \ \ \ | |/ / /
| * | | Merge 10.2 into bb-10.2-extMarko Mäkelä2018-01-131-1/+26
| |\ \ \ | | |/ /
| | * | MDEV-14372: Fix and enable rocksdb.information_schema testSergei Petrunia2018-01-121-1/+26
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Make Rdb_binlog_manager::unpack_value to not have a stack overrun when it is reading invalid data (which it currently does as we in MariaDB do not store binlog coordinates under BINLOG_INFO_INDEX_NUMBER, see comments in MDEV-14892 for details). - We may need to store these coordinates in the future, so instead of removing the call of this function, let's make it work properly for all possible inputs.
* | | | Merge bb-10.2-ext into 10.3Marko Mäkelä2018-01-041-1/+2
|\ \ \ \ | |/ / /
| * | | Merge remote-tracking branch 'origin/10.2' into bb-10.2-extMonty2018-01-011-1/+2
| |\ \ \ | | |/ / | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Conflicts: cmake/make_dist.cmake.in mysql-test/r/func_json.result mysql-test/r/ps.result mysql-test/t/func_json.test mysql-test/t/ps.test sql/item_cmpfunc.h
| | * | Removed curr_bitmap_pos++ from possible macroMonty2017-12-281-1/+2
| | | |
* | | | Merge bb-10.2-ext into 10.3Marko Mäkelä2017-12-191-1/+1
|\ \ \ \ | |/ / /
| * | | Merge 10.2 into bb-10.2-extMarko Mäkelä2017-12-191-1/+1
| |\ \ \ | | |/ /
| | * | MDEV-14293: MyRocks lacks basic functionalitySergei Petrunia2017-12-151-1/+1
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The error "Unsupported collation on string indexed column %s Use binary collation (latin1_bin, binary, utf8_bin)." is misleading. Change it: - It is now a warning - It is printed only for collations that do not support index-only access (reversible collations that use unpack_info are ok) - The new warning text is: Indexed column %s.%s uses a collation that does not allow index-only access in secondary key and has reduced disk space efficiency in primary key.
* | | | Merge remote-tracking branch 'origin/bb-10.2-ext' into 10.3Alexander Barkov2017-10-301-58/+328
|\ \ \ \ | |/ / / | | | | | | | | TODO: enable MDEV-13049 optimization for 10.3
| * | | Merge remote-tracking branch 'origin/10.2' into bb-10.2-extAlexander Barkov2017-10-301-4/+7
| |\ \ \ | | |/ /
| | * | Merge branch 'bb-10.2-mariarocks' of github.com:MariaDB/server into 10.2Sergei Petrunia2017-10-131-4/+7
| | |\ \ | | | | | | | | | | | | | | | | | | | | Conflicts: storage/rocksdb/ha_rocksdb.cc
| | | * | Enable basic XA between MyRocks and the binlogSergei Petrunia2017-08-251-4/+7
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | This allows basic master crash-safety - Un-comment and update relevant parts of the code - Make rocksdb_rpl suite work like other MyRocks testsuites (load the MyRocks plugin, don't start if it is not compiled in, etc) - For now, disable all tests in the rocksdb_rpl suite. - MariaDB-fication of rpl_rocksdb_2p_crash_recover test.
| * | | | Merge remote-tracking branch 'origin/10.2' into bb-10.2-extAlexander Barkov2017-10-181-54/+321
| |\ \ \ \ | | |/ / /
| | * | | Merge branch '10.2' of github.com:MariaDB/server into bb-10.2-mariarocks-mergeSergei Petrunia2017-09-191-0/+1
| | |\ \ \ | | | |/ /
| | * | | Merge mergetrees/merge-myrocks into bb-10.2-mariarocks-mergeSergei Petrunia2017-09-181-349/+1190
| | |\ \ \ | | | | |/ | | | |/| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Upstream cset we are merging from: commit 184a4a2d82f4f6f3cbcb1015bcdb32bebe73315c Author: Abhinav Sharma <abhinavsharma@fb.com> Date: Thu Sep 14 11:40:08 2017 -0700 Bump rocksdb submodule Summary: Bump rocksdb to include the fix for rocksdb.trx_info_rpl Lots of conflicts, got the code to compile but tests are likely to be broken
| | | * | Copy ofSergei Petrunia2017-09-151-43/+314
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | commit 184a4a2d82f4f6f3cbcb1015bcdb32bebe73315c Author: Abhinav Sharma <abhinavsharma@fb.com> Date: Thu Sep 14 11:40:08 2017 -0700 Bump rocksdb submodule Summary: Bump rocksdb to include the fix for rocksdb.trx_info_rpl The bug was introduced in: https://github.com/facebook/rocksdb/pull/2850 Fixed in: https://github.com/facebook/rocksdb/pull/2881 update-submodule: rocksdb Reviewed By: lth Differential Revision: D5834658 fbshipit-source-id: d1551bf