summaryrefslogtreecommitdiff
Commit message (Collapse)AuthorAgeFilesLines
* MDEV-27540 Different OpenSSL versions mix up in build depending on cmake optionspreview-10.8-MDEV-25785-openssl3.0Sergei Golubchik2022-01-201-1/+2
| | | | | list ${OPENSSL_ROOT_DIR}/lib64 explicitly, because cmake below version 3.23.0 won't search there.
* MDEV-25785 Add support for OpenSSL 3.0Vladislav Vaintroub2022-01-208-56/+134
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | Summary of changes - MD_CTX_SIZE is increased - EVP_CIPHER_CTX_buf_noconst(ctx) does not work anymore, points to nobody knows where. The assumption made previously was that (since the function does not seem to be documented) was that it points to the last partial source block. Add own partial block buffer for NOPAD encryption instead - SECLEVEL in CipherString in openssl.cnf had been downgraded to 0, from 1, to make TLSv1.0 and TLSv1.1 possible (according to https://github.com/openssl/openssl/blob/openssl-3.0.0/NEWS.md even though the manual for SSL_CTX_get_security_level claims that it should not be necessary) - Workaround Ssl_cipher_list issue, it now returns TLSv1.3 ciphers, in addition to what was set in --ssl-cipher - ctx_buf buffer now must be aligned to 16 bytes with openssl( previously with WolfSSL only), ot crashes will happen - updated aes-t , to be better debuggable using function, rather than a huge multiline macro added test that does "nopad" encryption piece-wise, to test replacement of EVP_CIPHER_CTX_buf_noconst
* Merge 10.7 into 10.8Marko Mäkelä2022-01-2012-46/+322
|\
| * Merge 10.6 into 10.7Marko Mäkelä2022-01-2012-46/+322
| |\
| | * Merge 10.5 into 10.6Marko Mäkelä2022-01-204-0/+77
| | |\
| | | * MDEV-27550: Disable galera.MW-328DMarko Mäkelä2022-01-201-0/+1
| | | |
| | | * MDEV-27382: OFFSET is ignored when combined with DISTINCTbb-10.5-mdev27382-v2Sergei Petrunia2022-01-193-0/+76
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | A query in form SELECT DISTINCT expr_that_is_inferred_to_be_const LIMIT 0 OFFSET n produces one row when it should produce none. The issue was in JOIN_TAB::remove_duplicates() in the piece of logic that tried to avoid duplicate removal for such cases but didn't account for possible "LIMIT 0". Fixed by making Select_limit_counters::set_limit() change OFFSET to 0 when LIMIT is 0.
| | * | MDEV-27499 fixup: Add a wait to buf_flush_sync()Marko Mäkelä2022-01-191-0/+4
| | | | | | | | | | | | | | | | | | | | | | | | | | | | The test innodb.log_file_size would occasionally fail with an assertion failure !buf_pool.any_io_pending(). Let us wait for the page cleaner thread to become idle already in srv_prepare_to_delete_redo_log_file(), like we used to.
| | * | MDEV-27025: Null merge 10.5 into 10.6Marko Mäkelä2022-01-190-0/+0
| | |\ \ | | | |/
| | | * MDEV-27025 insert-intention lock conflicts with waiting ORDINARY lockbb-10.5-MDEV-27025-deadlockVlad Lesin2022-01-1812-199/+408
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The code was backported from 10.6 bd03c0e51629e1c3969a171137712a6bb854c232 commit. See that commit message for details. Apart from the above commit trx_lock_t::wait_trx was also backported from MDEV-24738. trx_lock_t::wait_trx is protected with lock_sys.wait_mutex in 10.6, but that mutex was implemented only in MDEV-24789. As there is no need to backport MDEV-24789 for MDEV-27025, trx_lock_t::wait_trx is protected with the same mutexes as trx_lock_t::wait_lock. This fix should not break innodb-lock-schedule-algorithm=VATS. This algorithm uses an Eldest-Transaction-First (ETF) heuristic, which prefers older transactions over new ones. In this fix we just insert granted lock just before the last granted lock of the same transaction, what does not change transactions execution order. The changes in lock_rec_create_low() should not break Galera Cluster, there is a big "if" branch for WSREP. This branch is necessary to provide the correct transactions execution order, and should not be changed for the current bug fix.
| | * | MDEV-27025 insert-intention lock conflicts with waiting ORDINARY lockbb-10.6-MDEV-27025-deadlockVlad Lesin2022-01-187-46/+241
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When lock is checked for conflict, ignore other locks on the record if they wait for the requesting transaction. lock_rec_has_to_wait_in_queue() iterates not all locks for the page, but only the locks located before the waiting lock in the queue. So there is some invariant - any lock in the queue can wait only lock which is located before the waiting lock in the queue. In the case when conflicting lock waits for the transaction of requesting lock, we need to place the requesting lock before the waiting lock in the queue to preserve the invariant. That is why we are looking for the first waiting for requesting transation lock and place the new lock just after the last granted requesting transaction lock before the first waiting for requesting transaction lock. Example: trx1 waiting lock, trx1 granted lock, ..., trx2 lock - waiting for trx1 place new lock here -----------------^ There are also implicit locks which are lazily converted to explicit ones, and we need to place the newly created explicit lock to the correct place in a queue. All explicit locks converted from implicit ones are placed just after the last non-waiting lock of the same transaction before the first waiting for the transaction lock. Code review and cleanup was made by Marko Mäkelä.
* | | | MDEV-26519 fixup: GCC 11 -Og -Wmaybe-uninitializedMarko Mäkelä2022-01-201-2/+2
| | | | | | | | | | | | | | | | | | | | | | | | GCC does not understand that the variable have_ndv determines whether the variable ndv_ll is initialized. Let us add a redundant initialization to pacify GCC.
* | | | Merge MDEV-26519: JSON_HB histograms into 10.8preview-10.8-MDEV-26519-json-histogramsSergei Petrunia2022-01-1951-439/+11232
|\ \ \ \
| * | | | Code cleanupSergei Petrunia2022-01-197-28/+14
| | | | |
| * | | | Switch the default histogram_type to still be DOUBLE_PREC_HBSergei Petrunia2022-01-194-3/+4
| | | | | | | | | | | | | | | | | | | | MTR still uses JSON_HB as the default.
| * | | | JSON_HB histogram: represent values of BIT() columns in hex alwaysSergei Petrunia2022-01-193-16/+81
| | | | |
| * | | | MDEV-26901: Estimation for filtered rows less precise ... #4Sergei Petrunia2022-01-196-6/+42
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | In Histogram_json_hb::point_selectivity(), do return selectivity of 0.0 when the histogram says so. The logic of "Do not return 0.0 estimate as it causes a multiply-by-zero meltdown in cost and cardinality calculations" is moved into records_in_column_ranges() where it is one *once* per column pair (as opposed to doing once per range, which can cause the error to add-up to large number when there are many ranges)
| * | | | MDEV-27229: Estimation for filtered rows less precise ... #5Sergei Petrunia2022-01-197-16/+33
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Followup: remove this line from get_column_range_cardinality() set_if_bigger(res, col_stats->get_avg_frequency()); and make sure it is only used with the binary histograms. For JSON histograms, it makes the estimates unnecessarily imprecise.
| * | | | MDEV-27243: Estimation for filtered rows less precise ... #7Sergei Petrunia2022-01-192-0/+27
| | | | | | | | | | | | | | | | | | | | Added a testcase
| * | | | MDEV-27229: Estimation for filtered rows less precise ... #5Sergei Petrunia2022-01-194-55/+148
| | | | | | | | | | | | | | | | | | | | Fix special handling for values that are right next to buckets with ndv=1.
| * | | | Update test resultsSergei Petrunia2022-01-192-18/+18
| | | | |
| * | | | MDEV-27230: Estimation for filtered rows less precise ...Sergei Petrunia2022-01-193-0/+28
| | | | | | | | | | | | | | | | | | | | | | | | | Fix the code in Histogram_json_hb::range_selectivity that handles special cases: a non-inclusive endpoint hitting a bucket boundary...
| * | | | MDEV-27203: Valgrind / MSAN errors in Histogram_json_hb::parse_bucketSergei Petrunia2022-01-192-1/+8
| | | | | | | | | | | | | | | | | | | | In read_bucket_endpoint(), handle all possible parser states.
| * | | | MDEV-26764: JSON_HB Histograms: handle BINARY and unassigned charactersSergei Petrunia2022-01-194-22/+130
| | | | | | | | | | | | | | | | | | | | Encode such characters in hex.
| * | | | More test coverageSergei Petrunia2022-01-193-2/+44
| | | | |
| * | | | MDEV-26519: Improved histogramsSergei Petrunia2022-01-198-51/+576
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Save extra information in the histogram: "target_histogram_size": nnn, "collected_at": "(date and time)", "collected_by": "(server version)",
| * | | | MDEV-26519: Improved histograms: Better error reporting, test coverageSergei Petrunia2022-01-195-0/+107
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Also report JSON histogram load errors into error log, like it is already done with other histogram/statistics load errors. Add test coverage to see what happens if one upgrades but does NOT run mysql_upgrade.
| * | | | Rename histogram_hb_v2 -> histogram_hbSergei Petrunia2022-01-194-69/+69
| | | | |
| * | | | MDEV-26519: Improved histograms: Make JSON parser efficientSergei Petrunia2022-01-197-181/+351
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Previous JSON parser was using an API which made the parsing inefficient: the same JSON contents was parsed again and again. Switch to using a lower-level parsing API which allows to do parsing in an efficient way.
| * | | | MDEV-27062: Make histogram_type=JSON_HB the new defaultSergei Petrunia2022-01-1918-119/+119
| | | | |
| * | | | MDEV-26886: Estimation for filtered rows less precise with JSON histogramSergei Petrunia2022-01-194-29/+84
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | - Make Histogram_json_hb::range_selectivity handle singleton buckets specially when computing selectivity of the max. endpoint bound. (for min. endpoint, we already do that). - Also, fixed comments for Histogram_json_hb::find_bucket
| * | | | MDEV-26911: Unexpected ER_DUP_KEY, ASAN errors, double free detected in ...Sergei Petrunia2022-01-193-2/+39
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | When loading the histogram, use table->field[N], not table->s->field[N]. When we used the latter we would corrupt the fields's default value. One of the consequences of that would be that AUTO_INCREMENT fields would stop working correctly.
| * | | | MDEV-26892: JSON histograms become invalid with a specific (corrupt) value ..Sergei Petrunia2022-01-193-3/+29
| | | | | | | | | | | | | | | | | | | | | | | | | Handle the case where the last value in the table cannot be represented in utf8mb4.
| * | | | MDEV-26849: JSON Histograms: point selectivity estimates are offSergei Petrunia2022-01-198-10/+142
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | .. for non-existent values. Handle this special case.
| * | | | MDEV-26750: Estimation for filtered rows is far off with JSON_HB histogramSergei Petrunia2022-01-193-9/+61
| | | | | | | | | | | | | | | | | | | | | | | | | Fix a bug in position_in_interval(). Do not overwrite one interval endpoint with another.
| * | | | MDEV-26801: Valgrind/MSAN errors in Column_statistics_collected::finish ...Sergei Petrunia2022-01-193-9/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | The problem was introduced in fix for MDEV-26724. That patch has made it possible for histogram collection to fail. In particular, it fails for non-assigned characters. When histogram construction fails, we also abort the computation of COUNT(DISTINCT). When we try to use the value, we get valgrind failures. Switched the code to abort the statistics collection in this case.
| * | | | MDEV-26709: JSON histogram may contain bucketS than histogram_size allowsSergei Petrunia2022-01-193-2889/+2463
| | | | | | | | | | | | | | | | | | | | | | | | | When computing bucket_capacity= records/histogram->get_width(), round the value UP, not down.
| * | | | MDEV-26724 Endless loop in json_escape_to_string upon ... empty stringSergei Petrunia2022-01-196-16/+65
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Part#3: - make json_escape() return different errors on conversion error and on out-of-space condition. - Make histogram code handle conversion errors.
| * | | | Update test resultsSergei Petrunia2022-01-192-2/+2
| | | | |
| * | | | MDEV-26737: Outdated VARIABLE_COMMENT for HISTOGRAM_TYPE in I_S.SYSTEM_VARIABLESSergei Petrunia2022-01-194-2/+15
| | | | | | | | | | | | | | | | | | | | Fix the description
| * | | | MDEV-26710: Histogram field in mysql.column_stats is too shortSergei Petrunia2022-01-1910-13/+13
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Change it to LONGBLOB. Also, update_statistics_for_table() should not "swallow" an error from open_stat_tables.
| * | | | MDEV-26724 Endless loop in json_escape_to_string upon ... empty stringSergei Petrunia2022-01-193-7/+50
| | | | | | | | | | | | | | | | | | | | .. part#2: correctly pass the charset to JSON [un]escape functions
| * | | | MDEV-26595: ASAN use-after-poison my_strnxfrm_simple_internal / ↵Sergei Petrunia2022-01-192-4/+34
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | Histogram_json_hb::range_selectivity Add testcase
| * | | | MDEV-26589: Assertion failure upon DECODE_HISTOGRAM with NULLsSergei Petrunia2022-01-193-0/+40
| | | | | | | | | | | | | | | | | | | | | | | | | Item_func_decode_histogram::val_str should correctly set null_value when "decoding" JSON histogram.
| * | | | MDEV-26724 Endless loop in json_escape_to_string upon ... empty stringSergei Petrunia2022-01-193-2/+28
| | | | | | | | | | | | | | | | | | | | Correctly handle empty string when [un]escaping JSON
| * | | | MDEV-26711: Values in JSON histograms are not properly quotedSergei Petrunia2022-01-196-80/+608
| | | | | | | | | | | | | | | | | | | | Escape values when serializing to JSON. Un-escape when reading back.
| * | | | Use JSON_NAME, not the "histogram_hb_v2" constantSergei Petrunia2022-01-192-3/+3
| | | | |
| * | | | More "straightforward" memory managementSergei Petrunia2022-01-192-3/+5
| | | | | | | | | | | | | | | | | | | | Do not put Histogram objects on MEM_ROOT at all
| * | | | Fix off-by-one error in Histogram_json_hb::find_bucketSergei Petrunia2022-01-194-13/+70
| | | | |
| * | | | MDEV-26590: Stack smashing/buffer overflow in Histogram_json_hb::parseSergei Petrunia2022-01-193-8/+36
| | | | | | | | | | | | | | | | | | | | Provide buffer of sufficient size.