Previously, for a user to access definitions of routines the user did not define, the user was required to have the global SELECT privilege, which is very broad. The new SHOW_ROUTINE privilege may be granted instead as a privilege with a more restricted scope that permits access to routine definitions. (That is, an administrator can rescind global SELECT from users that do not otherwise require it and grant SHOW_ROUTINE instead.) This enables an account to back up stored routines without requiring a broad privilege.

SHOW_ROUTINE provides access to:

For upgrades from an older version of MySQL, any user who has the global SELECT privilege is granted SHOW_ROUTINE, if there is not already some user who has SHOW_ROUTINE. (WL #9049)

Solaris: Clang and GCC now can be used for compiling MySQL on Solaris, although both are experimental and cannot currently be used for production code. (Bug #30562248)

On EL7 and EL8, CMake configuration was adjusted to look for GCC 9 before GCC 8. Because libmysqlclient ships with MySQL distributions, client applications built against libmysqlclient on those platforms are affected and may need to be recompiled. (Bug #30722756)

On Windows, the CMake compiler-version check for Visual Studio was updated to indicate that Visual Studio 2019 is the currently supported version. (The version check can be bypassed by running CMake with -DFORCE_UNSUPPORTED_COMPILER=1.) (Bug #30688403)

JSON: Previously, it was possible to specify ON EMPTY and ON ERROR clauses in either order when invoking the JSON_TABLE() function. This runs counter to the SQL standard, which stipulates that when ON EMPTY is specified, it must always come before any ON ERROR clause. For this reason, specifying ON ERROR before ON EMPTY is now deprecated, and trying to do so causes the server to issue a warning. Support for the nonstandard syntax will be removed in a future version of MySQL. (WL #13512)

The max_length_for_sort_data system variable is now deprecated due to optimizer changes that make it obsolete and of no effect. (WL #13600)

References: See also: Bug #30473261.

The use of VALUES() to access new row values in INSERT ... ON DUPLICATE KEY UPDATE statements is now deprecated, and is subject to removal in a future MySQL release. Instead, you should use aliases for the new row and its columns as implemented in MySQL 8.0.19 and later.

For example, the statement shown here uses VALUES() to access new row values:

INSERT INTO t1 (a,b,c) VALUES (1,2,3),(4,5,6)
  ON DUPLICATE KEY UPDATE c=VALUES(a)+VALUES(b);

Henceforth, you should instead use a statement similar to the following, which uses an alias for the new row:

INSERT INTO t1 (a,b,c) VALUES (1,2,3),(4,5,6) AS new
  ON DUPLICATE KEY UPDATE c = new.a+new.b;

Alternatively, you can employ aliases for both the new row and each of its columns, as shown here:

INSERT INTO t1 (a,b,c) VALUES (1,2,3),(4,5,6) AS new(m,n,p)
  ON DUPLICATE KEY UPDATE c = m+n;

For more information and examples, see INSERT ... ON DUPLICATE KEY UPDATE Statement. (WL #13325)

The rapidjson library included with MySQL has been upgraded to the GitHub snapshot of 16 January 2020. A fix for a compiler error encountered when building from the snapshot on Mac OS X has been added. (Bug #30898701)

Sending a SIGHUP signal to the server no longer causes it to write a status report to the error log. Other actions performed by the server in response to SIGHUP continue to be done. See Unix Signal Handling in MySQL.

Similarly, mysqladmin debug no longer causes the status report to be written. (Bug #30578923)

The log_sink_json JSON-format error log sink now includes a ts (timestamp) in log messages. The value is an integer indicating milliseconds since the epoch ('1970-01-01 00:00:00' UTC). See Error Log Output Format. (WL #13786)

Hash joins are now used any time a nested block loop would be employed. This means that hash joins can be used for the following types of queries:

This builds on work done for MySQL 8.0.18, and removes a limitation in the implementation such that a hash join could be used only with a query having at least one equi-join condition. In addition, both inner and outer joins (including semijoins and antijoins) can now employ batched key access (BKA), which allocates join buffer memory incrementally so that individual queries need not use up large amounts of resources that they do not actually require for resolution. For more information, see Batched Key Access Joins.

This fix completes the task of replacing the executor used in previous versions of MySQL with the iterator executor, including replacement of the old index subquery engines that governed queries of the form WHERE value IN (SELECT column FROM table WHERE condition) for those IN queries which have not been converted into semijoins, as well as queries materialized into the same form, which depended on internals from the old executor.

For more information and examples, see Hash Join Optimization. (Bug #30528604, Bug #30473261, Bug #30912972, WL #13377, WL #13476)

This release implements several new index-level optimizer hints, which function much like existing index hints that employ SQL keywords such as FORCE INDEX and IGNORE INDEX. These are intended to replace the equivalent index hints, which will be deprecated in a future MySQL release (and eventually removed). The new hints are listed here, along with a brief description of each:

Consider the following query using index hints on a table having the indicated columns and index:

SELECT a,b FROM t1 USE INDEX FOR ORDER BY (i_ab) ORDER BY a;

Using the index-level optimizer hints introduced in this release, this query can be rewritten as shown here:

SELECT /*+ ORDER_INDEX(t1 i_ab) */ a,b FROM t1 ORDER BY a;

The new index-level optimizer hints can be used with SELECT, UPDATE, and DELETE statements. (This is unlike index hints using FORCE INDEX or IGNORE INDEX, which can be used only with SELECT and UPDATE.) Thus, statements like the following are possible:

UPDATE /*+ INDEX(t1 i_ab) */ t1 SET d = 1
    WHERE a = 1 AND b = 2 AND c = 3;

DELETE /*+ INDEX(t1 i_a,i_c) */ FROM t1
    WHERE a = 1 AND b = 2 AND c = 3;

Multiple hints can be specified within the same comment, like this:

DELETE /*+ INDEX(t1 i_a) JOIN_INDEX(t1 i_c) */
    FROM t1 WHERE a = 1 AND b = 2 AND c = 3;

Index-level optimizer hints can be used concurrently with other optimizer hints. When you do so, the index-level hints apply first; the effects of any other optimizer hints are limited to the set of indexes permitted by the index-level hints.

Index-level hints can also be used when creating views, as shown here:

CREATE VIEW v1 AS
    SELECT /*+ NO_INDEX(t1 i_a,i_b) */ a FROM t1
    WHERE b IN
        (SELECT /*+ NO_INDEX(t1 i_ab,i_b) */ a FROM t1 WHERE a > 3)
    ORDER BY a;

If these index-level optimizer hints are used in the same statement as index hints, the index hints are ignored.

The new index-level optimizer hints are equivalent to FORCE INDEX rather than USE INDEX; in other words, using one or more of the index-level optimizer hints means that a table scan is used only if there is no way to use one of the named indexes to find rows in the table. To cause MySQL to use the same index or set of indexes as with a given instance of USE INDEX, you can use NO_INDEX, NO_JOIN_INDEX, NO_GROUP_INDEX, NO_ORDER_INDEX, or some combination of these.

For more information and examples, see Index-Level Optimizer Hints. (WL #13538)

Binary packages that include curl rather than linking to the system curl library have been upgraded to use curl 7.69.0. (Bug #30866333)

For RPM packages, the comp_err utility has been moved to the -test subpackage and marked as a test component. (Bug #30716034)

The bundled libedit library was upgraded to version 3.1. (Bug #28939380, Bug #20770875, Bug #22930525, Bug #22332089, Bug #27433491, Bug #27285445, WL #13534)

The bundled LZ4 library was upgraded to version 1.9.2. This fixes certain issues such as Bug #30369643 producing a mysqlpump runtime error. (WL #13690)

References: See also: Bug #30369643.

The Performance Schema collected session-related statistics for errors that can occur only globally and not per session. This is no longer done, reducing memory overhead for error instrumentation. Additionally, rows for global errors are no longer included in error summaries reported per thread, account, user, or host. (Bug #30311574)

An LDAP server can be configured to delegate LDAP searches to another LDAP server, a functionality known as LDAP referral. However, enabling LDAP referral can cause searches to fail with LDAP operation errors under certain conditions. To enable the MySQL Enterprise Edition LDAP authentication plugins to avoid referral errors, the new authentication_ldap_simple_referral and authentication_ldap_sasl_referral system variables are available. These variables enable each plugin to control whether the LDAP server should use referral during MySQL authentication. See LDAP Search Referral. (WL #12888)

The MySQL Enterprise Edition SASL LDAP authentication plugin now supports GSSAPI/Kerberos as an authentication method for MySQL clients and servers on Linux. This is useful in Linux environments where applications access LDAP using Microsoft Active Directory, which has Kerberos enabled by default. See LDAP Authentication Methods.

This feature is available for all RPM and DEB packages for Linux, but not for the TAR archive packages. (WL #12888)

Previously, the INTO clause for SELECT statements could appear at either of two positions:

INTO now can appear in a third position, at the end of SELECT statements:

SELECT * FROM table_name FOR UPDATE INTO OUTFILE 'file_name';

Placing INTO at the end is the preferred position. The position before a locking clause is now deprecated and support for it will be removed in a future MySQL version. In other words, INTO after FROM but not at the end of the SELECT produces a warning.

Additionally, some changes have been made for UNION with respect to INTO. These UNION variants containing INTO are syntactically correct and produce the same result:

... UNION SELECT * FROM table_name INTO OUTFILE 'file_name';
... UNION (SELECT * FROM table_name) INTO OUTFILE 'file_name';
... UNION SELECT * INTO OUTFILE 'file_name' FROM table_name;
... UNION (SELECT * INTO OUTFILE 'file_name' FROM table_name);

However, the last two variants are confusing, as if they collect information from the named table rather than the entire query expression (the UNION). Those two UNION variants containing INTO now are deprecated and support for them will be removed in a future MySQL version. Thus:

The deprecations apply to all INTO forms: INTO OUTFILE, INTO DUMPFILE, and INTO var_list. (WL #13559)

The perfschema.idx_compare_replication_applier_status test case was updated to store the old value of number of transaction retries and compare it with the new value of number of transaction retries. Thanks to Facebook for the contribution. (Bug #30810627, Bug #98389)

If the MySQL Server instance's client connections limit, as specified by the max_connections server system variable, was reached while X Plugin was starting up, X Plugin was unable to create a session to get the server configuration, so failed to start. X Plugin now creates an administrative session (using the mysql_admin_session service) during startup, which is not subject to the client connections limit. (Bug #30894981)

When an X Protocol session could not be initialized because there were too many X Protocol connections already, the error code 5011 Could not open session was returned. The more relevant error code 1040 Too many connections is now returned in this situation. (Bug #30753637)

An issue with validating JSON references caused an error when creating a collection with a validation schema. (Bug #30733330)

During shutdown of a MySQL Server instance with X Protocol connections to clients, a race condition in X Plugin could cause invalid client connections to be accepted for processing. Because invalid clients were ignored for client timeout verification during shutdown, these clients blocked shutdown until the timeout set by the mysqlx_wait_timeout system variable was reached, which defaults to 8 hours. To prevent this issue, client timeout verification now includes clients that are in an invalid state. (Bug #30702685)

When connecting to a MySQL 8.0 server, X Plugin set a different collation for the session to that used by the mysql client, which could cause issues with queries that depended on the collation. X Plugin now uses the utf8mb4_0900_ai_ci collation, which is the default for the utf8mb4 characterset. (Bug #30516849)

The worker threads for X Protocol connections were identified as system threads on creation, and assigned to the SYS_default resource group. This identification meant they could not be assigned to user resource groups for resource management purposes. They are now identified as user threads and assigned to the USR_default resource group. Note that X Protocol does not currently support CREATE, ALTER, DROP, and SET RESOURCE GROUP statements, but these statements can operate on X Protocol connection threads using classic MySQL protocol connections. (Bug #30059288)

X Plugin can now access the MySQL system variables as soon as initialization starts, so the plugin install thread can set up the required connectivity itself rather than starting a separate thread. (Bug #29127302)

Important Change: Previously, including any column of a blob type larger than TINYBLOB or BLOB as the payload in an ordering operation caused the server to revert to sorting row IDs only, rather than complete rows; this resulted in a second pass to fetch the rows themselves from disk after the sort was completed. Since JSON and GEOMETRY columns are implemented internally as LONGBLOB, this caused the same behavior with these types of columns even though they are almost always much shorter than the 4GB maximum for LONGBLOB (or even the 16 MB maximum for MEDIUMBLOB). The server now converts columns of these types into packed addons in such cases, just as it does TINYBLOB and BLOB columns, which in testing showed a significant performance increase. The handling of MEDIUMBLOB and LONGBLOB columns in this regard remains unchanged.

One effect of this enhancement is that it is now possible for Out of memory errors to occur when trying to sort rows containing very large (multi-megabtye) JSON or GEOMETRY column values if the sort buffers are of insufficient size; this can be compensated for in the usual fashion by increasing the value of the sort_buffer_size system variable. (Bug #30400985, Bug #30804356)

InnoDB: The Contention-Aware Transaction Scheduling (CATS) algorithm, which prioritizes transactions that are waiting for locks, was improved. Transaction scheduling weight computation is now performed a separate thread entirely, which improves computation performance and accuracy.

The First In First Out (FIFO) algorithm, which had also been used for transaction scheduling, was removed. The FIFO algorithm was rendered redundant by CATS algorithm enhancements. Transaction scheduling previously performed by the FIFO algorithm is now performed by the CATS algorithm.

A TRX_SCHEDULE_WEIGHT column was added to the INFORMATION_SCHEMA.INNODB_TRX table, which permits querying transaction scheduling weights assigned by the CATS algorithm.

The following INNODB_METRICS counters were added for monitoring code-level transaction scheduling events:

(WL #13486)

InnoDB: The storage area for the doublewrite buffer was moved from the system tablespace to doublewrite files. Moving the doublewrite buffer storage area out of the system tablespace reduces write latency, increases throughput, and provides flexibility with respect to placement of doublewrite buffer pages. The following system variables were introduced for advanced doublewrite buffer configuration:

For more information, see Doublewrite Buffer. (WL #5655)

EXPLAIN ANALYZE can now be stopped during execution using KILL QUERY or CTRL-C. (Bug #30787515)

EXPLAIN FORMAT=TREE now displays inversion information for windowing functions. (Bug #30770631)

EXPLAIN FORMAT=TREE output has been improved to provide more information about evaluated window functions, and to match that supplied for regular aggregates. (Bug #30573446, Bug #30582782)

Configuring with the -DWITH_LTO=1 CMake option now works on macOS. (Bug #30125902)

You can now enable binary log transaction compression on a MySQL server instance. When binary log transaction compression is enabled, transaction payloads are compressed using the zstd algorithm, and then written to the server's binary log file as a single event (a Transaction_payload_event). Compressed transaction payloads remain in a compressed state while they are sent in the replication stream to replicas, other Group Replication group members, or clients such as mysqlbinlog. They are not decompressed by receiver threads, and are written to the relay log still in their compressed state. Binary log transaction compression therefore saves storage space both on the originator of the transaction and on the recipient (and for their backups), and saves network bandwidth when the transactions are sent between server instances.

You can enable binary log transaction compression on a MySQL server instance using the binlog_transaction_compression system variable, which defaults to OFF. You can also use the binlog_transaction_compression_level_zstd system variable to set the level for the zstd algorithm that is used for compression. This value determines the compression effort, from 1 (the lowest effort) to 22 (the highest effort). (WL #3549)

A new option for the CHANGE MASTER TO statement, REQUIRE_TABLE_PRIMARY_KEY_CHECK, enables a replication slave to select its own policy for primary key checks. When the option is set to ON for a replication channel, the slave always uses the value ON for the sql_require_primary_key system variable in replication operations, requiring a primary key. When the option is set to OFF, the slave always uses the value OFF for the sql_require_primary_key system variable in replication operations, so that a primary key is never required, even if the master required one. When the REQUIRE_TABLE_PRIMARY_KEY_CHECK option is set to STREAM, which is the default, the slave uses whatever value is replicated from the master for each transaction.

(WL #13239)

Since MySQL 8.0.19, compression has been supported for messages sent over X Protocol connections. Connections can be compressed if the server and the client agree on a compression algorithm to use. By default, the server permits the Deflate, LZ4, and zstd compression algorithms, or you can set the mysqlx_compression_algorithms system variable to include only the ones you permit. In MySQL 8.0.19, X Protocol uses the library default compression level for each algorithm, and the client cannot negotiate this.

From MySQL 8.0.20, the client can request a specific compression level during capability negotiations for an X Protocol connection. X Protocol sets a maximum compression level for each algorithm, which prevents the server from agreeing to high compression levels that are requested by clients if that would consume too much resource on the server. The maximum compression levels are initially set to 5 for Deflate, 8 for LZ4, and 11 for zstd. You can adjust these settings using the new mysqlx_deflate_max_client_compression_level, mysqlx_lz4_max_client_compression_level, and mysqlx_zstd_max_client_compression_level system variables.

New default compression levels for X Protocol have also been selected through performance testing as being a good trade-off between compression time and network transit time. These defaults are not necessarily the same as the library default for each algorithm. They are applied if the client does not request a compression level for the algorithm. The default compression levels are initially set to 3 for Deflate, 2 for LZ4, and 3 for zstd. You can adjust these settings using the new mysqlx_deflate_default_compression_level, mysqlx_lz4_default_compression_level, and mysqlx_zstd_default_compression_level system variables. (WL #13034)

Incompatible Change: Some queries that used ST_Contains() did not return any results unless > 0 was added.

(Bug #30461595, Bug #97347)

Performance: Certain queries against tables with spatial indexes were not performed as efficiently following an upgrade from MySQL 5.7 to MySQL 8.0. (Bug #94655, Bug #29488350)

References: See also: Bug #89551, Bug #27499984.

NDB Cluster: NDB defines one SPJ worker per node owning a primary partition of the root table. If this table used read from any fragment replica, DBTC put all SPJ workers in the same DBSPJ instance, which effectively removed the use of some SPJ workers. (Bug #30639165)

NDB Cluster: Executing the SHOW command using an ndb_mgm client binary from NDB 8.0.16 or earlier to access a management node running NDB 8.0.17 or later produced the error message Unknown field: is_single_user. (Bug #30599413)

References: See also: Bug #16275500.

InnoDB: A CREATE UNDO TABLESPACE operation that specified an undo data file name without specifying a path removed an existing undo data file of the same name from the directory specified by innodb_undo_directory variable. The file name conflict check was performed on the data directory instead of the directory specified by the innodb_undo_directory variable. (Bug #30908328, Bug #98628)

InnoDB: In debug builds, a regression introduced in MySQL 8.0.19 slowed down mutex and rw-lock deadlock debug checks. (Bug #30886393)

References: This issue is a regression of: Bug #30628872.

InnoDB: Valgrind testing raised an error indicating that a conditional jump or move depends on an uninitialized value. The error was a false-positive due to invalid validation logic. (Bug #30837136)

InnoDB: Missing barriers in rw_lock_debug_mutex_enter() (in source file sync0debug.cc) could cause a thread to wait without ever being woken up. (Bug #30819167)

InnoDB: To improve server initialization speed on Linux, posix_fallocate() is now used to allocate space for redo log files. (Bug #30804431, Bug #98342)

InnoDB: A data dictionary table open function was implemented with incorrect lock ordering. (Bug #30782103, Bug #97825)

InnoDB: Changes to parallel read threads functionality introduced in MySQL 8.0.17 caused a degradation in SELECT COUNT(*) performance. Pages were read from disk unnecessarily. (Bug #30766089)

InnoDB: DDL logging was not performed for SQL operations executed by the bootstrap thread using the init_file startup variable, causing files to be left behind that should have been removed during a post-DDL stage. (Bug #30721214, Bug #98131)

InnoDB: Adding an index on a column cast as a JSON array on a table with a specific number of records failed with an “Incorrect key file for table” error. (Bug #30709525, Bug #98098)

InnoDB: A Valgrind error reported that an uninitialized lock->writer_thread value was used in a conditional jump. (Bug #30694177)

InnoDB: An internal buffer pool statistics counter (n_page_gets) was partitioned by page number to avoid contention when accessed by multiple threads. (Bug #30604841, Bug #97822)

InnoDB: A tablespace import operation failed with a schema mismatch error due to the .cfg file and the data dictionary both containing default values for a column that was added using ALGORITHM=INSTANT. An error should only occur if default values differ. (Bug #30561144)

InnoDB: A slow shutdown failed to flush some GTIDs, requiring recovery of unflushed GTIDs from the undo log. (Bug #30548229)

InnoDB: A broken alignment requirement in the code that allocates a prefix in memory for Performance Schema memory allocations caused a failure on MySQL builds optimized for macOS and FreeBSD. (Bug #30530857)

InnoDB: Adding a virtual column raised an assertion failure due to data that was missing from the new data dictionary object created for the table. (Bug #30524263)

InnoDB: A required latch was not taken when checking the mode of an undo tablespace. A required latch was also not taken when checking whether an undo tablespace is empty. (Bug #30509134)

InnoDB: Allocating an update undo log segment to an XA transaction for persisting a GTID value before the transaction performed any data modifications caused a failure. (Bug #30456328)

InnoDB: A query executed on a partitioned table with a discarded tablespace raised an assertion failure. (Bug #30437407, Bug #97271)

InnoDB: The row_upd_clust_rec_by_insert function, which marks a clustered index record as deleted and inserts an updated version of the record into the clustered index, passed an incorrect n_ext value (the total number of external fields) to lower level functions, causing an assertion failure. (Bug #30437378)

InnoDB: During a cloning operation, writes to the data dictionary buffer table at shutdown were too late, causing a failure. Newly generated dirty pages were not being flushed. (Bug #30427369, Bug #30405535, Bug #30405535)

InnoDB: An operation performed with the innodb_buffer_pool_evict debug variable set to uncompressed caused an assertion failure. (Bug #30405531)

InnoDB: Read-write lock code (rw_lock_t) that controls ordering of access to the boolean recursive flag and the writer thread ID using GCC builtins or os_mutex when the builtins are not available, was revised to use C++ std::atomic in some instances. Thanks to Yibo Cai from ARM for the contribution. (Bug #30401416, Bug #97150)

InnoDB: A failure occurred while upgrading from MySQL 5.7 to MySQL 8.0. A server data dictionary object was missing information about the FTS_DOC_ID column and FTS_DOC_ID_INDEX that remain after dropping a FULLTEXT index. (Bug #30357954)

InnoDB: Unnecessary messages about parallel scans were printed to the error log. (Bug #30330448)

InnoDB: During upgrade from MySQL 5.7 to MySQL 8.0, clustered indexes named GEN_CLUST_INDEX are renamed to PRIMARY, which resulted in duplicate entries for the clustered indexes being added to the mysql.innodb_index_stats table. (Bug #30330448)

InnoDB: Various internal functions computed write event slots in an inconsistent manner. (Bug #30228108, Bug #96519)

InnoDB: Under specific circumstances, it was possible that tablespace encryption key information would not be applied during the redo log apply phase of crash recovery. (Bug #30209760)

InnoDB: A file operation failure caused the page tracking archiver to fail, which in turn caused the main thread to hang, resulting in an assertion failure. Also, incorrectly, the page tracking archiver remained enabled in innodb_read_only mode. (Bug #30202643)

InnoDB: An index corruption error was reported when attempting to import a tablespace containing a table column that was added using ALGORITHM=INSTANT. The error was due to missing metadata associated with the instantly added column. (Bug #30191523, Bug #96477)

InnoDB: A transaction attempting to fetch an LOB record encountered a null LOB reference, causing an assertion failure. However, the null LOB reference was valid in this particular scenario because the LOB value was not yet fully written. (Bug #30144303)

InnoDB: During a parallel read operation, the rollback of a table load operation while autocommit was disabled resulted in a server to exit due to assertion code that did not account for the possibility of tree structure changes during a parallel read. (Bug #30060690)

InnoDB: The current size value maintained in a rollback segment memory object was found to be invalid, causing an assertion failure in function trx_purge_free_segment(). A validation routine (trx_rseg_t::validateCurrSize()) was added to verify the current size value. (Bug #29947027)

InnoDB: A prepared statement executed with invalid parameter values raised an assertion failure. (Bug #29880907)

InnoDB: An add column operation caused an assertion failure. The failure was due to a dangling pointer. (Bug #29866408)

References: This issue is a regression of: Bug #28491099.

InnoDB: Updating certain InnoDB system variables that take string values raised invalid read errors during Valgrind testing. (Bug #29717909, Bug #95215)

InnoDB: Redo log records for modifications to undo tablespaces increased in size in MySQL 8.0 due to a change in undo tablespace ID values, which required additional bytes. The change in redo log record size caused a performance regression in workloads with heavy write I/O. To address this issue, the redo log format was modified to reduce redo log record size for modifications to undo tablespaces. (Bug #29536710)

InnoDB: Additional information about InnoDB file writes, including progress data, is now printed to the error log. (Bug #29472295, Bug #94634)

InnoDB: An insert statement on a table with a spatial index raised a record type mismatch assertion due to a tuple corruption. (Bug #29465567)

InnoDB: A function that calculates undo log record size could calculate an incorrect length value in the case of a corrupted undo log record, resulting in a malloc failure. Assertion code was added to detect incorrect calculations. (Bug #29448406, Bug #82734)

Replication: While an SQL statement was in the process of being rewritten for the binary log so that sensitive information did not appear in plain text, if a SHOW PROCESSLIST statement was used to inspect the query, the query could become corrupted when it was written to the binary log, causing replication to stop. The process of rewriting the query is now kept private, and the query thread is updated only when rewriting is complete. (Bug #30569003, Bug #97531, Bug #30654405)

Replication: When a GRANT or REVOKE statement is only partially executed, an incident event is logged in the binary log, which makes the replication slave's applier thread stop so that the slave can be reconciled manually with the master. Previously, if a failed GRANT or REVOKE statement was the first statement executed in the session, no GTID was applied to the incident event (because the cache manager did not yet exist for the session), causing an error on the replication slave. Also, no incident event was logged in the situation where a GRANT statement created a user but then failed because the privileges had been specified incorrectly, again causing an error on the replication slave. Both these issues have now been fixed. (Bug #30566518, Bug #30324661)

Replication: Compression is now triggered for the mysql.gtid_executed table when the thread/sql/compress_gtid_table thread is launched after the server start, and the effects are visible when the compression process is complete. (Bug #30541799)

Replication: In the event of an unplanned disconnection of a replication slave from the master, the reference to the master's dump thread might not be removed from the list of registered slaves, in which case statements that accessed the list of slaves would fail. The issue has now been fixed. (Bug #29915479)

Replication: When a partitioned table was involved, the server did not correctly handle the situation where a row event could not be written to the binary log due to a lack of cache space. An appropriate error is now returned in this situation. (Bug #29848931)

Replication: With the settings binlog_format=MIXED, tx_isolation=READ-COMMITTED, and binlog_row_image=FULL, an INSERT ... SELECT query involving a transactional storage engine omitted any columns with a null value from the row image written to the binary log. This happened because when processing INSERT ... SELECT statements, the columns were marked for inserts before the binary logging format was selected. The issue has now been fixed. (Bug #29110804, Bug #93423)

Replication: Under certain conditions, replication of conditional comments could fail. (Bug #28388217)

Group Replication: The thread used by the Group Replication message service was not correctly registered by the Performance Schema instrumentation, so the thread actions were not visible in Performance Schema tables. (Bug #30824676)

Group Replication: Group Replication initiates and manages cloning operations for distributed recovery, but group members that have been set up to support cloning may also participate in cloning operations that a user initiates manually. In releases before MySQL 8.0.20, you could not initiate a cloning operation manually if the operation involved a group member on which Group Replication was running. From MySQL 8.0.20, you can do this, provided that the cloning operation does not remove and replace the data on the recipient. The statement to initiate the cloning operation must therefore include the DATA DIRECTORY clause if Group Replication is running. (Bug #30798640)

Group Replication: For Group Replication channels, issuing the CHANGE MASTER TO statement with the PRIVILEGE_CHECKS_USER option while Group Replication was running caused the channel's relay log files to be deleted. Transactions that had been received and queued in the relay log, but not yet applied, could be lost in this situation. The CHANGE MASTER TO statement can now only be issued when Group Replication is not running. (Bug #30655369)

Group Replication: The Group Replication failure detection mechanism raises a suspicion if a server stops sending messages, and the member is eventually expelled provided that a majority of the group members are still communicating. However, the failure detection mechanism did not take into account the situation where one or more of the group members in the majority had actually already been marked for expulsion, but had not yet been removed from the group. Where the network was unstable and members frequently lost and regained connection to each other in different combinations, it was possible for a group to end up marking all its members for expulsion, after which the group would cease to exist and have to be set up again.

The Group Replication Group Communication System (GCS) now tracks the group members that have been marked for expulsion, and treats them as if they were in the group of suspect members when deciding if there is a majority. This ensures at least one member remains in the group and the group can continue to exist. When an expelled member has actually been removed from the group, GCS removes its record of having marked the member for expulsion, so that the member can rejoin the group if it is able to. (Bug #30640544)

Group Replication: Performance Schema tables could not be accessed on a MySQL server with Group Replication that was running under high load conditions. (Bug #30112711, Bug #30675790)

Group Replication: Internal queries from Group Replication to the Performance Schema for statistics on local group members failed if they occurred simultaneously with changes to the group's membership. Locking for the internal queries has been improved to fix the issue. (Bug #30049349, Bug #30791583, Bug #30963553)

Group Replication: During the Group Replication distributed recovery process, if a joining member is unable to complete a remote cloning operation with any donor from the group, it uses state transfer from a donor's binary log to retrieve all of the required data. However, if the last attempted remote cloning operation was interrupted and left the joining member with incomplete or no data, an attempt at state transfer immediately afterwards could also fail. Before attempting state transfer following a failed remote cloning operation, Group Replication now checks that the remote cloning operation did not reach the stage of removing local data from the joining member. If data was removed, the joining member leaves the group and takes the action specified by the group_replication_exit_state_action system variable. (Bug #29669099, Bug #29944828)

Group Replication: An earlier change to reduce Performance Schema memory instrumentation overhead had the unintended effect of causing Group Replication performance degradation. (Bug #28719976)

References: This issue is a regression of: Bug #27500610.

Group Replication: Before taking certain actions, Group Replication checks what transactions are running on the server. Previously, the service used for this check did not count transactions that were in the commit phase, which could result in the action timing out. Now, transactions that are in the commit phase are included in the set of currently ongoing transactions. (Bug #28327838)

JSON: When JSON_TABLE() was used as part of an INSERT statement in strict mode, conversion errors handled by any ON ERROR clause could cause the INSERT to be rejected. Since errors are handled by an ON ERROR clause, the statement should not be rejected unless ERROR ON ERROR is actually specified.

This issue is fixed by ignoring warnings when converting values to the target type if NULL ON ERROR or DEFAULT ... ON ERROR has been specified or is implied. (Bug #30628330)

JSON: The output from JSON_TABLE() was not always correct when used in views. This fix corrects the following issues:

(Bug #30263373)

JSON: The functions JSON_SCHEMA_VALID() and JSON_SCHEMA_VALIDATION_REPORT() formerly checked to ensure that their arguments were convertible to JSON each time a prepared statement including these was executed, which was neither efficient nor necessary. Now in such cases, the check is performed only once, when the statement is prepared. (Bug #97878, Bug #30622327)

Privilege requirements were checked incorrectly for stored objects with a DEFINER that has the SYSTEM_USER privilege. (Bug #31077699)

A number of errors reported by Clang in the documentation generated from the MySQL sources have been corrected. (Bug #30956093)

On FreeBSD, the krb5 package is a now a dependency. (Bug #30887620)

If a query contained multiple references to the same common table expression (CTE) and a pseudo-comment crossed borders of the CTE definition, the parser failed with confusing syntax error messages. (Bug #30871301)

For installation using Debian packages, the /var/run/mysqld directory was not created. (Bug #30855015, Bug #98484)

mysqlslap did not shut down its threads properly when SQL statements returned an error. This could result in attempts to free already freed memory. (Bug #30850310)

When X Plugin was attempting to add a document to a collection as either an insertion or an update in the case of a duplicate key, in the case where the document failed a unique key constraint in a field other than the primary key, the error returned by X Plugin did not state that this was the cause of the issue. The appropriate error is now returned. (Bug #30843865)

An integer value generated by transformations in the resolver was supplied to a test which expected a boolean. (Bug #30837240)

A query using an IN expression that accessed one or more columns holding large string values could lead to a memory leak. (Bug #30814171)

Statements did not work properly when the target of a DELETE was a common table expression. (Bug #30796015, Bug #98330)

Starting the server with create_admin_listener_thread enabled and without admin_address enabled caused an abnormal exit during the server shutdown process. (Bug #30785609)

When a table had both a primary key and a secondary key on the same column, but for different lengths, the range optimizer chose the wrong key part in the secondary index for comparing range values. (Bug #30783011)

In some cases, errors caused when DISTINCT was used with an aggregate function whose argument was of an incorrect type were not propagated correctly. (Bug #30782687)

For replication using compression, the slave could raise an assertion if the master was restarted. (Bug #30774692)

For debug builds, the server could exit trying to print an optimizer trace. (Bug #30773218, Bug #98258)

The mysql_real_connect_nonblocking() C API function exhibited blocking behavior. (Bug #30771233)

With LOCK TABLES active, while processing INFORMATION_SCHEMA queries, the server could attempt to lock internal temporary tables (which need no locks), causing an assertion to be raised. (Bug #30764651, Bug #98221)

The mysqldump internal network timeout was increased from 700 to 86400 seconds to accommodate connecting to busy or unresponsive servers. (Bug #30755992, Bug #98203)

Configuring with -DWITH_SASL=path/to/custom/installation inadvertently caused libsasl to be linked into the daemon_memcached plugin. (Bug #30755301)

After deleting the temporary table associated with a window function's frame buffer, the temporary table parameter for the frame buffer was not cleaned up, causing string buffers associated with copy fields not to be freed properly. (Bug #30752366)

The -libs-compat RPM package is now built with system zlib to avoid problems with unrestricted export of symbols in libmysqlclient.so.18. (Bug #30722389, Bug #98130)

The server exited histogram sampling prematurely, causing an assertion failure. An unnecessary boolean variable that marked the completion of a sampling operation was removed. (Bug #30717778)

When removing a WHERE condition because one of the participating conditions was always false, a materialized derived table was not cleaned up properly, resulting in a memory leak. (Bug #30712243)

Multiple comparisons with the same GEOMETRY value were not always handled correctly. (Bug #30697042)

References: See also: Bug #30306306.

MIN() and MAX() could return an incorrect value for some queries if a WHERE clause containing an IN () subquery was added. (Bug #30691682, Bug #98047)

Server startup failed if MySQL Enterprise Firewall was enabled at startup but the whitelist and user tables were missing. (Bug #30690181)

For prepared statements, re-execution could cause a server exit if a cleaned-up materialized temporary table was still being referred to. (Bug #30674598)

The ER_WARN_DEPRECATED_SQL_CALC_FOUND_ROWS and ER_WARN_DEPRECATED_FOUND_ROWS error messages were incorrectly categorized in the range of messages meant to be written to the error log. They are now correctly categorized as messages meant to be sent to clients. The old errors are now designated as OBSOLETE_ER_WARN_DEPRECATED_SQL_CALC_FOUND_ROWS and OBSOLETE_ER_WARN_DEPRECATED_FOUND_ROWS in the range of error-log messages. (Bug #30673043)

Some joins within subqueries where an outer query used EXISTS or NOT EXISTS were not always handled correctly. (Bug #30671329)

Queries using ORDER BY constant are permitted but an ORDER BY clause of this sort should not have any effect on the result; such queries were not always handled correctly. (Bug #30669493)

A missing out-of-bounds check in wild_case_match() caused a pointer to read out of bounds. (Bug #30668886)

The strconvert() function was not safe for conversions between filename and utf8_general_ci strings. (Bug #30668847)

Some filesorts using keys of fixed length were not always handled correctly. (Bug #30665034)

When performing a hash join on two string columns that were potentially very large (in particular, BLOB columns with PAD SPACE collations), MySQL stored the entire sort key in the row, which impacted performance by requiring large amounts of memory. Now only a collation-aware hash is stored, with an added equality comparison prevent a wrong answer, even in the event of a 64-bit hash collision. (Bug #30664831)

When at least two tables were joined to at least two other tables using a semijoin, and the join optimizer chose to use a loose scan, it was possible to place both of the left tables below the deduplicating nested loop iterator, leading to excessive deduplication. We fix this by treating a loose scan across multiple tables as a separate internal structure. (Bug #30659810)

In unions of a const table and zero or more known-zero expressions, derived tables of exactly one row could be read incorrectly as having zero rows. (Bug #30655712, Bug #97967)

A MySQL 8.0.19 patch set an invalid INFORMATION_SCHEMA and data dictionary version number. Assertion code was added to prevent future version information errors. (Bug #30645158, Bug #97948)

References: This issue is a regression of: Bug #29871530.

When setting up the iterator tree, the optimizer now filters away and subsequently ignores conditions which are known to be trivially true. (Bug #30644591)

Under some conditions, SHOW COLUMNS on a temporary MERGE table could raise an assertion or cause a server exit. (Bug #30640463)

References: This issue is a regression of: Bug #28811287, Bug #92834.

The Event Scheduler had a memory leak. (Bug #30628268)

Using the asynchronous C API functions could result in freeing already freed memory. (Bug #30596999, Bug #97805)

On tables containing a CHECK constraint, certain simple queries were inefficient due to excessive memory allocation and Performance Schema calls. (Bug #30594613)

Under certain circumstances, a memcached command could result in reading an uninitialized memory buffer, causing a failure. (Bug #30592346)

A race condition could occur between InnoDB issuing requests for schema and table metadata while filling INFORMATION_SCHEMA.INNODB_TABLES, and the schema being dropped, leading to user queries on INNODB_TABLES reporting an error. (Bug #30591967)

The client library could be induced into an infinite loop by a malicious server. (Bug #30581726)

Using ALTER USER to reset an account MAX_USER_CONNECTIONS value did not take effect until all current account connections terminated, if there were any. (Bug #30578217, Bug #97735)

When the optimizer sets up a weedout, it notifies all tables that are part of the weedout that they should provide row IDs. For confluent weedouts (weedouts returning at most one row), the optimizer expects that the executor handles the weedout without row IDs. In the iterator executor, confluent weedouts are implemented using LIMIT 1; the normal weedout iterator does not handle confluent weedouts, and thus always expects row IDs. In the case of a confluent weedout on the right side of an outer join, the confluent weedout was processed as a normal weedout, causing the iterator executor to ask for row IDs where the tables did not supply them. Now in such cases, the LIMIT 1 optimization is also applied. (Bug #30566549, Bug #30282693)

SET PERSIST could fail due to attempting to persist variables to the wrong directory. (Bug #30561982)

Within a stored program with an error handler defined for the error condition of accessing a nonexistent table, the handler was not invoked if the table was nonexistent because it was named in a nonexistent database. (Bug #30561920, Bug #97682)

The duplicate weedout optimization strategy employed by MySQL (see Optimizing IN and EXISTS Subquery Predicates with Semijoin Transformations) uses an internal table of row IDs which it has already seen, with a unique index on the column containing these IDs. When the key for the unique index became too large, which could happen with very large row IDs, the server reverted to deduplication by hash key instead, with a separate index (not unique) over the hash field only, as with other temporary tables. Because the latter index was not properly initialized, affected queries were not executed properly and could lead to a premature exit. (Bug #30556257)

For debug builds, under LOCK TABLES, the server could mishandle materialized temporary tables and raise an assertion. (Bug #30476213, Bug #97404)

The internal array of materialized query blocks SELECT_LEX_UNIT::m_query_blocks_to_materialize was not reset between executions, which meant that it pointed to objects which were no longer valid when a prepared statement was executed a second time, causing the second execution to fail. (Bug #30438038)

Altering column collations did not affect unique indexes until a server restart. (Bug #30386119, Bug #97103)

When using roles, the EXECUTE privilege for stored functions was treated as a privilege for stored procedures. As a result, it was not possible to use EXECUTE as a role privilege for functions. (Bug #30376231)

A materialized subquery including a condition in which a column value was used as input to a nondeterministic function produced incorrect results. (Bug #30368937)

Several fixes were applied to the InnoDB memcached plugin. The fixes addressed potential deadlock issues, issues related to connection list latches, and removal of an obsolete flush mutex. (Bug #30354225)

Strings that used the utf8mb4_0900_bin collation could not be compared with utf8mb4 strings that used a different collation. Now the comparison is done by using utf8mb4_0900_bin for both strings. (Bug #30350111)

During optimization, MySQL removes conditions in which all arguments are considered equal; for example, 1 <> 1 is removed and replaced with false. In doing so, conditions containing non-deterministic arguments were also removed, which caused a condition such as RAND() < RAND() to be considered an impossible condition. Now, the optimizer no longer removes conditions containing nondeterministic arguments. (Bug #30311271)

Scheduling of events could be disturbed by removing events. (Bug #30301356, Bug #96849)

The Event Scheduler reported warnings for Valgrind builds. (Bug #30301340)

Shutting down the server while using the clone plugin raised a Valgrind error. (Bug #30248419)

If the mysqld-auto.cnf file was malformed, the server did not start (expected), but did not report any error (unexpected). (Bug #30169731, Bug #96501)

UPDATE statements could give an inconsistent number of rows matched (found rows) in cases where not all matched rows were updated, depending on the reason for rows not being updated. For example, rows not updated due to being updated through a view with a WITH CHECK OPTION clause were not counted as matching rows, whereas rows not updated due to a failing CHECK CONSTRAINT were counted. For consistency, rows that fail a WITH CHECK OPTION clause now are counted as matching rows. (Bug #30158954)

When restarting the MySQL server on a cloned directory, InnoDB reported an error indicating that it could not find a tablespace file for a statistics table that was dropped by the server previously. (Bug #30093799)

The server did not handle correctly a UNION in which one of the queries contained a subquery that used ORDER BY. (Bug #29952565)

For INFORMATION_SCHEMA queries, a race condition could result in multiple attempts to insert a key when updating the dynamic statistics tables, producing a duplicate-key error. (Bug #29948755, Bug #95929)

SHOW CREATE VIEW could fail with an illegal mix of collations for views defined on a function that returns a string. (Bug #29904087)

The Performance Schema could fail to remove thread instrumentation when a thread was deleted. (Bug #29859605)

A query with a WHERE clause whose predicate contained a numeric value in scientific notation was not handled correctly.

In addition, attempting to insert a particular integer specified as a string caused a server exit when the string-to-integer conversion was not successful. (Bug #29723340, Bug #30441969)

An internal interface was added for retrieving and parsing errors that occur on the donor MySQL server instance (ER_CLONE_DONOR errors) and for checking if data on the recipient has been dropped. (Bug #29682642)

It was not possible to drop any columns from a table when the DEFAULT value. (Bug #29661106)

For the CONNECTION_CONTROL plugin, the Performance Schema instrumentation used keys that were not discoverable to the Performance Schema unless the associated code actually executed. (Bug #29539976)

For a nullable column c, the optimizer now recognizes when the conditions c < c, c > c, and c <> c are always false and need not be evaluated for every row. Thanks to Daniel Black for the contribution. (For nonnullable columns, the optimizer already recognized always-false conditions.) (Bug #29115386, Bug #93642)

Reinitialization of character sets from Index.xml could cause a use-after-free error. (Bug #28956360, Bug #93276)

The sys schema ps_setup_reset_to_default() procedure used MySQL 5.7 defaults, not MySQL 8.0 defaults. (Bug #27636611)

Some connection encryption ciphers did not work. (Bug #27045306)

Previously, mysqlpump read the [mysql_dump] and [client] groups from option files. mysqlpump now additionally reads the [mysqlpump] group. The [mysql_dump] group is still accepted but is deprecated. (Bug #24733245, Bug #83144)

For a query of the form SELECT DISTINCT ... ORDER BY ..., when the ORDER BY was pushed down onto the first table in the join, the result was not always sorted in the correct order. (Bug #98217, Bug #30760534)

The NULL indicator was not properly written for items used as variable-length keys, such that all such items were assumed to be not NULL, which was considered equal to the empty string when using certain collations. One visible effect of this issue was that ordering by an expression using a nullable string was sometimes not performed correctly. An example of such a query, where column c1 contains both NULL and empty string values, is shown here:

SELECT c1, SUBSTR(c1, 1) AS c2 FROM t ORDER BY c2;

(Bug #98035, Bug #30687020)

A query returned inaccurate results when an expression in a GROUP BY clause used a column name differing in case from that used for the name of the column when the table containing this column was created. An example of this would be when the query used GROUP BY id although the column name as shown in the original CREATE TABLE statement was ID.

This occurred because, the server performed case-sensitive comparisons of column names in expressions with names of columns in tables. This issue is fixed by ensuring that such comparisons are performed in a case-insensitive fashion as expected. (Bug #97628, Bug #98222, Bug #30541701, Bug #30761372)

A multi-table UPDATE statement which updated a table joined to a derived table that joined two other tables was not optimized properly as it had been in MySQL 5.6, instead being treated as if STRAIGHT_JOIN had been used with the subquery creating the derived table. (Bug #97418, Bug #30488700)

EXPLAIN now uses hash join instead of block nested loop, since the latter no longer exists and is replaced by a hash join in nearly all cases. (Bug #97299, Bug #30444550)

References to columns from tables of outer query blocks in the ON condition of a join did not work, and could be used only in a WHERE. The fix for this problem means that a query such as this one now works correctly:

SELECT o.order_date FROM orders o 
WHERE o.order_date IN  ( SELECT c.contact_name FROM customers c     
INNER JOIN order_details od
ON o.order_id = od.discount );  

Previously this had to be rewritten as shown here:

SELECT o.order_date FROM orders o 
WHERE o.order_date IN  ( SELECT c.contact_name FROM customers c
INNER JOIN order_details od
ON 1 
WHERE o.order_id = od.discount );  

References to other tables of the same FROM clause as the join, as in the query SELECT * FROM t1 CROSS JOIN (t2 LEFT JOIN t3 ON t1.c=3), are not outer references and remain forbidden. In this case, a lateral join is required, like this: SELECT * FROM t1 JOIN LATERAL (SELECT * FROM t2 LEFT JOIN t3 ON t1.c=3). (Bug #96946, Bug #30350696)

The execution plan for a query that filtered on the first column of a composite hash index wrongly used this index, producing erroneous results. (Bug #94737, Bug #29527115)

References to columns from tables of outer query blocks in an ON condition of a JOIN did not work, and could be used only in a WHERE. The fix for this problem means that a query such as this one now works correctly:

SELECT o.order_date FROM orders o
WHERE o.order_date IN  ( SELECT c.contact_name FROM customers c
                    INNER JOIN order_details od
                    ON o.order_id = od.discount );

Previously this had to be rewritten as shown here:

SELECT o.order_date FROM orders o
WHERE o.order_date IN  ( SELECT c.contact_name FROM customers c
                    INNER JOIN order_details od
                    ON 1
                    WHERE o.order_id = od.discount );

References to other tables of the same FROM clause as the JOIN, as in the query SELECT * FROM t1 CROSS JOIN (t2 LEFT JOIN t3 ON t1.c=3), are not outer references and remain forbidden. In this case, a lateral join is required, like this: SELECT * FROM t1 JOIN LATERAL (SELECT * FROM t2 LEFT JOIN t3 ON t1.c=3). (Bug #35242, Bug #96946, Bug #11748138, Bug #30350696)

There could be a mismatch between the version of OpenSSL used to build the server and the version used for other parts of MySQL such as libraries or plugins. This could cause certain features not to work, such as the LDAP authentication plugins. Now the same version of OpenSSL is used for building everything. (WL #13759)

Previous work in MySQL 8.0 to optimize impossible expressions such as a=b AND FALSE as FALSE could make for less efficient execution when such expressions appeared as outer join conditions, due to the fact that the join was interpreted as a Cartesian product followed by a filter. (Bug #8202, Bug #89739, Bug #97552, Bug #11745046, Bug #27581277, Bug #30520749)

References: See also: Bug #98206, Bug #30756135.