Bug: 36878769: Upgrade Oracle GoldenGate for Big Data packaged libraries for 19.1.0.0.18 release

This issue has been fixed. The packaged libraries have been upgraded to maintain consistency with the future releases, such as Oracle GoldenGate for Distributed Applications and Analytics 23ai (23.5) and 21.15.0.0.0 releases.

Bug 36643378: Upgrading multiple old 3rd party libraries to the most recent versions.

This issue has been fixed.

Spring Framework Upgrade to at least 6.0.8, 5.3.27, or 5.2.24 to address security vulnerabilty

The following security vulnerability has been fixed: CVE-2023-20863.

Oracle recommends that you upgrade to this patch to include these security fixes.

Bug 35617764 - Memory leak in Oracle GoldenGate for Big Data Replicat processes

This issue has been fixed.

Bug 35617691 - Mongo replicat is crashing while processing 3-part table name

This issue has been fixed.

Bug 32862043 - Extract is abending with "OGG-25119 Failed to create missing sub-directories"

This issue has been fixed.

Bug 34014027 - File Writer Handler may encounter java.lang.IllegalArgumentException: Cannot set target checkpoint to null or GGTranID.UNSET exception when Java operation filtering is enabled.

This issue has been fixed.

Bug 33847292 - DDL changes/Table metadata changes lead to issue in Stage and Merge processing

This issue has been fixed.

Bug 33734218 - BigQuery Handler may propagate large number in scientific notation format when a source numeric field is mapped to a string field in BigQuery.

This issue has been fixed. Change was made to convert numbers from scientific notation to standard form.

Upgrade of log4j 2.17.1 to address Security Vulnerability

The following security vulnerability has been fixed: CVE-2021-44832

Oracle recommends that you upgrade to this patch to include these security fixes.

Bug 33270938 - Generic: Rollback should not happen when disabling GROUPTRANSOPS

This issue has been fixed.

Upgrade of log4j to address Security Vulnerability

The following security vulnerabilities have been fixed: CVE-2021-45046 and CVE-2021-44228.

Oracle recommends that you upgrade to this patch to include these security fixes.

After you have applied the patch, do the following:

• Manually remove the older version of log4j related jar files from ggjava/resources/lib/optional​.
• In the .properties file of the replicat or extract groups, add the following: gg.log.classpath=ggjava/resources/lib/optional/log4j-api-2.16.0.jar:ggjava/res ources/lib/optional/log4j-core-2.16.0.jar:ggjava/resources/lib/optional/log4j-slf4j-impl-2.16.0.jar​

Bug 33471061 - Azure storage account key for authentication into ADLS

This issue has been fixed.

Bug 33392133 - The replicat suddenly crashes, and upon restart, a duplicate parquet file gets created.

This issue has been fixed.

Bug 33328546 - Avro Formatter added configuration to allow special handling of Oracle Number source types as string.

This issue has been fixed.

Bug 33322992 - File Writer Handler failing to delete data files on Windows due to process based file locking.

This issue has been fixed. File Writer Handler now implements retries on file delete operations.

Bug 32880283 - Oracle GoldenGate for Big Data replicate creating Parquet files hangs and generate dump files .

This issue has been fixed.

Bug 33298943 - Azure Data Lake File exists error

This issue has been fixed. Parquet Event Handler change to overwrite target files if file already exists.

Enh 32804778 - Added metacolumn keyword to provide indication that the metadata for associated table has changed.

This issue has been fixed. The metacolumn ${metadatachanged} has been added. This metacolumn has a boolean value and when true, it indicates that the metadata of the table has changed as of the current record.

Enh 33053571 - Replication to tables on multiple target schemas is now supported.

Bug 33007616 - Initial Load From Cassandra Crash For Out Of Memory

This issue has been fixed.

Bug 32792682 - CassandraCommitLogDirectoryReader - Exception while reading commitlogs .

This issue has been fixed.

Bug 32830352 - Upgraded Apache Commons IO 2.8.0.

This is a Security fix for CVE-2021-29425.

Enh 32455419 - Oracle GoldenGate for Big Data: S3 Event handler: Support Canned Access Control List

Support has been added to mutate permissions to the S3 object ACL using S3 Canned Access Control list. For more information, see Configuring the S3 Event Handler in the Oracle GoldenGate for Big Data User Guide.

Bug 32639595 - Avro and Kafka Connect - Error in timestamp logical types when source field is a date or time.

Timestamps sources can propagate as timestamp logical types. Dates and times cannot. This issue is fixed.

Bug 32609848 - Velocity template generates duplicate messages in the File Writer Handler when mode is tx.

This issue has been fixed.

Bug 32492392 - Failing to parse Timestamps from trail.

The issue with parsing timestamp column data from MySQL, PostreSQL, and DB2 sources has been fixed.

Bug 32322155 - GoldenGate Big Data JMS extract abends if decimal number starts with the decimal point.

This issue has been fixed.

Bug 32217448 - Adding trim to columnValue template

This issue has been fixed by adding a functionality to trim the parameter contents of the ${columnValue[]} parameters so that whitespace is supported. For more information, see Using Templates to Resolve the Topic Name and Message Key in the Oracle GoldenGate for Big Data User Guide.

Enh 32200821 - Metacolumn support for seqno and rba

This issue has been fixed. The following Metacolumn keywords have been added to resolve the trail file sequence number and rba respectively: ${seqno} and ${rba}. For more information, see Setting Metacolumn Output in the Oracle GoldenGate for Big Data User Guide.

Bug 32203093 - Secure database password in Oracle Wallet

Cassandra Capture added support to store the password for the Cassandra database in Oracle Wallet.

Bug 32619663 - Kafka Connect Handler to set the namespace and unique name generated row schemas for op formatted messages

Kafka Connect Handler to set the namespace and unique name generated row schemas for op formatted messages. To enable this functionality, the configuration property gg.handler.name.schemaNamespace must be set.

Bug 32430128: Upgrade Jackson Databind library to 2.12.1

The following security bug was fixed:

Enh 32203093: Secure database password inside Oracle Wallet

This issue has been fixed.

Enh 31953602 - Kafka Connect Handler add ability to control the namespace on generated schemas.

Added the configuration property gg.handler.name.schemaNamespace allowing the user better control of generated schema naming. For more information, see Kafka Connect Handler Configuration (Table Kafka Connect Handler Configuration Properties) in Using Oracle GoldenGate for Big Data.

Enh 31936725 - Stage and Merge: Redshift: COPY SQL Authorization enhancement

The Redshift Event Handler has been enhanced to support all the available COPY SQL S3 authorization mechanisms. For more information, see Redshift COPY SQL Authorization in Using Oracle GoldenGate for Big Data.

Enh 31721551 - Token output in the template mapper

The template mapper functionality has been enhanced with a new keyword to resolve token values - ${token[]}. For more information, see Using Templates to Resolve the Stream Name and Partition Name in Using Oracle GoldenGate for Big Data.

Bug 31960873 - Operation Delimited Text Formatter - Injecting 2 line delimiters after truncate operations

This issue has been fixed. The extra line delimiter after truncate operations has been removed.

Bug 31936543 - BigQuery handler : Dataset to be derived from table schema name

The table schema name specified in the replicat map statement has been mapped to the BigQuery dataset name. For more information, see Automated Table Creation in Using Oracle GoldenGate for Big Data.

Bug 32015766 - MongoDb target connection fails with 'Command failed with error 18 (AuthenticationFailed)'

This issue has been fixed.

Bug 31922247 - Kafka formatted message contains incorrect before image portion of the record

This issue has been fixed.

Bug 31839295 - The Avro Formatter formatOp operation failed. java.lang.ArithmeticException: Rounding necessary .

This issue has been fixed. The Avro Formatter has implement rounding when the scale setting requires rounding on Avro decimal logical types.

Enh 31814794 - The S3 Event Handler has implemented the ability to change AWS roles when STS is enabled.

This issue has been fixed. See S3 Handler Configuration in Using Oracle GoldenGate for Big Data.

Bug 31786482 - OCI Bucket Creation

This issue has been fixed by changing the bucket creation by the OCI automated bucket creation feature from a public to private access.

Bug 31526594 - ADW handler is abending with java.lang.ClassNotFoundException: oracle.jdbc.driver.OracleDriver

This issue has been fixed.

Bug 31524648 - ADW handler abending with ORA-00001: unique constraint error while processing UPSERT

This issue has been fixed.

Bug 31471259 - Remove flume example from AdapterExamples

This issue has been fixed. The flume example has been removed from the AdapterExamples folder.

Bug 31409651 - Oracle GoldenGate for Big Data Replicat Publish Messages to all Destination rather Defined Destination.

This issue has been fixed.

Enh 31404378 - OGGBD: Stage and Merge: ADW: Support compressed updates in the trail

Support has been added for compressed updates in the trail. For more information, see Troubleshooting and Diagnostics in the Using Oracle GoldenGate for Big Data.

Enh 31404362 - OGGBD: Stage and Merge: ADW: XMLTYPE support

An XML cast function has been introduced in the merge SQL to convert the CLOB value in the staging table to XMLTYPE.

Bug 31302830 - NO-OP updates applied even NOAPPLYNOOPUPDATES parameter

This issue has been fixed.

Enh 31316766 - HDFS Event Handler - Log HDFS configuration properites at debug level.

If the log level is set to DEBUG, then the HDFS configuration properties will be logged.

Enh 31202078 - Command Event Handler - Fail at initialization if script does not exist at configured location

This issue has been fixed.

Enh 29722965 - Elasticsearch Handler - Migrate from Transport APIs to High Level Rest Synchronous APIs

Support has been added for Elasticsearch High Level REST client. For more information, see Elasticsearch High Level REST Client Dependancies in the Using Oracle GoldenGate for Big Data.

Enh 30121870 - Stage and Merge support applying to ADW

This issue has been fixed by applying the Stage and Merge support to ADW.

Enh 31182988 - ADW: Support LOB updates

If the GoldenGate trail is generated by Oracle Integrated capture, then for the UPDATE operations on the source LOB column, only the changed portion of the LOB is written to the trail file. For more information, see Using the Autonomous Data Warehouse Event Handler in Using Oracle GoldenGate for Big Data.

Enh 27444427 - Kafka Handler - Add support for Kafka Headers

Kafka and Kafka connect support for headers have been added. For more information, see Using the Kafka Handler and Using the Kafka Connect Handler in Using Oracle GoldenGate for Big Data.

Enh 30564524 - Metacolumns functionality - Add output for primary key column names

The following two metacolumns have been added to the Avro formatters: ${primarykeycolumns} and ${currenttimestampiso8601}. For more information, see Using the Pluggable Formatters in Using Oracle GoldenGate for Big Data.

Bug 31114658 - ADW: External table is not fetching very small/large values in the AVRO file that has Decimal data type

This issue has been fixed.

Bug 31101426 - OGGBD: AVRO file generated by ADW/File writer with JDBC MDP is not correct for the NUMBER data types.

This issue has been fixed. The ADW configuration has been corrected.

Bug 30846809 - ADW handler: ORA-01830: date format picture ends before converting entire input string error

This issue has been fixed by using the following parameters: gg.eventhandler.adw.dateFormat=YYYY-MM-DD HH24:MI:SS and gg.eventhandler.adw.timestampFormat=YYYY-MM-DD HH24:MI:SS.FF9 in the ADW handler.

Bug 29650246 - Jms Extract hanging even after Jms server down

This issue has been fixed.

BUG 31235726 - Heartbeat table incorrect buffer handling which caused metadata mismatch on subsequent operations.

This issue was fixed.

BUG 31373926 - OCI Event Handler fails if OCI credentials lack admin privileges to interrogate and create OCI buckets.

This issue was fixed. The Oracle Cloud Infrastructure (OCI) Handler has been modified to work without admin privileges.

ENH 31071500 - Support capture of single record message containing binary data.

This issue has been fixed. Support was added to enable capturing of single record messages containing binary data.

BUG 31208539 - Duplicate record in transaction mode after processing RESTART ABEND record.

This issue was corrected by fixing duplicate operations when handling RESTART_ABEND with DDL operation from the last commit operation.

ENH 31073365 - Support TRIMSPACES, SPACESTONULL in Oracle GoldenGate replicat.

This issue was fixed by implementing missing TRIMSPACES, TRIMVARSPACES and SPACESTONULL parameters in Oracle GoldenGate BigData.

BUG 31256903 - Incorrect before image handling when involving ALLOWDUPTARGETMAP mode.

This issue is fixed by fixing missing BEFORE values when mapping the same source tables to different target tables.

BUG 31010774 Correct OCI Event Handler proxy server configuration.

This issue was fixed by adding the following properties to set the proxy settings: gg.eventhandler.name.proxySever, gg.eventhandler.name.proxyPort, gg.eventhandler.name.proxyProtocol, gg.eventhandler.name.proxyUsername, and gg.eventhandler.name.proxyPassword. For more information about these properties, see Configuring the Oracle Cloud Infrastructure Event Handler in the Using Oracle GoldenGate for Big Data Guide.

BUG 31297753 Upgrade log4j to version 2.13.2

The following security bug was fixed:

• CVE-2020-9488

BUG 30926357 - Property gg.handler.name.EnableTimestampLogicalType is not getting enabled with gg.format.timestamp

The feature to enable logical timestamps in Kafka Connect and Avro is not working when the content regex replacement feature is also enabled. This issue is fixed.

BUG 29875647 - Extract abends with error code 16002 when source data contains newlines

This issue has been fixed.

BUG 30843726 - Unable to Selected Parquet Writer Versions.

A new property gg.eventhandler.name.writerVersion has been added on the Parquet Event Handler to support the explicit selection of the Parquet writer version.

BUG 31038699 - OCI Event Handler - Does not work with 1.5.x+ versions of the OCI SDK

The version of the OCI Java SDK has been moved up in order to support newer regions. If the OCI Event Handler is used, then you must use version 1.5.4 or higher of the OCI Java SDK.

BUG 30916397 - HDFS Handler - Roll on Metadata change is broken

This issue is fixed.

BUG 30752010 Security Bug

BUG 31018223 Security Bug

Bug 25106122 - Possible SQL injection in Hive automated table creation.

The possible SQL injection in automated Hive table creation functionality was fixed.

30318721 - CVE-2018-11058: ORACLE SECURITY SERVICE UPGRADE

The following security vulnerabilities were fixed:

• CVE-2018-11058
• CVE-2016-0701
• CVE-2016-2183
• CVE-2016-6306
• CVE-2016-8610
• CVE-2018-11054
• CVE-2018-11055
• CVE-2018-11056
• CVE-2018-11057
• CVE-2018-15769