10.8.6 Cloudera Data Platform

10.8.6.1 About Cloudera Data Platform Connections

A Cloudera Data Platform (CDP) connection is a named connection definition that stores the configuration information required to connect Oracle GoldenGate for Distributed Applications and Analytics (GG DAA) to Cloudera Data Platform services.

The connection definition includes:

  • Core Site XML configuration
  • Common Settings
  • Proxy Settings, when required

Each connection is identified by a unique connection alias. During Replicat creation, the selected connection alias supplies the generated connection reference used by the Replicat configuration.

With Connection Config, the CDP configuration is securely stored in Oracle GoldenGate for Distributed Applications and Analytics, managed separately from the Replicat configuration, and can be reused across multiple Replicat processes.

Note:

A CDP connection stores only the information required to establish the connection. Configure CDP-specific handler properties separately.

10.8.6.2 Before You Begin

Before creating a CDP connection, obtain the
core-site.xml
configuration file for the target Cloudera Data Platform environment. Ensure that the Oracle GoldenGate deployment can access the CDP environment and has the required client libraries.

For CDP connection configuration, ensure that you have the following:

  • Core Site XML: The core-site.xml file that contains the required Cloudera Data Platform and Hadoop filesystem configuration. The file content is stored in Base64-encoded form.
  • Common Settings (Optional): Common connection properties, such as the runtime classpath, if required by the deployment.
  • Network Connectivity: Network connectivity from the Oracle GoldenGate deployment to the target CDP environment.
  • CDP Client Libraries: The required CDP and Hadoop client libraries available to the Replicat runtime.
  • Proxy Information (Optional): Proxy configuration details if the deployment accesses CDP through an HTTP proxy.

10.8.6.3 Create and Validate a Cloudera Data Platform Connection

Use the Add Connection page to create a CDP connection.

Procedure

  1. In the navigation menu, select DB Connections.
  2. Click Add Connection.
  3. In Connection Alias, enter a unique name for the connection.
  4. From Technology Type, select Cloudera Data Platform.
  5. In the Technology Settings section, provide the CDP connection information.

    Core Site XML: Upload or provide the core-site.xml configuration file for the target CDP environment. This field is required.

  6. Configure the following settings:
    • Common Settings: if additional runtime configuration is required.
    • Classpath: Specify the full path to the Cloudera Data Platform required by the Replicat type. You can use Dependency Downloader to download supported client libraries.
  7. (Optional) In the Proxy Settings section, configure proxy information only if the Oracle GoldenGate deployment accesses CDP through an HTTP proxy.
    • Proxy URL: Specifies the URL or host name of the proxy server.
    • Proxy Port: Specifies the proxy server port number.
    • Proxy Username: Specifies the user name for proxy authentication, if required.
    • Proxy Password: Specifies the password for proxy authentication.
    • Truststore: Specifies the Java truststore file used to validate the proxy server certificate, when required.
    • Truststore Password: Specifies the password associated with the truststore.
    • Keystore: Specifies the Java keystore file containing the client certificate and private key, when required.
    • Keystore Password: Specifies the password associated with the keystore.
    • SSL Key Password: Specifies the password protecting the private key when it differs from the keystore password.

    Note:

    If the deployment has direct network connectivity to CDP, leave Proxy Settings blank.
  8. Click Submit to create the connection.
  9. On the DB Connections page, run DB Login to validate the connection. Verify that the connection is successfully validated.
  10. After successful validation, the connection is displayed in the DB Connections table and is available for selection during Replicat creation.

Note:

A successful DB Login validates only the saved connection information. It does not validate the Replicat configuration or CDP-specific handler configuration.

10.8.6.4 Use a Cloudera Data Platform Connection in Replicat

After the CDP connection has been successfully validated, you can associate it with a Replicat.

  1. Start the
    Create Replicat
    workflow.
  2. Select Cloudera Data Platform as the target technology.
  3. Select the validated CDP target alias.
  4. Review the generated connection reference.
  5. Complete the remaining Replicat configuration.
  6. Create the Replicat.

The selected connection alias supplies the generated connection reference in the Replicat configuration.

For example:

gg.handler.<handler>.connectionId=<GENERATED_CONNECTION_ID>
gg.handler.<handler>.connectionAlias=<CDP_CONNECTION_ALIAS>

Note:

  • Do not change the generated connection ID or connection alias.
  • After creating the Replicat, configure the CDP-specific handler properties separately.

Related Topics