• OneLake Event Handler Automatic Configuration
  
• File Writer Handler Configuration
  
• Autoconfiguration of Parquet/ORC Event Handler
  
• OneLake Event Handler Configuration
  
• File Format for the Lakehouse target
  
• OneLake Event Handler Classpath Configuration
  
• OneLake Event Handler Authentication
  
• OneLake Event Handler Proxy Configuration
  
• Sample Configuration for Lakehouse Target
  
• Sample Configuration for Mirrored Database Target
  
• Performance Considerations
  

Primary key UPDATE behavior depends on the file-format configuration.

• Mirrored Database in Microsoft Fabric
  
• Lakehouse in Microsoft Fabric
  

The existing solution for ingesting data into Fabric mirrored tables uses a single landing folder for a specific table and a metadata file to specify key columns. However, this approach does not scale well for large tables as only a single replicat thread is used. To improve scalability, we can leverage Fabric’s partitioning feature and Oracle GoldenGate’s coordinated apply feature to distribute the workload for specific tables.

• Replicat MAP Statement
  
• Metadata File Updates
  
• Limitation
  

• Unsupported Operations:
  • DDL operations that DROP/RENAME table will not be replicated by the Replicat process.
  • Renaming columns of the table is not supported by the Microsoft application consuming the Fabric Mirroring format file.
  • TRUNCATE operations cannot be replicated.
• Error:

  com.azure.identity.CredentialUnavailableException: EnvironmentCredential authentication unavailable.Environment variables are not fully configured.

  This indicates that the Azure authentication parameters tenantId, clientId, and clientSecret are not configured. See Azure Tenant ID, Client ID, and Client Secret to configure the authentication parameters.
• Error:

  java.lang.IllegalArgumentException: Invalid tenant id provided. You can locate your tenant id by following the instructions  listed here:
  https://learn.microsoft.com/partner-center/find-ids-and-domain-names

  This indicates that the authentication parameter tenandId is invalid. See Azure Tenant ID, Client ID, and Client Secret to configure the authentication parameters.
• Error:

  com.microsoft.aad.msal4j.MsalServiceException: AADSTS700016: Application with identifier '<invalid_clientId>' was  not found in the directory '<tenant
   name>'.

  This indicates that the authentication parameter clientId with value <invalid_client_id> is incorrect. See Azure Tenant ID, Client ID, and Client Secret to configure the authentication parameters.
• Error:

  com.microsoft.aad.msal4j.MsalServiceException: AADSTS7000215: Invalid client secret provided.

  This indicates that the authentication parameter clientSecret is incorrect. See Azure Tenant ID, Client ID, and Client Secret to configure the authentication parameters.
• Error:

  com.azure.storage.file.datalake.models.DataLakeStorageException:  Status code 404,
  "{"error":{"code":"ArtifactNotFound","message":"Request Failed with  Artifact 'gglakehouse1_invalid.lakehouse' is not found in workspace
  'ggworkspace1'."}}"

  This indicates that the Fabric workspace name or lakehouse name is invalid. If the Fabric workspace or lakehouse does not exist, then you should create these before starting the replicat process. Ensure the configuration parameters gg.eventhandler.onelake.workspace and gg.eventhandler.onelake.lakehouse are set to the Fabric warehouse and lakehouse names respectively.
• Error:

  ONELAKE-00073 The event handler cannot proceed. The stage  file '<file_name>' in the directory '<directory_name>'  contains one or more truncate operations.
  Truncate operations cannot be  replicated into Microsoft Fabric OneLake Generic Mirror. Modify the  GoldenGate replicat parameter file and remove the line that contains  GETTRUNCATES and
  restart the replicat process.

  There are one or more TRUNCATE operations that were processed by the replicat process. To proceed, you need to remove the GETTRUNCATES parameter from the parameter file and restart the replicat process.
• Error:

  ONELAKE-00082 File name sequence number for table QASOURCE.TCUSTMER has reached the maximum limit of 99,999,999,999,999,999,999.

  You need to clear the backlog in OneLake or purge the last file with the highest sequence number and restart the replicat process.
• Error:

  The operation record in the trail sequence'<seqno>' at offset '<offset>' for the table '<table>' has missing column values.

  OneLake replication requires full images. You need to regenerate the trail files that contain full images for UPDATE operations, and restart the replication process.
• Mirrored Database Target:
  • Error:

    ONELAKE-00073 The event handler cannot proceed. The stage file '<file_name>' in  the directory '<directory_name>' contains one or more truncate  operations. Truncate operations cannot bereplicated into Mirrored  Database in Microsoft Fabric. Modify the GoldenGate replicat
    parameter  file and remove the line that contains GETTRUNCATES and restart the  replicat process.

    There are one or more TRUNCATE operations that were processed by the replicat process.

    To proceed, you need to remove the GETTRUNCATES parameter from the parameter file and restart the replicat process.

  • Error:

    ONELAKE-00082 File name sequence number for table QASOURCE.TCUSTMER has reached the maximum limit of
    99,999,999,999,999,999,999.

    User needs to clear the backlog in OneLake or purge the last file with the highest sequence number and restart the replicat process.

  • Error:

    The operation record in the trail sequence'<seqno>' at offset  '<offset>' for the table '<table>'
    has missing column values

    Replication to Mirrored Database in Microsoft Fabric requires full images.

    You need to regenerate the trail files that contain full images for UPDATE operations, and restart the replication process.

  • Error:

    Azure Identity => ERROR in getToken() call for scopes [https://storage.azure.com/.default]: java.io.UncheckedIOException: io.netty.channel.StacklessClosedChannelException
    {"az.sdk.message":"Failed to acquire a new access token.","exception":"java.io.UncheckedIOException: io.netty.channel.StacklessClosedChannelException"}

    The root cause for this issue is the definition order of the downloaded dependencies in gg.classpath in the replicat properties file. The correct order is as follows:

    gg.classpath=$THIRD_PARTY_DIR/onelake/*:$THIRD_PARTY_DIR/hadoop/*:$THIRD_PARTY_DIR/parquet/*