This connector utilizes the RODS Fusion Extraction Framework for loading bulk data from Fusion applications to Autonomous AI Database. Note that connections created using this connector can only be used as a source connection.

This topic has the following sections:

• Creating a Spectra Batch Processing Connection
• Creating a Spectra Batch Processing Data Load
• Running a Spectra Batch Processing Data Load
• Creating a Spectra Batch Processing Data Flow

Creating a Spectra Batch Processing Connection

To create this connection, you need to specify the Service URL and Token URL of the Oracle Fusion Cloud Applications service and the Client Id, Client Secret, and Auth Scope to connect to the service.

To define a Spectra Batch Processing Connection:

1. From the left pane of the Home page, click the Connections tab.

   Connections page appears.

2. Click Create Connection.

   Create Connection page slides in.

3. Do one of the following:
   • In the Select Type field, enter the name or part of the name of the connection type.
   • Select the Databases tab.
4. Select Spectra Batch Processing as the connection type.
5. Click Next.
6. The Connection Name field is pre-populated with a default name. You can edit this value.
7. In the Service URL text box, enter the URL for the Oracle Fusion Cloud Applications service.
8. In the Token URL text box, enter the OAuth token endpoint.
9. In the Client ID text box, enter the Client ID or Confidential OAuth application client ID.
10. In the Client Secret text box, enter the Confidential OAuth application secret.
11. In the Auth Scope text box, enter the scope for the Fusion Cloud Application.
12. After providing all the required connection details, click Test Connection to test the connection.
13. Click Create.

    The newly created connection is displayed in the Connections page.

    Click the Actions icon () next to the selected connection to perform the following operations:

    • Select Edit to edit the provided connection details.
    • Select Test Connection to test the created connection.
    • Click Export to export the connection. See Export Objects.
    • Select Delete Schema to delete schemas.
    • Select Delete Connection to delete the created connection.

    You can also search for the required connection to know its details based on the following filters:

    • Name of the connection.
    • Technology associated with the created connection.

Creating a Spectra Batch Processing Data Load

To create a data load you need to select the offering you want to use to load data from.

To create a Spectra Batch Processing Data Load,

1. Do one of the following:
   • On the Home page, click Load Data. The Create Data Load wizard appears.

     In the Create Data Load tab, enter a name if you want to replace the default value, add a description, and select a project from the drop-down.

   • On the Home page, click Projects, and then the required project tile. In the left pane, click Data Loads, and then click Create Data Load. The Create Data Load wizard appears.
2. Enter a name if you want to replace the default value and add a description.
3. For Load Processing, select the Internal radio button and from the Deployment Type drop-down select Data Transforms (Batch).
4. Click Next.
5. In the Source Connection tab,
   1. From the Connection Type drop-down, select a connection that you created using the instructions in Creating a Spectra Batch Processing Connection.
   2. From the Connection drop-down, select the required connection from which you wish to add the data stores.
   3. From Schema, choose the offering you want to load data from.
   4. Click Next.
6. In the Target Connection tab,
   1. From the Connection Type drop-down, select Oracle as the connection type.
   2. From the Connection drop-down, select the connection you want to use to load the data into.
   3. Select the schema that you want to use from the Schema drop down.
   4. Click Save.

   The Data Load Detail page appears listing all the source tables.

Running a Spectra Batch Processing Data Load

The Data Load Detail page displays the information that you need to run a data load. To run the data load, you can apply different actions on the data entities such as Incremental Merge, Incremental w/ Deletes, and Do Not Load before loading it to the target schema.

To run a data load,

1. In the Data Load Detail page, select the data entities that you want to move to the target schema.
2. To filter the displayed list, you can do one of the following:
   • Enter the name or part of the name in the Name text box. This search returns data entities that include the specified string in the name. For example, the search string AD returns results such as ADMIN, ADDRESS, BADGE, UPGRADE, WORKLOAD, and so on.
   • Turn on the Use Regular Expression toggle to use pattern matching to search for particular strings of characters. For example, the search string CO.* returns results such as CONTACT, COUNT, COUNTRY and so on.
   You can select multiple data entities and load them to the target schema. You can also sort the displayed list using the following options:

   • All - Displays all the data entities that match the search criteria.
   • Selected - Displays all the rows that you selected.
   • Unselected - Displays all the unselected rows.
   • Invalid – Displays all the invalid rows.

   Note:

   These options display the list of data entities based on the search criteria. To view the list of all data entities, clear any applied filters.
3. Click on the required icon to choose any of the following actions:
   • Incremental Merge - Updates the data in the selected column by comparing the source table with the target table.
   • Do Not Load – Skips the selected data entity from the data load job. After you click Save, these data entities are no longer available for future data load jobs.

   You can select multiple data entities and apply different actions. The unsaved rows are highlighted in bold.

4. To configure options for running the data load job, click Settings and set the following:
   • Spectra job polling interval - Set the polling interval for monitoring the job. The value is set to the recommended optimal value of 19 seconds. You can reset this to the default value of 4 seconds.
   • Spectra Job Timeout - Specify the maximum timeout before the job is considered as failed. A blank value means there is no timeout. The value is set to the recommended optimal value of 1200 seconds. You can reset this to the default value of 1000 seconds.
5. Click to save the changes. A green checkmark () in the row indicates that the changes are saved.
6. To start the data load,
   • Click .

   A confirmation prompt appears when the data load starts successfully.

To check the status of the data load, see the Status panel on the right below the Target Schema details. For details about the Status panel, see Monitor Status of Data Loads, Data Flows, and Workflows. This panel shows links to the jobs that execute to run this data load. Click the link to monitor the progress on the Job Details page. For more information about jobs, see Create and Manage Jobs.

Creating a Spectra Batch Processing Data Flow

You can define a data flow to move data from a source Spectra Batch Processing connection to a target Oracle Autonomous Database. Note that you cannot use a Spectra Batch Processing connection as a target for mapping.

To create a data flow,

1. Follow the instructions in Create a Data Flow to create a new data flow.
2. In the Data Flow Editor click Add a Schema to define your source connection. From the Connection drop-down, select the Oracle Business Intelligence Cloud Connector connection and the schema that you want to use from the drop down. Click OK.
3. Similarly add more schemas to the data flow.
4. Drag the table that you want to use as a source in the data flow and drop it on the design canvas.
5. Drag the table that you want to use as a target in the data flow and drop it on the design canvas.
6. Select one of the objects on the design canvas, and drag the Connector icon () next to it to connect the components.
7. Click Save. After saving a Transfer button is added to the data flow.
8. Click on the Transfer button and in the Properties pane to the right, click Options ().
9. Set the following transfer options, as required:
   • Spectra job polling interval - The polling interval (in seconds) for monitoring the job. The default value is 4 seconds. The recommended optimal value is 19 seconds.
   • Spectra job Timeout - The maximum timeout (in seconds) before the job is considered as failed. A blank value means there is no timeout. The default value is 1000 seconds. The recommended optimal value is 1200 seconds.
   • Conn timeout millis - The connection timeout (in milliseconds) for opening the HTTP connection. The default value is 5000 milliseconds.
   • Read timeout millis - The read timeout (in milliseconds) for waiting on the HTTP response. The default value is 15000 milliseconds.
10. Save and execute the data flow.