2 Migrating from Oracle Data Integrator Cloud Services to Oracle Data Integrator Marketplace
This chapter describes how to migrate the Oracle Data Integrator repository of Oracle Data Integrator Cloud Service (ODI-CS) to Oracle Data Integrator on Marketplace at the database level, using Data Pump.
This chapter contains the following sections:
Note:
Migration using data pump should only be done when the repository is very large. For smaller repositories, a standard export/import is enough. For more information on exporting/importing repositories, refer Repository-Level Export/Import section of Developing Integration Projects with Oracle Data Integrator.
2.1 Exporting the ODI-CS Repository
You can export the ODI-CS repository using SQL Developer (Data Pump Wizard) or with the following OS-line command:
expdp SYSTEM/<PASSWOD>@<TNS_NAME> schemas=<SCHEMA_NAME> directory= DATA_PUMP_DIR_PDB dumpfile=<DUMP_FILE_NAME > logfile=<LOG_FILE_NAME>
2.2 Provisioning DBaaS
Follow the provisioning Wizard for DBaaS System and Database as described in the below section:
https://docs.cloud.oracle.com/en-us/iaas/Content/Database/Tasks/creatingDBsystem.htm
The DBaaS version should be the same as the DBCS version used in ODI-CS.
2.3 Provisioning ATP
Refer to the tutorial, Getting Started and Provisioning Autonomous Transaction Processing for detailed steps on how to provision ATP.
2.4 Provisioning ODI Marketplace
For detailed information on provisioning ODI Marketplace, see Launching Your Oracle Data Integrator Instance.
After provisioning, the standalone agent is available by default. It is possible to switch the standalone agent (that comes with ODI Marketplace) to point to the new repository. However, if a standalone collocated/weblogic agent is required, it has to be installed separately. For more information on setting up a standalone collocated agent, see Creating a Standalone Collocated Agent.
2.5 Installing the required ODI version in ODI Marketplace node
The ODI version installed in the ODI Marketplace node must be the same as that used in ODI-CS.
Follow the below steps to install the required ODI version in the ODI Marketplace node:
- Use SSH to connect to the ODI Marketplace node.
- Create a new directory and download the required ODI version into this directory.
- Unzip the files and run the ODI installer.
- In the Welcome screen, click Next.
- In the Auto Updates screen, select Skip Auto Updates. Click Next.
- In the Installation Location screen, specify the Oracle Home using the directory you created for ODI. Click Next.
- In the Installation Type screen, leave the default selected “Standalone Installation” as it is and click Next.
- In the Prerequisite Checks screen, click Next when the prerequisite check is 100% complete.
- In the Security Updates screen, uncheck the security updates option and click Next.
- Click Yes in the warning dialog box. This is a temporary installation, so we do NOT need to connect to support.
- In the Installation Summary screen, verify the installation information and click Install.
- In the Installation Progress screen, you can see the progress of the process. This might take several minutes. Once all tasks are successfully finished, click Finish.
2.6 Creating an ODI Repository in DBaaS
You can create an ODI repository in DBaaS using the repository creation utility (rcu). The repository version must be the same as that used in ODI-CS.
Follow the below steps to create an ODI repository in DBaaS with rcu:
2.7 Importing the ODI Repository into the DBaaS node
Follow the below steps to import the ODI repository into the DBaaS node:
-
Use SSH to connect to the DBaaS node into which you will import the ODI repository.
-
Execute the following
impdp
command:impdp SYSTEM/<PASSWORD>@<DBBaaS_system> schemas=DEV_ODI_REPO directory=DATA_PUMP_DIR_PDB dumpfile=<DUMP_FILE_NAME> logfile=<LOG_FILE_NAME> TABLE_EXISTS_ACTION=REPLACE
Please ensure that the
TABLE_EXISTS_ACTION
option is included in the command.
2.8 Verifying access to the DBaaS ODI Repository in ODI Studio
- Navigate to the
$MW_HOME/odi/studio
directory. - Execute
odi.sh
. - In the Confirm Import Preferences screen, click No.
- Click Connect to Repository available on the left panel.
- On the Oracle Data Integrator Login screen, click the plus sign (+) icon to add the repository. The Repository Connection Information screen appears.
- Specify the Oracle Data Integrator connection details as follows:
- Login Name: Specify a custom login name. You can provide a name that will remind you of the purpose of this repository.
- User: Specify
SUPERVISOR
. - Password: The password of your original ODI repository.
- Specify the Database Connection (Master Repository) details as follows:
- User: The schema owner (in the newly created repository).
- Password: The password of the schema owner.
- Driver List: Select Oracle JDBC Driver from the drop-down list.
- Driver Name: This is automatically populated to 'oracle.jdbc.OracleDriver'.
- URL: Specify the connection URL. The connection URL should be in the following format:
jdbc:oracle:thin:@<host>:<port/ServiceName>
.
- Click Test to test the connection to the repository.
- On receiving a successful connection message, click OK.
- Click OK in the Repository Connection Information screen.
- In the Oracle Data Integrator Login screen, click OK.
- Navigate to the Topology tab on the left panel.
- Expand the Work Repositories node and double-click WORKREP. You will receive an error message. Click OK.
- To change the connection information to the DBaaS repository, click on the plug icon in the top left corner of the screen.
- Provide the database user (DBaaS) for the repositories and its password. Then click on the JDBC link on the left pane.
- Provide the connection URL to the DBaaS server and click Test Connection.
- Click Yes in the confirmation window.
- Click Test to test the connection to the repository. Please ensure that you do not change the agent specified here.
- On receiving a successful connection message, click OK.
2.10 Exporting the Migrated Repository
You can export the migrated repository using SQL Developer (Data Pump Wizard) or with the following OS-line command:
expdp SYSTEM/<PASSWOD>@<TNS_NAME> schemas=<SCHEMA_NAME> directory= DATA_PUMP_DIR_PDB dumpfile=<DUMP_FILE_NAME > logfile=<LOG_FILE_NAME>
Please note that you need to use DATA_PUMP_DIR_PDB
in the command, and not DATA_PUMP_DIR
.
2.11 Importing the Migrated Repository into ATP
To import the migrated repository into ATP, do the following:
-
Upload the exported upgrade repository to Object Storage, so that it can be accessed from ATP.
-
Create credentials in your ATP system so that you can access your Object Storage:
BEGIN DBMS_CLOUD.PUT_OBJECT(credential_name => 'ODI_MIG', object_uri => 'https://objectstorage.us-phoenix-1.oraclecloud.com/n/<NAMESPACE>/b/<BUCKET_NAME>/o/< DUMP_FILE_NAME>', directory_name => 'DATA_PUMP_DIR', file_name => '<DUMP_FILE_NAME>'); END; /
-
You can import the file using SQL Developer (Data Pump Wizard) or with the following OS-line command:
impdp ADMIN/<PASSWORD>@<TNS_NAME> directory=data_pump_dir credential=ODI_MIG dumpfile=https://objectstorage.us-phoenix-1.oraclecloud.com/n/orasenatdpltinfomgmt01/b/MAGU_Bucket/o/MIG_ODI_REPO.dmp parallel=16 partition_options=merge table_exists_action=REPLACE transform=segment_attributes:n transform=dwcs_cvt_iots:y transform=constraint_use_default_index:y exclude=index,cluster,indextype,materialized_view,materialized_view_log,materialized_zonemap,db_link REMAP_SCHEMA=<SOURCE_SCHEMA>:<TARGET_SCHEMA>
Note:
This procedure is only applicable for ATP-D.
2.12 Verifying access to the Migrated Repository in ODI Marketplace Studio
- Once the repository has been successfully imported, start ODI Studio in your new ODI Marketplace node.
- Click Connect to Repository available on the left panel. The Oracle Data Integrator Login screen appears.
- To modify the repository connection information, click on the pencil icon. The Repository Connection Information screen appears.
- Modify the repository connection information as follows:
- Password (for
SUPERVISOR
): Change the Supervisor password to the one you had in your original ODI repository in the Oracle Data Integrator Cloud Service. - Use Credential File: Select the check box.
- Credential File: Browse and select the wallet file in
/home/opc
directory. - Connection Details: Select your low connection.
- Work Repository: Select Master Repository Only.
- Password (for
- Click Test Connection.
- On receiving a successful connection message, click OK.
- Click OK in the Repository Connection Information screen.
- In the Oracle Data Integrator Login screen, click OK.
- Navigate to the Topology tab on the left panel.
- Open the Repositories panel.
- Expand the Work Repositories node and double-click WORKREP.
- To change the connection information to the ADB repository, click the Connection Information button on the top left corner of the screen.
- Provide the database user (ADB) for the repositories and its password. Then click the JDBC link on the left pane.
- Provide the connection URL to the ADB server in the JDBC URL field and click Test Connection.
- In the confirmation window, click Yes.
- Click Test. Ensure that you do not change the Physical Agent specified here.
- On receiving a successful connection message, click OK.
- Disconnect from the repository by clicking on the unplug icon.
- Click Connect to Repository available on the left panel. The Oracle Data Integrator Login screen appears.
- To repoint the work repository, click on the pencil icon. The Repository Connection Information screen appears.
- Select the Work Repository radio button at the bottom of the screen. Then click on the magnifying glass on the right side.
- Select the work repository that is displayed in the Select Repository screen and click OK.
- Click OK in the Repository Connection Information screen. You are now in your repository in ODI Marketplace.