Oracle Cloud Infrastructure Documentation

Getting a Data Ingestion Job's Details in Generative AI Agents

View ingestion job details, including file processing details and status logs.
  1. On the Knowledge Bases list page, select the knowledge base that you want to see its data source ingestion jobs. If you need help finding the list page, see Listing Knowledge Bases.
  2. Select the data source that you want to see its data ingestion jobs.
  3. Select the ingestion job that you want to see its details.

    The status of the ingestion job appears below the JOB icon. For the description of a job status and the action to take if there is a failure issue, see Ingesting Data Source Data, Step 6.

  4. View the following details in the Ingestion information tab:
    • Basic information such as the ingestion job OCID, display name, description, compartment OCID
    • The following numbers, depending on the ingestion job that was run:
      • Number of ingested files
      • Number of failed files
      • Number of ignored files
    • Job duration
    • Creator
    • Creation date and time
  5. Select the Tags tab to see any tags associated with this ingestion job.
  6. Under Resources, select Status logs to view file processing details in this ingestion job.

    File ingestion processing details include the type and number of files that are processed, and the outcomes. If there are individual file failures, review the failure reason and the action that you can take to address each file failure. If there is a global failure (for example, the entire processing stopped or failed), details are also provided in the status logs.

    Important

    After Creating an Ingestion Job
    1. Review the status logs to confirm that all updated files were successfully ingested. This section is especially important when you update a data source or manually run an ingestion job to include the updates.
    2. If the ingestion job fails (for example, because of a file being too large), address the issue and restart the job. See also Ingesting Data Source Data, Step 6.
    How the Ingestion Pipeline Handles Previously Run Jobs

    When you restart a previously run ingestion job, the pipeline:

    1. Detects files that were successfully ingested earlier and skip them.
    2. Only ingests files that failed previously and have since been updated.
    Example Scenario

    Suppose you have 20 files to ingest, and the initial job run results in 2 failed files. When you restart the job, the pipeline:

    1. Recognizes that 18 files have already been successfully ingested and ignore them.
    2. Ingests only the 2 files that failed earlier and have since been updated.
  7. Select Download logs to download the details for this ingestion job.
  8. Under Resources, select Work requests and then select a work request to see the log messages and error messages for that work request.