Oracle Cloud Infrastructure Documentation

Creating a Dedicated AI Cluster for Fine-Tuning Custom Models

Create a dedicated AI cluster resource in OCI Generative AI to use for fine-tuning custom models.

Important

Some OCI Generative AI foundational pretrained base models supported for the dedicated serving mode are now deprecated and will retire no sooner than 6 months after the release of the 1st replacement model. You can host a base model, or fine-tune a base model and host the fine-tuned model on a dedicated AI cluster (dedicated serving mode) until the base model is retired. For dedicated serving mode retirement dates, see Retiring the Models.
    1. On the Dedicated AI clusters list page, select Create dedicated AI cluster. If you need help finding the list page, see Listing Dedicated AI Clusters.
    2. Select a compartment to create the dedicated AI cluster in. The default compartment is the same as the list page, but you can select any compartment that you have permission to work in.
    3. (Optional) Enter a name and description for the cluster. If you don't enter a name, the system generates one that you can change later.

      The generated name has the format generativeaidedicatedaicluster<timestamp>. For example: generativeaidedicatedaicluster20250922181431

    4. For Cluster type, select Fine-tuning.
    5. For Base model, select the foundational base model for the custom model that you want to fine-tune on this cluster.
      Important

      The number of units in a fine-tuning cluster is preset and depends on the foundational base model selected for fine-tuning. Fine-tuning clusters need more resources than hosting clusters because they use more GPUs. You can fine-tune several models on the same cluster, as long as the custom models train on the same foundational base model.
    6. Read the commitment unit hours for the fine-tuning cluster and select the checkbox to agree to the commitment.
    7. (Optional) Select Add tag and assign tags to this cluster.
    8. Select Create.
    Note

    Fine-tuning clusters take some time to create. After a fine-tuning cluster is in an active state, you can use it to fine-tune custom models. You can select a cluster for fine-tuning when you create a custom model.

  • Use the dedicated-ai-cluster create command and required parameters to create a dedicated AI cluster:

    oci generative-ai dedicated-ai-cluster create 
--compartment-id <compartment-OCID>
--type FINE_TUNING
--unit-count [integer]
--unit-shape [text]
[OPTIONS]

    For a complete list of parameters and values for CLI commands, see the CLI Command Reference.

  • Run the CreateDedicatedAiCluster operation to create a dedicated cluster.