About Model Retirement
OCI Generative AI retires its large language models (LLMs) based on each model's type and serving mode. The LLMs serve the user requests in either an on-demand mode or a dedicated mode. Review the following sections to learn about each serving mode and how you can get notified before a model retires.
On-Demand Mode
- You pay as you go for each inference call when you use the models in the playground or when you call the models through the API.
- Available for the Pretrained Foundational Models in Generative AI in regions not listed as (dedicated AI cluster only).
- Retirement for On-Demand Mode
-
When a model is retired in the on-demand mode, it's no longer available for use in the Generative AI service playground or through the Generative AI Inference API.
- Deprecation for On-Demand Mode
-
When a model is deprecated in the on-demand mode, it remains available in the Generative AI service, but has a defined amount of time that it can be used before it's retired. This amount of time is longer for the dedicated mode.
For the OCI Generative AI models, see the model retirement dates (on-demand mode).
Dedicated Mode
- You get a dedicated set of GPUs for your dedicated AI clusters.
- You can create custom models on the dedicated AI clusters, by fine-tuning a subset of the Pretrained Foundational Models in Generative AI listed for fine-tuning.
- You can host replicas of the foundational and fine-tuned models on your dedicated AI clusters.
- You commit in advance to certain hours of using the dedicated AI clusters. For prices, see the pricing page.
- Available for the Pretrained Foundational Models in Generative AI in all listed regions.
- Retirement for Dedicated Mode
-
When a model is retired in the dedicated mode, you can no longer create a dedicated AI cluster for the retired model, but an active dedicated AI cluster running a retired model continues to run. A custom model, that's running off a retired model also continues to be available for active dedicated AI clusters and you can continue to create new dedicated AI clusters with a custom model that was created on a retired model. However, Oracle offers limited support for these scenarios, and Oracle engineering might ask you to upgrade to a supported model to resolve issues related to your model.
To request for a model to stay alive longer than the retirement date in a dedicated mode, create a support ticket.
- Deprecation for Dedicated Mode
-
When a model is deprecated in the dedicated mode, it remains available in the Generative AI service, but has a defined amount of time that it can be used before it's retired. The dedicated mode deprecation time is longer than the on-demand deprecation time of the same model.
For the OCI Generative AI models, see the model retirement dates (dedicated mode).