Deployment Overview

The Agent Factory application runs in a container, an isolated, lightweight package that lets the application to run consistently across environments. We use Podman, an open-source container engine, and Podman Compose to enable the application to run on multiple operating systems.

Currently supported operating systems:

• Oracle Linux 8 on AMDx86_64
• Oracle Linux 8 on ARM64
• MAC OS ARM64 (M.x chipsets)
• MAC OS Intel

Prerequisites

Regardless of the platform, Agent Factory requires the following prerequisites:

• Oracle AI Database 26ai: You will need access to an instance of Oracle AI Database 26ai. It is recommended to create a dedicated user for this purpose. This user should be used exclusively for managing Agent Factory’s tables and not for storing production data.

  Note: Oracle Database Knowledge Assistant requires that the user tablespace be a BIGFILE tablespace or at least 100GB.

• LLM endpoint: The Oracle AI Database Private Agent Factory relies on integration with a Large Language Model to function properly. You will require appropriate authentication credentials or an access key to connect the application with an available LLM instance of your choice.

Installation Modes

Oracle AI Database Private Agent Factory offers two installation modes:

1. Production: Production mode allows you to manually set up the database and LLM endpoint details. This setup empowers you to use your own credentials and connect with the supported LLM providers such as vLLM, OpenAI, Ollama, and the full catalogue of pre-trained foundational models that OCI GenAI offers. Resource usage is about 7 GB of device storage and 190 MB of RAM.

2. Quickstart: Quickstart mode sets up instances of an Oracle AI Database 26ai free, and Ollama with a pre-trained Llama3.2 LLM, via containers that operate locally within the same environment. This allows you to start using Agent Factory without the database and LLM setup. Resource usage is about 21 GB of device storage and 8928 MB of RAM.

By default, the container running Oracle AI Database Private Agent Factory uses port 8080. If you install on Quickstart mode, the Oracle AI Database 26ai free instance runs on port 1521, and the Ollama instance runs on port 11434. Ensure that these ports are available on your system to avoid installation issues.

Review your environment and development requirements to choose the installation mode that best suits your needs.

LLM Preferences

Use the table below to identify the recommended LLM configuration based on your operating system, VPN availability, and intended use case.

Note: Numbers in brackets [] indicate preference order (1 = most preferred).

Types of Setup

Oracle AI Database Private Agent Factory can be installed on both Linux and Mac environments. For both operating systems, you can choose between Production and Quickstart installation modes, with or without a VPN connection. Please refer to the appropriate links in the table for detailed setup instructions for your specific platform and installation scenario.

Linux

Oracle AI Database Private Agent Factory offers support for Linux environments based on X86-64 and ARM64 architectures.

Mac

Oracle AI Database Private Agent Factory is certified for Mac systems based on Intel and Apple Silicon Chips.