Table of Contents

• Title and Copyright Information
• Preface
  • Audience
  • Documentation Accessibility
  • Diversity and Inclusion
  • Set Up Java Access Bridge to Implement Java Accessibility
  • Command Syntax
  • Conventions
• 1 Oracle Grid Infrastructure Installation Checklist
  • Server Hardware Checklist for Oracle Grid Infrastructure
  • Operating System Checklist for Oracle Grid Infrastructure and Oracle RAC
  • Server Configuration Checklist for Oracle Grid Infrastructure
  • Network Checklist for Oracle Grid Infrastructure
  • User Environment Configuration Checklist for Oracle Grid Infrastructure
  • Storage Checklist for Oracle Grid Infrastructure
  • Cluster Deployment Checklist for Oracle Grid Infrastructure
  • Installer Planning Checklist for Oracle Grid Infrastructure
• 2 Checking and Configuring Server Hardware for Oracle Grid Infrastructure
  • Logging In to a Remote System Using X Window System
  • Checking Server Hardware and Memory Configuration
• 3 Automatically Configuring Oracle Linux with Oracle Database Preinstallation RPM
  • About the Oracle Database Preinstallation RPM
  • Overview of Oracle Linux Configuration with Oracle Database Preinstallation RPM
  • Installing the Oracle Database Preinstallation RPM Using ULN
  • Installing Oracle Database Preinstallation RPM During an Oracle Linux Installation
  • Installing Oracle Oracle Database Preinstallation RPM Using the Oracle Linux yum Server
  • Configure Additional Operating System Features
• 4 Configuring Operating Systems for Oracle Grid Infrastructure on Linux
  • Guidelines for Linux Operating System Installation
    • Completing a Minimal or Default Linux Installation
    • About Oracle Linux with the Unbreakable Enterprise Kernel
    • Configuring HugePages on Linux
    • Restrictions for HugePages and Transparent HugePages Configurations
  • Reviewing Operating System and Software Upgrade Best Practices
    • General Upgrade Best Practices
    • New Server Operating System Upgrade Option
    • Upgrading Operating System for an Oracle Grid Infrastructure Server
    • Oracle ASM Upgrade Notifications
  • Reviewing Operating System Security Common Practices
  • About Installation Fixup Scripts
  • About Automatic Self Correction
  • About Operating System Requirements
  • Operating System Requirements for x86-64 Linux Platforms
    • General Guidelines for Operating System Packages
    • Supported Oracle Linux 9 Distributions for x86-64
    • Supported Oracle Linux 8 Distributions for x86-64
    • Supported Red Hat Enterprise Linux 9 Distributions for x86-64
    • Supported Red Hat Enterprise Linux 8 Distributions for x86-64
    • Supported SUSE Linux Enterprise Server 15 Distributions for x86-64
    • Installing Operating System Packages
  • Additional Drivers and Software Packages for Linux
    • Installing PAM for Login Authentication on Linux
    • Installing OCFS2
    • Installation Requirements for ODBC and LDAP
      • About ODBC Drivers and Oracle Database
      • Installing ODBC Drivers for Linux x86-64
      • About LDAP and Oracle Plug-ins
      • Installing the LDAP Package
    • Installing Oracle Messaging Gateway
    • Installation Requirements for Programming Environments for Linux
      • Installation Requirements for Programming Environments for Linux x86-64
    • Installation Requirements for Web Browsers
  • Checking Kernel and Package Requirements for Linux
  • Setting Clock Source for VMs on Linux x86-64
  • Installing the cvuqdisk RPM for Linux
  • Reviewing HugePages Memory Allocation
  • Setting Transparent HugePages to madvise
  • Enabling the Name Service Cache Daemon
  • Verifying the Disk I/O Scheduler on Linux 8 and Later Systems
  • Using Automatic SSH Configuration During Installation
  • Setting Network Time Protocol for Cluster Time Synchronization
  • Verifying Digital Signature and Integrity of Installation Archive Files
• 5 Configuring Networks for Oracle Grid Infrastructure and Oracle RAC
  • About Oracle Grid Infrastructure Network Configuration Options
  • Understanding Network Addresses
    • About the Public IP Address
    • About the Private IP Address
    • About the Virtual IP Address
    • About the Grid Naming Service (GNS) Virtual IP Address
    • About the SCAN
    • About Shared SCAN
  • Network Interface Hardware Minimum Requirements
  • Private IP Interface Configuration Requirements
  • IPv4 and IPv6 Protocol Requirements
  • Oracle Grid Infrastructure IP Name and Address Requirements
    • About Oracle Grid Infrastructure Name Resolution Options
    • Cluster Name and SCAN Requirements
    • IP Name and Address Requirements For Grid Naming Service (GNS)
    • IP Name and Address Requirements for Manual Configuration of Cluster
    • Confirming the DNS Configuration for SCAN
  • Broadcast Requirements for Networks Used by Oracle Grid Infrastructure
  • Multicast Requirements for Networks Used by Oracle Grid Infrastructure
  • Domain Delegation to Grid Naming Service
    • Choosing a Subdomain Name for Use with Grid Naming Service
  • Configuration Requirements for Oracle Flex Clusters
    • Understanding Oracle Flex Clusters
    • About Oracle Flex ASM Clusters Networks
    • General Requirements for Oracle Flex Cluster Configuration
    • Oracle Flex Cluster DHCP-Assigned Virtual IP (VIP) Addresses
    • Oracle Flex Cluster Manually-Assigned Addresses
  • Grid Naming Service Cluster Configuration Example
  • Manual IP Address Configuration Example
  • Network Interface Configuration Options
  • Multiple Private Interconnects and Oracle Linux
  • Creating SCAN Client Data File
• 6 Configuring Users, Groups and Environments for Oracle Grid Infrastructure and Oracle Database
  • Creating Groups, Users and Paths for Oracle Grid Infrastructure
    • Determining If an Oracle Inventory and Oracle Inventory Group Exist
    • Creating the Oracle Inventory Group If an Oracle Inventory Does Not Exist
    • About Oracle Installation Owner Accounts
    • Restrictions for Oracle Software Installation Owners
    • Identifying an Oracle Software Owner User Account
    • About the Oracle Base Directory for the grid User
    • About the Oracle Home Directory for Oracle Grid Infrastructure Software
    • About Creating the Oracle Home and Oracle Base Directory
  • Oracle Installations with Standard and Job Role Separation Groups and Users
    • About Oracle Installations with Job Role Separation
    • Standard Oracle Database Groups for Database Administrators
    • Extended Oracle Database Groups for Job Role Separation
    • Creating an ASMSNMP User
    • Oracle Automatic Storage Management Groups for Job Role Separation
  • Creating Operating System Privileges Groups
    • Creating the OSASM Group
    • Creating the OSDBA for ASM Group
    • Creating the OSOPER for ASM Group
    • Creating the OSDBA Group for Database Installations
    • Creating an OSOPER Group for Database Installations
    • Creating the OSBACKUPDBA Group for Database Installations
    • Creating the OSDGDBA Group for Database Installations
    • Creating the OSKMDBA Group for Database Installations
    • Creating the OSRACDBA Group for Database Installations
  • Creating Operating System Oracle Installation User Accounts
    • Creating an Oracle Software Owner User
    • Modifying Oracle Owner User Groups
    • Identifying Existing User and Group IDs
    • Creating Identical Database Users and Groups on Other Cluster Nodes
    • Example of Creating Minimal Groups, Users, and Paths
    • Example of Creating Role-allocated Groups, Users, and Paths
  • Configuring Grid Infrastructure Software Owner User Environments
    • Environment Requirements for Oracle Software Owners
    • Procedure for Configuring Oracle Software Owner Environments
    • Checking Resource Limits for Oracle Software Installation Users
    • Setting Remote Display and X11 Forwarding Configuration
    • Preventing Installation Errors Caused by Terminal Output Commands
  • Enabling Intelligent Platform Management Interface (IPMI)
    • Requirements for Enabling IPMI
    • Configuring the IPMI Management Network
    • Configuring the Open IPMI Driver
    • Configuring the BMC
    • Configuring BMC Using IPMItool
• 7 Supported Storage Options for Oracle Database and Oracle Grid Infrastructure
  • Supported Storage Options for Oracle Grid Infrastructure
  • Oracle ACFS and Oracle ADVM
    • Oracle ACFS and Oracle ADVM Support on Linux x86–64
    • Restrictions and Guidelines for Oracle ACFS
  • Storage Considerations for Oracle Grid Infrastructure and Oracle RAC
  • Guidelines for Using Oracle ASM Disk Groups for Storage
  • Guidelines for Configuring Oracle ASM Disk Groups on NFS
  • Using Logical Volume Managers with Oracle Grid Infrastructure and Oracle RAC
  • Using a Cluster File System for Oracle Clusterware Files
  • About NFS Storage for Data Files
  • About Direct NFS Client Mounts to NFS Storage Devices
• 8 Configuring Storage for Oracle Grid Infrastructure
  • Configuring Storage for Oracle Automatic Storage Management
    • Identifying Storage Requirements for Oracle Automatic Storage Management
    • Oracle Clusterware Storage Space Requirements
    • Using an Existing Oracle ASM Disk Group
    • About Upgrading Existing Oracle Automatic Storage Management Instances
    • Selecting Disks to use with Oracle ASM Disk Groups
    • Specifying the Oracle ASM Disk Discovery String
    • Creating Files on a NAS Device for Use with Oracle Automatic Storage Management
  • Configuring Storage Device Path Persistence Using Oracle ASMFD
    • About Oracle ASM with Oracle ASM Filter Driver
    • Configuring Oracle ASM Filter Driver
      • Configuring Oracle ASM Filter Driver During Installation
      • Configuring Oracle ASM Filter Driver After Installation
    • About Migrating From Oracle ASMLib to Oracle ASM Filter Driver
      • Migrating Oracle ASM Disk Groups Including OCR or Voting Files
      • Migrating Oracle ASM Disk Groups with Oracle Cluster Registry or Voting Files
    • Determining If Oracle ASM Filter Driver Is Configured
  • Configuring NVMe Over Fabrics Storage Devices with Oracle ASM
    • About Using NVMe Over Fabrics Devices for Data Files
    • Requirements and Guidelines for NVMe Over Fabrics Storage
    • Creating an NVMe-oF Storage Target
    • Creating an NVMe Configuration File and Using NVMe-oF Devices
  • Using Disk Groups with Oracle Database Files on Oracle ASM
    • Identifying and Using Existing Oracle Database Disk Groups on Oracle ASM
    • Guidelines for Creating Disk Groups for Oracle Database Data Files
    • Creating Directories for Oracle Database Files
  • Configuring File System Storage for Oracle Database
    • Configuring NFS Buffer Size Parameters for Oracle Database
    • Checking TCP Network Protocol Buffer for Direct NFS Client
    • Creating an oranfstab File for Direct NFS Client
    • Enabling and Disabling Direct NFS Client Control of NFS
    • Enabling Hybrid Columnar Compression on Direct NFS Client
  • Creating Oracle ASM Client Data File
  • Configuring Oracle Advanced Cluster File System
  • Checking OCFS2 Version Manually
• 9 Installing Oracle Grid Infrastructure
  • About Image-Based Oracle Grid Infrastructure Installation
  • Setup Wizard Installation Options for Creating Images
  • Downloading the Software from Oracle Software Delivery Cloud Portal
  • Understanding Cluster Configuration Options
    • About Oracle Grid Infrastructure to Manage Oracle RAC Databases
    • About Oracle Grid Infrastructure to Manage Generic Applications
    • About Oracle Extended Clusters
  • Installing Oracle Grid Infrastructure for a New Cluster
    • About Oracle Grid Infrastructure Installation
    • Installing Oracle Grid Infrastructure to Manage Oracle RAC Databases
    • Installing Oracle Grid Infrastructure to Manage Generic Applications
  • Installing Oracle Grid Infrastructure Using Command-Line Interface
  • Installing Oracle Grid Infrastructure Using a Cluster Configuration File
  • Installing Only the Oracle Grid Infrastructure Software
    • Installing Software Binaries for Oracle Grid Infrastructure for a Cluster
    • Configuring Software Binaries for Oracle Grid Infrastructure for a Cluster
    • Configuring the Software Binaries Using a Response File
    • Setting Ping Targets for Network Checks
  • About Deploying Oracle Grid Infrastructure Using Oracle Fleet Patching and Provisioning
  • Confirming Oracle Clusterware Function
  • Confirming Oracle ASM Function for Oracle Clusterware Files
  • Understanding Offline Processes in Oracle Grid Infrastructure
• 10 Patching Oracle Grid Infrastructure
  • About Individual Oracle Grid Infrastructure Patches
  • About Oracle Grid Infrastructure Software Patch Levels
  • About Zero-Downtime Oracle Grid Infrastructure Patching
  • Applying Patches to Oracle Grid Infrastructure
    • Applying Patches Using Zero-Downtime Oracle Grid Infrastructure Patching
    • Applying Patches During an Oracle Grid Infrastructure Installation or Upgrade
    • Applying Patches After an Oracle Grid Infrastructure Installation or Upgrade
    • Applying Patches when Oracle Clusterware Fails to Start
  • Patching and Switching Oracle Grid Infrastructure Homes
  • Patching Oracle Grid Infrastructure Using Oracle FPP Local Mode
  • Changing the Oracle Grid Infrastructure Base Path
• 11 Upgrading Oracle Grid Infrastructure
  • Understanding Out-of-Place Upgrade
  • About Oracle Grid Infrastructure Upgrade and Downgrade
  • Options for Oracle Grid Infrastructure Upgrades
  • Restrictions for Oracle Grid Infrastructure Upgrades
  • Preparing to Upgrade an Existing Oracle Clusterware Installation
    • Upgrade Checklist for Oracle Grid Infrastructure
    • Checks to Complete Before Upgrading Oracle Grid Infrastructure
    • Removing Grid Infrastructure Management Repository
    • Moving Oracle Clusterware Files from NFS to Oracle ASM
    • Running the Oracle ORAchk Upgrade Readiness Assessment
    • Using CVU to Validate Readiness for Oracle Clusterware Upgrades
      • About the CVU Upgrade Validation Command Options
      • Standalone CVU Home
      • Example of Verifying System Upgrade Readiness for Grid Infrastructure
    • Using Dry-Run Upgrade Mode to Check System Upgrade Readiness
      • About Oracle Grid Infrastructure Dry-Run Upgrade Mode
      • Performing Dry-Run Upgrade Using Oracle Universal Installer
  • Understanding Rolling Upgrades Using Batches
  • Performing Rolling Upgrade of Oracle Grid Infrastructure
    • Upgrading Oracle Grid Infrastructure Using Setup Wizard
    • Upgrading Oracle Grid Infrastructure Using Command-Line Interface
    • Completing an Oracle Clusterware Upgrade when Nodes Become Unreachable
    • Joining Inaccessible Nodes After Forcing an Upgrade
    • Changing the First Node for Install and Upgrade
  • About Upgrading Oracle Grid Infrastructure Using Oracle Fleet Patching and Provisioning
  • Updating Oracle Enterprise Manager Cloud Control Target Parameters
    • Updating the Enterprise Manager Cloud Control Target After Upgrades
    • Updating the Enterprise Manager Agent Base Script After Upgrades
    • Registering Resources with Oracle Enterprise Manager After Upgrades
  • Unlocking and Deinstalling the Previous Release Grid Home
  • Checking Cluster Health Monitor Repository Size After Upgrading
  • Downgrading Oracle Clusterware to an Earlier Release
    • About Oracle Grid Infrastructure Downgrades
    • Options for Oracle Grid Infrastructure Downgrades
    • Restrictions for Oracle Grid Infrastructure Downgrades
    • Downgrading Oracle Grid Infrastructure
    • Downgrading Oracle Grid Infrastructure when Upgrade Fails
    • Downgrading Oracle Grid Infrastructure Using Online Terminate Upgrade
  • Completing Failed or Interrupted Installations and Upgrades
    • Completing Failed Installations and Upgrades
    • Continuing Incomplete Upgrade of First Node
    • Continuing Incomplete Upgrades on Remote Nodes
    • Continuing Incomplete Installation on First Node
    • Continuing Incomplete Installation on Remote Nodes
• 12 Oracle Grid Infrastructure Postinstallation Tasks
  • Required Postinstallation Tasks
    • Downloading Release Update Patches
  • Recommended Postinstallation Tasks
    • About Installing Oracle Autonomous Health Framework
    • Creating a Fast Recovery Area
      • About the Fast Recovery Area and the Fast Recovery Area Disk Group
      • Creating the Fast Recovery Area Disk Group
    • Checking the SCAN Configuration
    • Setting Resource Limits for Oracle Clusterware and Associated Databases and Applications
  • About Changes in Default SGA Permissions for Oracle Database
  • Using Earlier Oracle Database Releases with Oracle Grid Infrastructure
    • General Restrictions for Using Earlier Oracle Database Releases
    • Using ASMCA to Administer Disk Groups for Earlier Database Releases
    • Using the Correct LSNRCTL Commands
  • Relinking Oracle Grid Infrastructure for a Cluster Binaries
• 13 Removing Oracle Database Software
  • About Oracle Deinstallation Options
  • Oracle Deinstallation (Deinstall)
  • Unlocking and Deinstalling the Previous Release Grid Home
  • Deinstallation Examples for Oracle Database
  • Deinstallation Response File Example for Oracle Grid Infrastructure for a Cluster
  • Migrating Standalone Oracle Grid Infrastructure Servers to a Cluster
  • Changing the Oracle Grid Infrastructure Home Path
• A Oracle Grid Infrastructure Command-Line Options
  • gridSetup.sh Command
  • gridSetup.sh -setupHome
  • gridSetup.sh -setupHomeAs
  • gridSetup.sh -configureCluster
  • gridSetup.sh -switchGridhome
  • gridSetup.sh -upgrade
  • gridSetup.sh -downgrade
  • gridSetup.sh -createGoldImage
  • gridSetup.sh -addNode
  • gridSetup.sh -deleteNode
• B Response Files
  • Reasons for Using Silent Mode or Response File Mode
  • Using Response Files
  • Preparing Response Files
    • Editing a Response File Template
    • Recording Response Files
  • Running Oracle Universal Installer Using a Response File
  • Postinstallation Configuration Using Response File Created During Installation
    • Using the Installation Response File for Postinstallation Configuration
    • Running Postinstallation Configuration Using Response File
• C Completing Preinstallation Tasks Manually
  • Configuring SSH Manually on All Cluster Nodes
    • About Passwordless SSH Configuration
    • Checking Existing SSH Configuration on the System
    • Configuring SSH on Cluster Nodes
      • Create SSH Directory and Create SSH Keys On Each Node
      • Add All Keys to a Common authorized_keys File
    • Enabling SSH User Equivalency on Cluster Nodes
  • Configuring Storage Device Path Persistence Using Oracle ASMLIB
    • About Oracle ASM with Oracle ASMLIB
    • Installing and Configuring Oracle ASMLIB Software
    • Configuring Disk Devices to Use Oracle ASMLIB
    • Administering Oracle ASMLIB and Disks
    • Configuring Oracle ASMLIB for Multipath Disks
      • About Using Oracle ASM with Multipath Disks
      • About Disk Scan Ordering
      • Configuring Disk Scan Ordering to Select Multipath Disks
      • Configuring Disk Order Scan to Exclude Single Path Disks
    • Deinstalling Oracle ASMLIB On Oracle Grid Infrastructure
  • Configuring Storage Device Path Persistence Manually
    • About Device Path Persistence
    • Configuring Device Persistence Manually for Oracle ASM
  • Configuring Kernel Parameters for Linux
    • Minimum Parameter Settings for Installation
    • Changing Kernel Parameter Values
    • Configuring Additional Kernel Settings for SUSE Linux
    • Setting UDP and TCP Kernel Parameters Manually
  • Configuring Default Thread Limits Value for SUSE Linux
• D Optimal Flexible Architecture
  • About the Optimal Flexible Architecture Standard
  • About Multiple Oracle Homes Support
  • About the Oracle Inventory Directory and Installation
  • Oracle Base Directory Naming Convention
  • Oracle Home Directory Naming Convention
  • Optimal Flexible Architecture File Path Examples