1. Oracle 6.8TB NVMe SSD and 3.84TB NVMe SSD (Release 2.0) User Guide
  2. Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

4 Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

This section provides information on updating Oracle 6.8TB NVMe SSD and 3.84TB NVMe SSD v2 firmware and software.

Keep Drivers and Firmware Up to Date

This section provides information on updating NVMe SSD drivers, firmware and software.

Product patches, updates and firmware are available on My Oracle Support from the Patches and Updates tab. Refer to the server documentation to check for updates to the device firmware.

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Server Management Tools

The following management tools are available for the server:

  • Oracle Integrated Lights Out Manager (ILOM), Preinstalled service processor (SP) with integrated firmware. No installation required. Some initial configuration is required. For information, refer to the product information page at Oracle Integrated Lights Out Manager. For documentation, refer to Oracle ILOM Documentation.

  • Oracle Hardware Management Pack, available with the Oracle Solaris OS or as a standalone product with other OS. Monitor hardware through the host operating system, either remotely or locally using command-line interface tools. For information, refer to the product information page at Oracle Hardware Management Pack. For documentation and OS support matrix, refer to Oracle Hardware Management Pack Documentation at Servers Documentation Systems Management.

  • Oracle Enterprise Manager Ops Center, available software to manage multiple systems in a data center. For information, refer to the product information page at Oracle Enterprise Manager. For documentation, refer to Oracle Enterprise Manager Cloud Control Documentation at Oracle Enterprise Manager Cloud Control.

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Download the Device Software Package

To find the device software package, access My Oracle Support and download the latest software package for Oracle 6.8TB and 3.84TB NVMe SSDs.

  1. Go to My Oracle Support.
  2. Sign in to My Oracle Support.
  3. At the top of the page, click the Patches & Updates tab.

    The Patch Search pane appears at the right of the screen.

  4. Within the Search tab area, click Number/Name or Bug Number (Simple).

    The Search tab area appears with search fields.

  5. In the Product field, enter the patch number for 6.8TB or 3.84TB NVME PCIE SSD.
  6. Click Search.

    The Patch Search Results screen appears, listing the patch for the software release.

  7. To review the ReadMe file for this patch, click ReadMe.
  8. To download the patch for the software release, click Download.
  9. In the File Download dialog box, click the patch zip file name.

    The patch for the software release downloads. The download is an archive zip file, which you must extract to find the directory containing the image.pkg file.

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Update the NVMe Storage Drive Firmware

  • Update your system to the latest software release.

  • Verify that the latest supported software release of Oracle Hardware Management Pack is installed on the host.

    For CLI command instructions, refer to Oracle Hardware Management Pack documentation.

This procedure provides instructions to update Oracle 6.8TB and 3.84TB NVMe SSD NAND flash controller firmware for the host on supported Oracle Linux and Oracle Solaris operating systems. Oracle 6.8TB and 3.84TB NVMe SSD firmware is updated as a single package using Oracle Hardware Management Pack utility command-line interface (CLI) tools.

Note:

Refer to the server documentation product notes for detailed instructions on system software updates.
  1. Check Oracle 6.8TB or 3.84TB NVMe SSD Product Information for the latest firmware requirements.
  2. Log in to the target system.

    For detailed instructions, refer to the server installation documentation. For example, to log in to the target system through SSH or through Oracle ILOM Remote System Console Plus, do one of the following:

    • If you are using an SSH client connection.

      1. From a shell command line in a terminal window, establish an SSH connection to the server host.

        Type: ssh root@hostname , where hostname can be the DNS name or the IP address for the server host.

      2. Log in to the system using an account with root access.

      3. Proceed to Step 3.

    • If you are using a remote system console, first refer to Start Serial Console Redirection and Log In to Host Server OS server administration documentation and then perform these steps.

      To launch an Oracle ILOM Remote System Console Plus session, refer to Launching Remote KVMS Redirection Sessions in the server administration documentation.

      1. Access the host console. Establish a remote connection to the host console.

        Start an Oracle ILOM serial console session, type:

        --> start /HOST/console

        Are you sure you want to start /HOST/console (y/n)? y

      2. Ensure that the server is powered on and booted.

      3. Access the operating system command-line interface.

        You issue Oracle Hardware Management Pack commands from the operating system command-line interface.

      4. Proceed to Step 3.

  3. Download and store any firmware image file updates on the server that are required to support Oracle 6.8TB or 3.84TB NVMe SSDs.
    1. Download firmware image files from My Oracle Support.
    2. Copy the downloaded firmware image files to the target system root directory.
  4. Identify all Oracle 6.8TB and 3.84TB NVMe SSDs and controller firmware versions in the server.
    1. Type: # fwupdate list controller

      In the following examples, NVMe SSD controllers c0-c10 are enumerated in the output returned by the above command. 

      # fwupdate list controller
 
WARNING: Due to strict MMIO memory settings in the running kernel some network controllers may not be accessible.
         See Hardware Management Pack documentation regarding iomem kernel settings required for
         firmware update of these devices.
==================================================
CONTROLLER
==================================================
ID    Type   Manufacturer   Model     Product Name               FW Version
     BIOS Version   EFI Version    FCODE Version  Package Version  NVDATA Version    XML Support
-----------------------------------------------------------------------------------------------
c0    NVMe   Intel          0x0b60    INTEL SSDPF2NV307TZS       ACV1R380
c1    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c2    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c3    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c4    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c5    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c6    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c7    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c8    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c9    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
c10   NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
c11   SAS    Samsung        0xa826    MZWLO7T6HBLA-00AU3         OPPA1R5Q
c12   SAS    0x025e         0x0b60    SOLIDIGM SBFPF2BV307TOC    5CV1R077
c13   SAS    0x025e         0x0b60    SOLIDIGM SBFPF2BV614TOC    5CV1R077
c14   SAS    0x1344         0x51c3    Micron_7450_MTFDKBA480TFR  E2MU200 
c15   NVMe   Samsung        0xa80a    SAMSUNG MZVL2480HBJD-00A07 GDB7302Q
    2. Verify that the firmware package files that are installed in NVMe SSDs require updating.

      To identify NVMe controllers that need updated firmware image files, view the FW Version column in the output from the fwdupdate list controller command.

      In the example, NVMe SSD controller c6 shows firmware version 9CV1R409, while other NVMe controllers show firmware version 9CV1R410. NVMe SSD controllers c1 through c5, c7 and c8 are enumerated in the output returned by the above command. 

      # fwupdate list controller

WARNING: Due to strict MMIO memory settings in the running kernel some network controllers may not be accessible. 
See Hardware Management Pack documentation regarding iomem kernel settings required for firmware update of these devices.  
===================CONTROLLER=========
ID    Type   Manufacturer   Model     Product Name      FW Version
BIOS Version EFI Version FCODE Version Package Version NVDATA Version XML Support
---------------------------------------------------------------------------------
c0    NVMe   Intel  0x0b60    INTEL SSDPF2NV307TZS      ACV1R380
c1    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c2    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c3    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c4    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c5    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c6    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R409
c7    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c8    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T1S      9CV1R410
c9    NVMe   Intel  0x0b60    INTEL SSDPFCKE064T9S      2CV1RC50
c10   NVMe   Intel  0x0b60    INTEL SSDPFCKE064T9S      2CV1RC50
c11   SAS    Samsung0xa826    MZWLO7T6HBLA-00AU3        OPPA1R5Q
c12   SAS    0x025e 0x0b60    SOLIDIGM SBFPF2BV307TOC   5CV1R077
c13   SAS    0x025e 0x0b60    SOLIDIGM SBFPF2BV614TOC   5CV1R077
c14   SAS    0x1344 0x51c3    Micron_7450_MTFDKBA480TFR E2MU200
c15   NVMe   Samsung0xa80a    SAMSUNG MZVL2480HBJD-00A07GDB7302Q
    3. View the Firmware Revision in the output from the nvmeadm list -v command.

      To identify NVMe controllers and current firmware versions type:

      # nvmeadm list -v

      In the following example, controller SUNW-NVME-3 shows firmware version 9CV1R410 in the output returned by the above command. 

      # nvmeadm list -v
SUNW-NVME-1
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAC2453005D30PGGN
        Model Number:                   INTEL SSDPF2NV307TZS
        Firmware Revision:              ACV1R380
        Number of Namespaces:           128
SUNW-NVME-2
        PCI Vendor ID:                  0x144d
        Serial Number:                  S77GNG0W200069
        Model Number:                   MZWLO7T6HBLA-00AU3
        Firmware Revision:              OPPA1R5Q
        Number of Namespaces:           64
SUNW-NVME-3
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001G6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-4
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001G6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-5
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000L6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-6
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000L6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-7
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAG0145001V6P4CGN-1
        Model Number:                   INTEL SSDPFCKE064T9S
        Firmware Revision:              2CV1RC50
        Number of Namespaces:           128
SUNW-NVME-8
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAG0145001V6P4CGN-2
        Model Number:                   INTEL SSDPFCKE064T9S
        Firmware Revision:              2CV1RC50
        Number of Namespaces:           128
SUNW-NVME-9
        PCI Vendor ID:                  0x025e
        Serial Number:                  PHA43285002330PHGN
        Model Number:                   SOLIDIGM SBFPF2BV307TOC
        Firmware Revision:              5CV1R077
       Number of Namespaces:           128
SUNW-NVME-10
        PCI Vendor ID:                  0x025e
        Serial Number:                  PHA43313000161PIGN
        Model Number:                   SOLIDIGM SBFPF2BV614TOC
        Firmware Revision:              5CV1R077
        Number of Namespaces:           128
SUNW-NVME-11
        PCI Vendor ID:                  0x1344
        Serial Number:                  22303B4BB3B8
        Model Number:                   Micron_7450_MTFDKBA480TFR
        Firmware Revision:              E2MU200
        Number of Namespaces:           132
SUNW-NVME-12
        PCI Vendor ID:                  0x144d
        Serial Number:                  S78UNE0TA00279
        Model Number:                   SAMSUNG MZVL2480HBJD-00A07
        Firmware Revision:              GDB7302Q
        Number of Namespaces:           32
SUNW-NVME-13
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001H6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-14
        PCI Vendor ID:                  0x8086
       Serial Number:                  PHAZ2233001H6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-15
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000T6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-16
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000T6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
  5. Quiesce Oracle 6.8TB and 3.84TB NVMe SSD devices.

    Before removing a drive, manually quiesce I/O and device usage.

    Caution:

    System hang or data loss. Before updating device firmware, ensure that the device is quiesced and the following events are not occurring:

    • The operating system is not accessing the disk (for example, the system boot disk).

    • An application is not accessing the disk (for example, a database application).

  6. Update the selected 6.8TB and 3.84TB NVMe SSDs with the specified firmware package.

    The fwupdate command can update firmware for all similar devices in the system utilizing an XML metadata file. This method is called Automatic Mode and is the recommended method for upgrades.

    Note:

    Alternately, if you determine that each device must be updated with a separate fwupdate command, perform the fwupdate Automatic Single Drive method, or the fwupdate Manual method (if an XML metadata file is not available). For CLI command instructions, refer to Oracle Hardware Management Pack documentation.
    1. Verify that an XML metadata file is available for the server.

      An XML metadata file must be included with the firmware update package to use Automatic Mode. Refer to the update package Release Notes.

    2. To update device firmware on Oracle 6.8TB or 3.84TB NVMe SSDs, type fwupdate update controller -x metadata.xml. 
      
# fwupdate update controller -x metadata.xml
 The following components will be upgraded as shown:
==========================================================
IDPriority Action      Status      Old Firmware Ver.   Proposed Ver.       New Firmware Ver.   System Reboot
-------------------------------------------------------------------------------------------------------------------------
c71Check FW    Success     9CV1R410    9CV1R410    N/A None
c81Check FW    Success     9CV1R410    9CV1R410    N/A None
       System Reset
Do you wish to process all of the above component upgrades? [y/n]?

      If the current firmware package version on the selected drive is higher than the specified firmware package version, the command returns an error. For error codes, refer to Oracle Hardware Management Pack documentation.

    3. To upgrade the firmware packages and process all of the above component upgrades, type y. 
      Updating c1:  Success
Updating c2:  Success
Verifying all priority 1 updates
Execution Summary
==========================================================
IDPriority Action      Status      Old Firmware Ver.   Proposed Ver.       New Firmware Ver.   System Reboot
-------------------------------------------------------------------------------------------------------------------------
c71Check FW    Success     9CV1R410    9CV1R410    N/A None
c81Check FW    Success     9CV1R410    9CV1R410    N/A None
System Reboot required for some applied firmware
Do you wish to automatically reboot now? [y/n]?
    4. Type y to reboot the host server to initialize the firmware update.
  7. Re-access the console. See step 2.

    For more instructions, refer to the server Installation Guide.

  8. Verify that the updated firmware package is installed in 6.8TB and 3.84TB NVMe SSDs.
    1. Type the following from a terminal: # fwupdate list controller

      NVMe SSDs are displayed.

      # fwupdate list controller
 
WARNING: Due to strict MMIO memory settings in the running kernel some network controllers may not be accessible.
         See Hardware Management Pack documentation regarding iomem kernel settings required for
         firmware update of these devices.
==================================================
CONTROLLER
==================================================
ID    Type   Manufacturer   Model     Product Name               FW Version
     BIOS Version   EFI Version    FCODE Version  Package Version  NVDATA Version    XML Support
-----------------------------------------------------------------------------------------------
c0    NVMe   Intel          0x0b60    INTEL SSDPF2NV307TZS       ACV1R380
c1    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c2    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c3    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c4    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c5    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c6    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c7    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c8    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c9    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
c10   NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
c11   SAS    Samsung        0xa826    MZWLO7T6HBLA-00AU3         OPPA1R5Q
c12   SAS    0x025e         0x0b60    SOLIDIGM SBFPF2BV307TOC    5CV1R077
c13   SAS    0x025e         0x0b60    SOLIDIGM SBFPF2BV614TOC    5CV1R077
c14   SAS    0x1344         0x51c3    Micron_7450_MTFDKBA480TFR  E2MU200 
c15   NVMe   Samsung        0xa80a    SAMSUNG MZVL2480HBJD-00A07 GDB7302Q
    2. Verify host recognition of all NVMe SSDs by checking ID enumeration.
    3. Ensure that the expected NVMe SSD firmware was updated in the output returned by the above command.
  9. Verify Oracle 6.8TB and 3.84TB NVMe SSD operation.
  10. Repeat the firmware upgrade process until 6.8TB and 3.84TB NVMe SSDs have the most up to date firmware release.

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Verify Oracle 6.8TB and 3.84TB NVMe SSD Operation

  • Verify that Oracle Hardware Management Pack is installed on the host. For CLI command instructions, refer to Oracle Hardware Management Pack documentation Oracle Server CLI Tools User's Guide.

  • Ensure that you have access to the server (either directly or over the network).

This procedure provides instructions to verify Oracle 6.8TB and 3.84TB (v2) NVMe SSD operation on the host for supported Oracle Linux and Oracle Solaris operating systems. Verify Oracle 6.8TB and 3.84TB (v2) NVMe SSD operation using Oracle Hardware Management Pack utility CLI tools.

  1. Observe Oracle 6.8TB and 3.84TB NVMe SSD status indicator LEDs.

    Verify that the Fault-Service Required NVMe SSD status indicator is not lit and that the green Power status indicator is lit on the NVMe SSDs that you updated. LED status indicators are: Green (operational), Amber (faulty disk ), Blue (SSD has been prepared for removal).

    Refer to LED Status Indicator Characteristics in Oracle 6.8TB and 3.84TB, 2.5-inch, NVMe Solid State Drive Specifications.

  2. Log in to the target system.

    For detailed instructions, refer to the server installation guide. For example, to log in to the target system through SSH or through Oracle ILOM Remote System Console Plus, do one of the following:

    • SSH client connection:

      1. From a shell command line in a terminal window, establish an SSH connection to the server host.

        Type: ssh root@hostname , where hostname can be the DNS name or the IP address for the server host.

      2. Log in to the system using an account with root access.

      3. Proceed to Step 3.

    • Remote system console:

      First refer to Start Serial Console Redirection and Log In to Host Server OS at Oracle ILOM Documentation and then perform these steps.

      If you are using a remote system console, refer to the server administration documentation and perform these steps.

      1. Establish a remote connection to the host console.

        Start an Oracle ILOM serial console session, type: -> start /HOST/console

        Are you sure you want to start /HOST/console (y/n)? y

        To launch an Oracle ILOM Remote System Console Plus session, refer to Launching Remote KVMS Redirection Sessions in the server administration documentation.

      2. Ensure that the server is powered on and booted.

      3. Access the operating system command-line interface.

        You issue Oracle Hardware Management Pack commands from the operating system command-line interface.

      4. Proceed to Step 3.

  3. Identify all Oracle 6.8TB and 3.84TB NVMe SSDs and verify that the latest firmware packages are installed.
    1. Type the following command: # fwupdate list controller

      In the following example, device controllers are enumerated in the output returned by the above command.

      # fwupdate list controller
 
==================================================
CONTROLLER
==================================================
ID    Type   Manufacturer   Model     Product Name               FW Version
---------------------------------------------------------------------------
c0    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c1    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c2    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c3    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c4    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c5    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c6    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c7    NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
c8    NVMe   Intel          0x0b60    INTEL SSDPF2KX153T1S       9CV1R410
c9    NVMe   Intel          0x0b60    INTEL SSDPF2KX153T1S       9CV1R410
c10   NVMe   Intel          0x0b60    INTEL SSDPF2KX076T9S       2CV1RC51
      # fwupdate list controller
 
WARNING: Due to strict MMIO memory settings in the running kernel some network controllers may not be accessible.
         See Hardware Management Pack documentation regarding iomem kernel settings required for
         firmware update of these devices.
==================================================
CONTROLLER
==================================================
ID    Type   Manufacturer   Model     Product Name               FW Version 
---------------------------------------------------------------------------
c0    NVMe   Intel          0x0b60    INTEL SSDPF2NV307TZS       ACV1R380
c1    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c2    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c3    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c4    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c5    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c6    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c7    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c8    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T1S       9CV1R410
c9    NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
c10   NVMe   Intel          0x0b60    INTEL SSDPFCKE064T9S       2CV1RC50
    2. Verify host recognition of all Oracle 6.8TB and 3.84TB NVMe SSDs by checking controller ID enumeration.

      In the above example, Oracle 6.8TB and 3.84TB NVMe SSD controllers c1 to c10 are enumerated in the output returned by the above command.

    3. Ensure that all Oracle 6.8TB and 3.84TB NVMe SSDs firmware revisions are current in the output returned by the above command.
  4. Check NVMe device status.

    To identify NVMe controllers and current firmware versions, type: # nvmeadm list -v

    To identify NVMe controllers that have updated firmware, view the Firmware Revision row in the output from the nvmeadm list -v command.

    In the following example, controller SUNW-NVME-3 shows firmware version 9CV1R410 in the output returned by the above command. 

    # nvmeadm list -v
SUNW-NVME-1
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAC2453005D30PGGN
        Model Number:                   INTEL SSDPF2NV307TZS
        Firmware Revision:              ACV1R380
        Number of Namespaces:           128
SUNW-NVME-2
        PCI Vendor ID:                  0x144d
        Serial Number:                  S77GNG0W200069
        Model Number:                   MZWLO7T6HBLA-00AU3
        Firmware Revision:              OPPA1R5Q
        Number of Namespaces:           64
SUNW-NVME-3
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001G6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-4
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001G6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-5
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000L6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-6
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000L6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-7
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAG0145001V6P4CGN-1
        Model Number:                   INTEL SSDPFCKE064T9S
        Firmware Revision:              2CV1RC50
        Number of Namespaces:           128
SUNW-NVME-8
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAG0145001V6P4CGN-2
        Model Number:                   INTEL SSDPFCKE064T9S
        Firmware Revision:              2CV1RC50
        Number of Namespaces:           128
SUNW-NVME-9
        PCI Vendor ID:                  0x025e
        Serial Number:                  PHA43285002330PHGN
        Model Number:                   SOLIDIGM SBFPF2BV307TOC
        Firmware Revision:              5CV1R077
       Number of Namespaces:           128
SUNW-NVME-10
        PCI Vendor ID:                  0x025e
        Serial Number:                  PHA43313000161PIGN
        Model Number:                   SOLIDIGM SBFPF2BV614TOC
        Firmware Revision:              5CV1R077
        Number of Namespaces:           128
SUNW-NVME-11
        PCI Vendor ID:                  0x1344
        Serial Number:                  22303B4BB3B8
        Model Number:                   Micron_7450_MTFDKBA480TFR
        Firmware Revision:              E2MU200
        Number of Namespaces:           132
SUNW-NVME-12
        PCI Vendor ID:                  0x144d
        Serial Number:                  S78UNE0TA00279
        Model Number:                   SAMSUNG MZVL2480HBJD-00A07
        Firmware Revision:              GDB7302Q
        Number of Namespaces:           32
SUNW-NVME-13
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233001H6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-14
        PCI Vendor ID:                  0x8086
       Serial Number:                  PHAZ2233001H6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-15
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000T6P4AGN-1
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
SUNW-NVME-16
        PCI Vendor ID:                  0x8086
        Serial Number:                  PHAZ2233000T6P4AGN-2
        Model Number:                   INTEL SSDPFCKE064T1S
        Firmware Revision:              9CV1R410
        Number of Namespaces:           128
  5. Check the health of Oracle 6.8TB and 3.84TB TB NVMe SSDs.

    To check the selected 6.8TB and 3.84TB NVMe SSD health and SMART (Self-Monitoring, Analysis, and Reporting Technology) information, type: # nvmeadm getlog -h

    The Critical Warning field should be zero. A non-zero Critical Warning field indicates a SMART Trip.

    Ensure that the NVMe SSDs have remaining drive life (Percentage Used) in the output returned by the above command. 

    # nvmeadm getlog -h 
SUNW-NVME-1
SMART/Health Information:
        Critical Warning: 0
        Temperature: 315 Kelvin
        Available Spare: 100 percent
        Available Spare Threshold: 10 percent
        Percentage Used: 0 percent
        Data Unit Read: 0x2fa1c314 of 512k bytes.
        Data Unit Written: 0x23bd12c7 of 512k bytes.
        Number of Host Read Commands: 0x3f0bb9308
        Number of Host Write Commands: 0x1c2433434
        Controller Busy Time in Minutes: 0x525
        Number of Power Cycle: 0x56e
        Number of Power On Hours: 0x55f
        Number of Unsafe Shutdown: 0x307
        Number of Media Errors: 0x0
        Number of Error Info Log Entries: 0x0

SUNW-NVME-2
SMART/Health Information:
        Critical Warning: 0
        Temperature: 310 Kelvin
        Available Spare: 99 percent
        Available Spare Threshold: 10 percent
        Percentage Used: 1 percent
        Data Unit Read: 0x138a818a of 512k bytes.
        Data Unit Written: 0x2d71a25d of 512k bytes.
        Number of Host Read Commands: 0xe75e59ca
        Number of Host Write Commands: 0x7a604b45c
        Controller Busy Time in Minutes: 0xe0
        Number of Power Cycle: 0x89
        Number of Power On Hours: 0x1443
        Number of Unsafe Shutdown: 0x78
        Number of Media Errors: 0x0
        Number of Error Info Log Entries: 0x0

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Known Issues

This section describes important operating issues and known hardware and software issues for Oracle NVMe SSDs.

Supplementary and workaround information for Oracle NVMe SSDs is included. Specific Bug ID identification numbers are provided for service personnel.

Parent topic: Updating Oracle 6.8 TB and 3.84 TB NVMe SSD Software and Firmware

Secure Erase Drives Before Use

Oracle 6.8TB and 3.84TB (NVMe SSDs may report uncorrectable errors or assert after not being powered for three or more months. For best practice, secure erase Oracle 6.8TB and 3.84TB NVMe SSDs before use (especially if use is reading from the card as a test) and especially if 6.8TB and 3.84TB NVMe SSDs have been unpowered for more than three months. If the NAND media is not refreshed for approximately three months, the drive may experience media errors.

Over time, the drive firmware policy refreshes the media in the background while it remains powered-on. If the drive has been powered on long enough for the background refresh policy to be applied to all bits, the drive is not at risk for this issue. The time required to refresh all the bits is approximately 14 days and varies by product.

If the number of bits experiencing this issue exceeds the error-correction code (ECC) capability, it may result in an uncorrectable read error. If the uncorrectable read errors occur during normal drive operation, the drive will report an increased number of SMART media errors to the host.

Workaround:

Secure erase the drive to return the drive to service. Secure erase frees and reuses all blocks starting with an empty Flash Translation Layer table (FTL). Any LBAs that may have held data that may have degraded are now released as free blocks to be reused.

Select one of the following methods before use of the drive for operation or test. An off-line server can be used.

Choose one of the erase options:

  • Secure erase the drive, using the nvmeadmin utility.

  • Download and use third party utilities to secure erase the drive.

  • Wait two weeks for a media refresh while the drive is powered-on before using the drive.

Caution:

All data will be destroyed after an erase.

Secure Erase Drive Using nvmeadmin Utility

To secure erase the drive, using the Oracle Hardware Management Pack NVMe admin utility:

  1. Stop all IO to the NVMe device before attempting this action.

  2. To securely erase all namespaces, type: # nvmeadm erase -s -a controller_name. For example: # nvmeadm erase -s -a SUNW-NVME-1

  3. List all server devices.

  4. Verify drive health.

For CLI command instructions, refer to Oracle Hardware Management Pack documentation Oracle Server CLI Tools User's Guide.

Secure Erase Drive Using Third-party Utilities

To secure erase the drive before use, using the Solidigm Storage Tool utility, if available:

  1. Install the Solidigm Storage Tool.

  2. Stop all IO to the NVMe device before attempting this action.

  3. Use the –secure_erase option to erase all the data on the drive. 

    ssm –drive_index 1 –secure_erase

  4. The user is prompted unless the –force option is used: 

    WARNING: You have selected to secure erase the drive!
Proceed with the secure erase? (Y/N)

  5. If the drive contains a partition, the prompt contains a second warning message:

    WARNING: You have selected to secure erase the drive!
WARNING: Tool has detected as partition on the drive!
Proceed with the secure erase? (Y/N)

  6. To bypass the warning prompts, use the –force option: 

    ssm –drive_index 1 –secure_erase -force

  7. List all server devices.

  8. Verify drive health.

Parent topic: Known Issues