14.3 RDMA Network Fabric Cabling for Oracle Exadata Database Machine X11M and X10M
This topic contains RDMA Network Fabric cabling details for Oracle Exadata Database Machine X11M and X10M.
The RDMA Network Fabric leaf switches are located in rack units 20 and 22 for Oracle Exadata Database Machine X11M and X10M.
The following table describes the connections between the servers and the RDMA Network Fabric leaf switches in an Oracle Exadata Database Machine X11M or X10M rack that is fully populated with database servers and storage servers. All connections in this table use QSFP28 100G cables that are 3 meters long.
In the following tables, UN denotes the rack unit location, where U42 is at the top of the rack and U1 is at the bottom of the rack.
Table 14-2 RDMA Network Fabric Cabling for Oracle Exadata Database Machine X11M or X10M Servers and Leaf Switches
| From Server in Rack Unit | Server Port | To RDMA Network Fabric Switch in Rack Unit | RDMA Network Fabric Switch Port |
|---|---|---|---|
|
U41 |
PCIe Slot 5, Port 2 |
U22 |
15 |
|
U41 |
PCIe Slot 5, Port 1 |
U20 |
15 |
|
U39 |
PCIe Slot 5, Port 2 |
U22 |
08 |
|
U39 |
PCIe Slot 5, Port 1 |
U20 |
08 |
|
U37 |
PCIe Slot 5, Port 2 |
U22 |
09 |
|
U37 |
PCIe Slot 5, Port 1 |
U20 |
09 |
|
U35 |
PCIe Slot 5, Port 2 |
U22 |
10 |
|
U35 |
PCIe Slot 5, Port 1 |
U20 |
10 |
|
U33 |
PCIe Slot 5, Port 2 |
U22 |
11 |
|
U33 |
PCIe Slot 5, Port 1 |
U20 |
11 |
|
U31 |
PCIe Slot 5, Port 2 |
U22 |
12 |
|
U31 |
PCIe Slot 5, Port 1 |
U20 |
12 |
|
U29 |
PCIe Slot 5, Port 2 |
U22 |
13 |
|
U29 |
PCIe Slot 5, Port 1 |
U20 |
13 |
|
U27 |
PCIe Slot 5, Port 2 |
U22 |
14 |
|
U27 |
PCIe Slot 5, Port 1 |
U20 |
14 |
|
U25 |
PCIe Slot 5, Port 2 |
U22 |
16 |
|
U25 |
PCIe Slot 5, Port 1 |
U20 |
16 |
|
U23 |
PCIe Slot 5, Port 2 |
U22 |
18 |
|
U23 |
PCIe Slot 5, Port 1 |
U20 |
18 |
|
U18 |
PCIe Slot 5, Port 2 |
U22 |
20 |
|
U18 |
PCIe Slot 5, Port 1 |
U20 |
20 |
|
U16 |
PCIe Slot 5, Port 2 |
U22 |
22 |
|
U16 |
PCIe Slot 5, Port 1 |
U20 |
22 |
|
U14 |
PCIe Slot 5, Port 2 |
U22 |
23 |
|
U14 |
PCIe Slot 5, Port 1 |
U20 |
23 |
|
U12 |
PCIe Slot 5, Port 2 |
U22 |
24 |
|
U12 |
PCIe Slot 5, Port 1 |
U20 |
24 |
|
U10 |
PCIe Slot 5, Port 2 |
U22 |
25 |
|
U10 |
PCIe Slot 5, Port 1 |
U20 |
25 |
|
U8 |
PCIe Slot 5, Port 2 |
U22 |
26 |
|
U8 |
PCIe Slot 5, Port 1 |
U20 |
26 |
|
U6 |
PCIe Slot 5, Port 2 |
U22 |
27 |
|
U6 |
PCIe Slot 5, Port 1 |
U20 |
27 |
|
U4 |
PCIe Slot 5, Port 2 |
U22 |
28 |
|
U4 |
PCIe Slot 5, Port 1 |
U20 |
28 |
|
U2 |
PCIe Slot 5, Port 2 |
U22 |
29 |
|
U2 |
PCIe Slot 5, Port 1 |
U20 |
29 |
The following table describes the inter-switch connections between the RDMA Network Fabric leaf switches in an Oracle Exadata Database Machine X10M rack. All connections in this table use QSFP28 100G cables that are 1 meter long.
Table 14-3 RDMA Network Fabric Inter-Switch Cabling for Oracle Exadata Database Machine X11M or X10M
| From RDMA Network Fabric Switch in Rack Unit | Port | To RDMA Network Fabric Switch in Rack Unit | Port |
|---|---|---|---|
|
U20 |
04 |
U22 |
04 |
|
U20 |
05 |
U22 |
05 |
|
U20 |
06 |
U22 |
06 |
|
U20 |
07 |
U22 |
07 |
|
U20 |
30 |
U22 |
30 |
|
U20 |
31 |
U22 |
31 |
|
U20 |
32 |
U22 |
32 |
|
U20 |
33 |
U22 |
33 |