19 In-Rack Cabling Tables for Recovery Appliance X4
This appendix identifies the location of the various components in a Recovery Appliance X4 full rack and a minimum configuration. It also lists the cabling connections among components within the rack.
This appendix contains the following sections:
The cables used in Recovery Appliance are color-coded as follows:
-
Black: InfiniBand cables, or AC power jumper cables
-
Blue: Gigabit Ethernet cables
-
Red: Integrated Lights Out Manager (ILOM) cables
Recovery Appliance X4 Rack Layout
Figure 18-1 shows the front and rear views of a Recovery Appliance X4 full rack. The front is shown on the left, and the rear is shown on the right.
Note:
The 1U empty space at the bottom of the rack is reserved for an optional InfiniBand spine switch, which is used in multirack installations. Do not install any other unit in this space.
Figure 18-1 Rack Layout of the Recovery Appliance X4 Full Rack
Description of "Figure 18-1 Rack Layout of the Recovery Appliance X4 Full Rack"
Figure 18-2 shows the front and rear views of a Recovery Appliance X4 minimum configuration.
Figure 18-2 Rack Layout of the Recovery Appliance X4 Minimum Configuration
Description of "Figure 18-2 Rack Layout of the Recovery Appliance X4 Minimum Configuration"
Oracle Integrated Lights Out Manager Cabling Connections
Table 18-1 shows the cable connections from the servers to the Oracle ILOM switches in a Recovery Appliance X4 full rack. The port numbers are the same in racks with fewer storage servers. The ILOM port on each server is labeled NET MGT and connects to the gigabit Ethernet switch located in rack unit 21.
ILOM cables are red.
Table 18-1 ILOM Cabling for the Recovery Appliance X4 Full Racks
| From Rack Unit(1) | Component | To Ethernet Port |
|---|---|---|
|
U39 |
Storage server |
2 |
|
U37 |
Storage server |
4 |
|
U35 |
Storage server |
6 |
|
U33 |
Storage server |
8 |
|
U31 |
Storage server |
10 |
|
U29 |
Storage server |
12 |
|
U27 |
Storage server |
14 |
|
U17 |
Compute server |
28 |
|
U16 |
Compute server |
30 |
|
U14 |
Storage server |
32 |
|
U12 |
Storage server |
34 |
|
U10 |
Storage server |
36 |
|
U8 |
Storage server |
38 |
|
U6 |
Storage server |
40 |
|
U4 |
Storage server |
42 |
|
U2 |
Storage server |
44 |
Footnote 1 Un is the unit location in the rack, where n is the number.
Administrative Gigabit Ethernet Cabling Connections
Table 18-2 shows the cable connections from the servers to the gigabit Ethernet switch in a Recovery Appliance X4 full rack. The port numbers are the same in racks with fewer storage servers. The Ethernet switch is located in rack unit 21. Ethernet cables are blue.
Table 18-2 Gigabit Ethernet Cabling for the Recovery Appliance X4 Full Racks
| From Rack Unit(2) | Component | To Ethernet Port |
|---|---|---|
|
U39 |
Storage server |
1 |
|
U37 |
Storage server |
3 |
|
U35 |
Storage server |
5 |
|
U33 |
Storage server |
7 |
|
U31 |
Storage server |
9 |
|
U29 |
Storage server |
11 |
|
U27 |
Storage server |
13 |
|
U22 |
InfiniBand leaf switch |
45 |
|
U20 |
InfiniBand leaf switch |
46 |
|
U17 |
Compute server |
27 |
|
U16 |
Compute server |
29 |
|
U14 |
Storage server |
31 |
|
U12 |
Storage server |
33 |
|
U10 |
Storage server |
35 |
|
U8 |
Storage server |
37 |
|
U6 |
Storage server |
39 |
|
U4 |
Storage server |
41 |
|
U2 |
Storage server |
43 |
Footnote 2 Un is the unit location in the rack, where n is the number.
Single-Phase Power Distribution Unit Cabling Connections
Table 18-3 shows the cable connections from the power distribution units (PDUs) to the rack units in a Recovery Appliance X4 full rack. The destinations and the cable lengths are the same in racks with fewer storage servers. The cables terminate at PDU-A on the left and are routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four.
Table 18-3 Single-Phase PDU Cabling for the Recovery Appliance X4 Full Racks
| Rack Unit(3) | PDU-A | PDU-B | Cable Length |
|---|---|---|---|
|
U39 |
G5-6 |
G0-0 |
2 meters |
|
U37 |
G5-3 |
G0-3 |
2 meters |
|
U35 |
G5-0 |
G0-6 |
2 meters |
|
U33 |
G4-6 |
G1-0 |
2 meters |
|
U31 |
G4-4 |
G1-2 |
2 meters |
|
U29 |
G4-2 |
G1-4 |
2 meters |
|
U27 |
G3-6 |
G2-0 |
2 meters |
|
U22 |
G3-1 |
G2-5 |
2 meters |
|
U21 |
G3-0 |
G2-6 |
2 meters |
|
U20 |
G2-4 |
G3-2 |
2 meters |
|
U17 |
G2-1 |
G3-5 |
2 meters |
|
U16 |
G1-6 |
G4-0 |
2 meters |
|
U14 |
G2-0 |
G3-6 |
2 meters |
|
U12 |
G1-4 |
G4-2 |
2 meters |
|
U10 |
G1-2 |
G4-4 |
2 meters |
|
U8 |
G1-0 |
G4-6 |
2 meters |
|
U6 |
G0-6 |
G5-0 |
2 meters |
|
U4 |
G0-4 |
G5-2 |
2 meters |
|
U2 |
G0-2 |
G5-4 |
2 meters |
Footnote 3 Un is the unit location in the rack, where n is the number.
Three-Phase Power Distribution Unit Cabling Connections
Table 18-4 shows the cable connections from the power distribution units (PDUs) to the rack units in a Recovery Appliance X4 full rack. The destinations and the cable lengths are the same in racks with fewer storage servers. The cables terminate at PDU-A on the left and are routed to the right to enter the cable management arm (CMA). The cables are bundled in groups of four.
Table 18-4 Three-Phase PDU Cabling for the Recovery Appliance X4 Full Racks
| Rack Unit(4) | PDU-A | PDU-B | Cable Length |
|---|---|---|---|
|
U39 |
G5-6 |
G2-0 |
2 meters |
|
U37 |
G5-3 |
G2-3 |
2 meters |
|
U35 |
G5-0 |
G2-6 |
2 meters |
|
U33 |
G4-6 |
G1-0 |
2 meters |
|
U31 |
G4-4 |
G1-2 |
2 meters |
|
U29 |
G4-2 |
G1-4 |
2 meters |
|
U27 |
G3-6 |
G0-0 |
2 meters |
|
U22 |
G3-1 |
G0-5 |
2 meters |
|
U21 |
G3-0 |
G0-6 |
2 meters |
|
U20 |
G2-4 |
G5-2 |
2 meters |
|
U17 |
G2-1 |
G5-5 |
2 meters |
|
U16 |
G1-6 |
G4-0 |
2 meters |
|
U14 |
G2-0 |
G5-6 |
2 meters |
|
U12 |
G1-4 |
G4-2 |
2 meters |
|
U10 |
G1-2 |
G4-4 |
2 meters |
|
U8 |
G1-0 |
G4-6 |
2 meters |
|
U6 |
G0-6 |
G3-0 |
2 meters |
|
U4 |
G0-4 |
G3-2 |
2 meters |
|
U2 |
G0-2 |
G3-4 |
2 meters |
Footnote 4 Un is the unit location in the rack, where n is the number.
InfiniBand Switch-to-Switch Cabling Connections
Table 18-5 lists the ports and cable lengths for the InfiniBand connections between the two gateway leaf switches, which are located in rack units 20 and 22. All cables are black quad data rate (QDR) InfiniBand cables.
Table 18-5 InfiniBand Switch-to-Switch Cabling
| From InfiniBand Switch U20 Port(5) | To InfiniBand Switch U22 Port5 | Cable Length |
|---|---|---|
|
9B |
9A |
1 meter |
|
10B |
10A |
1 meter |
|
11B |
11A |
1 meter |
|
8A |
8A |
1 meter |
|
9A |
9B |
1 meter |
|
10A |
10B |
1 meter |
|
11A |
11B |
1 meter |
Footnote 5 Un is the unit location in the rack, where n is the number.
InfiniBand Switch-to-Server Cabling Connections
Table 18-6 lists the location, ports, and cables for the InfiniBand connections from the gateway leaf switches to the servers in a Recovery Appliance X4 full rack. The port numbers and cable lengths are the same in racks with fewer storage servers. The switches are located in rack units 20 and 22.
All cables are black quad data rate (QDR) InfiniBand cables.
Table 18-6 InfiniBand Switch-to-Server Cabling for the Recovery Appliance X4 Full Racks
| From InfiniBand Switch Rack Unit(6) | Port | To Rack Unit | To Rack Unit | Port | Cable Length |
|---|---|---|---|---|---|
|
U22 |
0A |
U39 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
0B |
U37 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
1A |
U35 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
1B |
U33 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
2A |
U31 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
2B |
U29 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
3B |
U27 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U22 |
13B |
U17 |
Compute server |
PCIe 2, P2 |
2 meters |
|
U22 |
14B |
U16 |
Compute server |
PCIe 2, P2 |
2 meters |
|
U22 |
14A |
U14 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
15A |
U12 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
15B |
U10 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
16A |
U8 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
16B |
U6 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
17A |
U4 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U22 |
17B |
U2 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
0A |
U39 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
0B |
U37 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
1A |
U35 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
1B |
U33 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
2A |
U31 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
2B |
U29 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
3B |
U27 |
Storage server |
PCIe 3, P2 |
3 meters |
|
U20 |
13B |
U17 |
Compute server |
PCIe 2, P1 |
2 meters |
|
U20 |
14B |
U16 |
Compute server |
PCIe 2, P1 |
2 meters |
|
U20 |
14A |
U14 |
Storage server |
PCIe 3, P1 |
2 meters |
|
U20 |
15A |
U12 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U20 |
15B |
U10 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U20 |
16A |
U8 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U20 |
16B |
U6 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U20 |
17A |
U4 |
Storage server |
PCIe 3, P1 |
3 meters |
|
U20 |
17B |
U2 |
Storage server |
PCIe 3, P1 |
3 meters |
Footnote 6 Un is the unit location in the rack, where n is the number.