17.6 InfiniBand Network Cabling Tables
This topic contains the tables for InfiniBand network cabling for Oracle Exadata Database Machine X8 and X7 racks.
The Sun Datacenter InfiniBand Switch 36 switches are located in rack units 20 and 22. If present, the optional spine switch is located in rack unit 1.
In the following tables, Un denotes the unit height in the rack, where n is the number, such as U20. Pn denotes the InfiniBand port n, where n is port number, such as P1. The cables used for the InfiniBand switch are black in color. The following tables are in this section:
- Table 17-13 InfiniBand Network Cabling for Oracle Exadata Database Machine X8-2 and X7-2 Full Rack
- Table 17-14 InfiniBand Network Cabling for Oracle Exadata Database Machine X8-8 and X7-8 Full Rack
The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X8-2 and X7-2 Full Rack.
Table 17-13 InfiniBand Network Cabling for Oracle Exadata Database Machine X8-2 and X7-2 Full Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U22 |
0A |
U39 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
0B |
U37 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
1A |
U35 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
1B |
U33 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
2A |
U31 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
2B |
U29 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
3B |
U27 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U22 |
3A |
U26 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U22 |
4A |
U25 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U22 |
4B |
U24 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U22 |
5A |
U23 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U22 |
12B |
U19 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U22 |
13A |
U18 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U22 |
13B |
U17 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U22 |
14B |
U16 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U22 |
14A |
U14 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
15A |
U12 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
15B |
U10 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
16A |
U8 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
16B |
U6 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
17A |
U4 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U22 |
17B |
U2 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
0A |
U39 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
0B |
U37 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
1A |
U35 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
1B |
U33 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
2A |
U31 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
2B |
U29 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
3B |
U27 |
Oracle Exadata Storage Server |
PCIe 7, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
3A |
U26 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
4A |
U25 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
4B |
U24 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
5A |
U23 |
Oracle Exadata Database Server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
12B |
U19 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13A |
U18 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13B |
U17 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14B |
U16 |
Oracle Exadata Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14A |
U14 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
15A |
U12 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
15B |
U10 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16A |
U8 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16B |
U6 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17A |
U4 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17B |
U2 |
Oracle Exadata Storage Server |
PCIe 7, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
9B |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U20 |
10B |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U20 |
11B |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U20 |
8A |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U20 |
9A |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U20 |
10A |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U20 |
11A |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
|
U1 — when added as an optional configuration |
1B |
U20 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
|
U1 — when added as an optional configuration |
0B |
U22 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
The following table lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X8-8 and X7-8 Full Rack.
Table 17-14 InfiniBand Network Cabling for Oracle Exadata Database Machine X8-8 and X7-8 Full Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U23 |
0A |
U41 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
0B |
U39 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
1A |
U37 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
1B |
U35 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
2A |
U33 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
2B |
U31 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
3B |
U29 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U23 |
3A |
U24 |
Oracle Exadata Database Server |
12 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U23 |
4A |
U24 |
Oracle Exadata Database Server |
10 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U23 |
4B |
U24 |
Oracle Exadata Database Server |
8 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U23 |
5A |
U24 |
Oracle Exadata Database Server |
6 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U23 |
13A |
U16 |
Oracle Exadata Database Server |
10 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U23 |
13B |
U16 |
Oracle Exadata Database Server |
8 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U23 |
14B |
U16 |
Oracle Exadata Database Server |
6 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U23 |
12B |
U16 |
Oracle Exadata Database Server |
12 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U23 |
14A |
U14 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
15A |
U12 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
15B |
U10 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
16A |
U8 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
16B |
U6 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
17A |
U4 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U23 |
17B |
U2 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
0A |
U41 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
0B |
U39 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
1A |
U37 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
1B |
U35 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
2A |
U33 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
2B |
U31 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
3B |
U29 |
Oracle Exadata Storage Server |
3 PCIe3 P2 |
3 meter QDR InfiniBand cable |
|
U21 |
3A |
U24 |
Oracle Exadata Database Server |
12 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U21 |
4A |
U24 |
Oracle Exadata Database Server |
10 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U21 |
4B |
U24 |
Oracle Exadata Database Server |
8 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U21 |
5A |
U24 |
Oracle Exadata Database Server |
6 PCIe3 P2 |
2 meter QDR InfiniBand cable |
|
U21 |
12B |
U16 |
Oracle Exadata Database Server |
12 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U21 |
13A |
U16 |
Oracle Exadata Database Server |
10 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U21 |
13B |
U16 |
Oracle Exadata Database Server |
8 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U21 |
14B |
U16 |
Oracle Exadata Database Server |
6 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U21 |
14A |
U14 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
2 meter QDR InfiniBand cable |
|
U21 |
15A |
U12 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
15B |
U10 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
16A |
U8 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
16B |
U6 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
17A |
U4 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
17B |
U2 |
Oracle Exadata Storage Server |
3 PCIe3 P1 |
3 meter QDR InfiniBand cable |
|
U21 |
9B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U21 |
10B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U21 |
11B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U21 |
8A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U21 |
9A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U21 |
10A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U21 |
11A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
|
U1 — when added as an optional configuration |
1B |
U21 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
|
U1 — when added as an optional configuration |
0B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |