21.7 InfiniBand Network Cabling Tables
This section contains the tables for the InfiniBand network cabling. The Sun Datacenter InfiniBand Switch 36 switches are located in located in rack unit 1, 20 and 24.
The following tables are in this section:
Table 21-20 lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X2-2 Full Rack.
Table 21-20 InfiniBand Network Cabling for Oracle Exadata Database Machine X2-2 Full Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U24 |
0A |
U41 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
0B |
U39 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
1A |
U37 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
1B |
U35 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
2A |
U33 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
2B |
U31 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
3A |
U29 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
3B |
U28 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U24 |
4A |
U27 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U24 |
4B |
U26 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U24 |
5A |
U25 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U24 |
12B |
U19 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
13A |
U18 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
13B |
U17 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
14A |
U16 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
0A |
U41 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
0B |
U39 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
1A |
U37 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
1B |
U35 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
2A |
U33 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
2B |
U31 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
3A |
U29 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
3B |
U28 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
4A |
U27 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
4B |
U26 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
5A |
U25 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U20 |
12B |
U19 |
Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13A |
U18 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13B |
U17 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14A |
U16 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U24 |
8B |
U1 |
Sun Datacenter InfiniBand Switch 36 switch |
0B |
3 meter QDR InfiniBand cable |
|
U20 |
8B |
U1 |
Sun Datacenter InfiniBand Switch 36 switch |
1B |
3 meter QDR InfiniBand cable |
|
U20 |
9B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U20 |
10B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U20 |
11B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U20 |
8A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U20 |
9A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U20 |
10A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U20 |
11A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
|
U1 |
1B |
U20 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
|
U1 |
0B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
Table 21-21 lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X2-2 Half Rack.
Note:
The Sun Datacenter InfiniBand Switch 36 switch in rack position U1 is included in Oracle Exadata Database Machine X2-2 Half Racks with Sun Fire X4170 M2 Oracle Database Servers.
Table 21-21 InfiniBand Network Cabling for Oracle Exadata Database Machine X2-2 Half Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U24 |
12B |
U19 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
13A |
U18 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
13B |
U17 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
14A |
U16 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
12B |
U19 |
Database Server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13A |
U18 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
13B |
U17 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14A |
U16 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
9B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U20 |
10B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U20 |
11B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U20 |
8A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U20 |
9A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U20 |
10A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U20 |
11A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
|
U1 |
1B |
U20 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
|
U1 |
0B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
Table 21-22 lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X2-2 Quarter Rack.
Table 21-22 InfiniBand Network Cabling for Oracle Exadata Database Machine X2-2 Quarter Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U24 |
13B |
U17 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
14A |
U16 |
Database server |
PCIe 2, P2 |
2 meter QDR InfiniBand cable |
|
U24 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U24 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U20 |
13B |
U17 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
14A |
U16 |
Database server |
PCIe 2, P1 |
2 meter QDR InfiniBand cable |
|
U20 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U20 |
9B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U20 |
10B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U20 |
11B |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U20 |
8A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U20 |
9A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U20 |
10A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U20 |
11A |
U24 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
Table 21-23 lists the location, ports and cables for the InfiniBand connections for Oracle Exadata Database Machine X2-8 Full Rack.
Table 21-23 InfiniBand Network Cabling for Oracle Exadata Database Machine X2-8 Full Rack
| From InfiniBand Switch Rack Unit | Port | To Rack Unit | Type of Equipment | Port | Cable Description |
|---|---|---|---|---|---|
|
U23 |
0A |
U41 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
0B |
U39 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
1A |
U37 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
1B |
U35 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
2A |
U33 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
2B |
U31 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
3A |
U29 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
3B |
U24 |
Database server |
EM-3.0 P-O |
2 meter QDR InfiniBand cable |
|
U23 |
4A |
U24 |
Database server |
EM-2.0 P-O |
2 meter QDR InfiniBand cable |
|
U23 |
4B |
U24 |
Database server |
EM-1.0 P-O |
2 meter QDR InfiniBand cable |
|
U23 |
5A |
U24 |
Database server |
EM-0.0 P-O |
2 meter QDR InfiniBand cable |
|
U23 |
13A |
U16 |
Database server |
EM-2.0 P-1 |
2 meter QDR InfiniBand cable |
|
U23 |
13B |
U16 |
Database server |
EM-1.0 P-1 |
2 meter QDR InfiniBand cable |
|
U23 |
14A |
U16 |
Database server |
EM-0.0 P-1 |
2 meter QDR InfiniBand cable |
|
U23 |
12B |
U16 |
Database server |
EM-3.0 P-1 |
2 meter QDR InfiniBand cable |
|
U23 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U23 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
0A |
U41 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
0B |
U39 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
1A |
U37 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
1B |
U35 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
2A |
U33 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
2B |
U31 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
3A |
U29 |
Exadata Storage Server |
PCIe 3, P2 |
3 meter QDR InfiniBand cable |
|
U21 |
3B |
U24 |
Database server |
EM-3.0 P-1 |
2 meter QDR InfiniBand cable |
|
U21 |
4A |
U24 |
Database server |
EM-2.0 P-1 |
2 meter QDR InfiniBand cable |
|
U21 |
4B |
U24 |
Database server |
EM-1.0 P-1 |
2 meter QDR InfiniBand cable |
|
U21 |
5A |
U24 |
Database server |
EM-0.0 P-1 |
2 meter QDR InfiniBand cable |
|
U21 |
12B |
U16 |
Database Server |
EM-3.0 P-O |
2 meter QDR InfiniBand cable |
|
U21 |
13A |
U16 |
Database server |
EM-2.0 P-O |
2 meter QDR InfiniBand cable |
|
U21 |
13B |
U16 |
Database server |
EM-1.0 P-O |
2 meter QDR InfiniBand cable |
|
U21 |
14A |
U16 |
Database server |
EM-0.0 P-O |
2 meter QDR InfiniBand cable |
|
U21 |
14B |
U14 |
Exadata Storage Server |
PCIe 3, P1 |
2 meter QDR InfiniBand cable |
|
U21 |
15A |
U12 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U21 |
15B |
U10 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U21 |
16A |
U8 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U21 |
16B |
U6 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U21 |
17A |
U4 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U21 |
17B |
U2 |
Exadata Storage Server |
PCIe 3, P1 |
3 meter QDR InfiniBand cable |
|
U23 |
8B |
U1 |
Sun Datacenter InfiniBand Switch 36 switch |
0B |
3 meter QDR InfiniBand cable |
|
U21 |
8B |
U1 |
Sun Datacenter InfiniBand Switch 36 switch |
1B |
3 meter QDR InfiniBand cable |
|
U21 |
9B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
9A |
1 meter QDR InfiniBand cable |
|
U21 |
10B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
10A |
1 meter QDR InfiniBand cable |
|
U21 |
11B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
11A |
1 meter QDR InfiniBand cable |
|
U21 |
8A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
8A |
1 meter QDR InfiniBand cable |
|
U21 |
9A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
9B |
1 meter QDR InfiniBand cable |
|
U21 |
10A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
10B |
1 meter QDR InfiniBand cable |
|
U21 |
11A |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
11B |
1 meter QDR InfiniBand cable |
|
U1 |
1B |
U21 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |
|
U1 |
0B |
U23 |
Sun Datacenter InfiniBand Switch 36 switch |
8B |
3 meter QDR InfiniBand cable |