Creating and Removing EoIB Datalinks

Language:

Starting with the Oracle Solaris 11.2, release, you can create an EoIB datalink as a special eoib class object over an IB physical link using the dladm create-eoib command. These eoib class EoIB datalinks can host Ethernet data transfers just as regular Ethernet datalinks do. Additionally, you can also build VNICs and VLANs over these EoIB datalinks by using the dladm create-vnic and dladm create-vlan commands.

Note - EoIB datalinks can be created arbitrarily on Oracle Solaris. However, for data transfers to be successful, a Sun Network QDR InfiniBand Gateway Switch must be properly configured on the InfiniBand fabric. For information about configuring the gateway, see the Sun Network QDR InfiniBand Gateway Switch Administration Guide.

For information about configuring the network components, see Configuring and Managing Network Components in Oracle Solaris 11.4.

How to Create and Configure an EoIB Datalink

Become an administrator.
Display information about a chosen IB physical link.
```
# dladm show-ib link
```
If the output shows that the link's port is down, you can still proceed with the datalink creation and configuration. Then when the causes of the down state are resolved, the datalink will automatically transition to the up state. For more information about the information that this command displays, see Displaying Physical Data Link Information.
Create a new EoIB datalink and bind the host IB port to the Ethernet port on the EoIB gateway.
```
# dladm create-eoib -l link -g gway -c gway-port eoib-link
```
link

Name of the physical link.

gway

Gateway name.

gway-port

Gateway Ethernet port.

eoib-link

Name of the EoIB datalink.
Create an IP interface over the datalink and assign an IP address to the interface.
```
# ipadm create-ip name
# ipadm create-addr -a address [address-object]
```
name

Name of the EoIB interface.

address

A valid IP address. By default, this address is assumed to be a static address.

address-object

A name that identifies the IP address in association with the IP interface. If address-object is not specified, the OS automatically assigns a name using the format name/protocol.
(Optional) Display the interface information.
```
# ipadm show-addr
```
Display the EoIB datalink information.
You can use either the standard show-link subcommand for more general information or the show-eiob subcommand for more specific IB-related information.
```
# dladm show-link [eoib-link]

# dladm show-eoib [eoib-link]
```
For sample output, see Example 33, Displaying EoIB Datalink Information.

Example 32 Creating and Configuring an EoIB Datalink

In this example, an EoIB link is configured over ibp1.

# dladm show-ib ibp1
LINK    HCAGUID        PORTGUID       PORT STATE GWNAME  GWPORT   PKEYS
ibp1    212800013F2F5A 212800013F2F5C 1    up    nm2gw-1 0a-eth-1 FFFF,8001
                                                 nm2gw-1 0a-eth-2
                                                 nm2gw-1 0a-eth-3
                                                 nm2gw-1 0a-eth-4

# dladm create-eoib -l ibp1 -g nm2gw-1 -c 0a-eth-2 eib1

# ipadm create-ip eib1
# ipadm create-addr -a=192.0.2.35/27
# ipadm show-addr eib1
ADDROBJ   STATE    TYPE   ADDR
eib1/v4   static   ok     192.0.2.35.27

# dladm show-link eib1
LINK    CLASS  MTU   STATE  OVER
eib1    eoib   1500  up     ibp1

# dladm show-eoib eib1
LINK    GWNAME  GWPORT   GWID FLAGS  SPEED MACADDRESS     OVER 
eib1    nm2gw-1 0a-eth-2 1A8  aHnU-- 10000 0:25:8b:60:2:3 ibp1

Example 33 Displaying EoIB Datalink Information

This example shows typical output of the dladm show-eoib command.

LINK    GWNAME  GWPORT   GWID FLAGS  SPEED MACADDRESS     OVER 
eib1    nm2gw-1 0a-eth-2 1A8  aHnU-- 10000 0:25:8b:60:2:3 ibp1

The GWID value 1A8 is the unique identifier associated with the gateway and Ethernet port {nm2gw-1, 0a-eth-2} on the IB fabric. The MAC address is the address specified as a parameter when the VNIC associated with this datalink was created on the gateway. For more information about the output, see the dladm(8) man page.

The VNIC in this context refers to the entity created on the gateway switch using the createvnic gateway command. This VNIC is different from the entity that is created with Oracle Solaris dladm subcommands.

For more information about the createvnic command, see the Sun Network QDR InfiniBand Gateway Switch Command Reference.

How to Remove an EoIB Datalink

You can remove an existing EoIB datalink that has no IP interfaces, VLANs, or VNICs currently built over it.

Become an administrator.
List the EoIB datalinks to identify the EoIB datalink to remove.
```
# dladm show-eoib
```
Verify that no VNICs, VLANs, and IP interfaces are built over the EoIB datalink.
```
# dladm show-vlan link
# dladm show-vnic -l link
# dladm show-if interface
```
where link is the EoIB datalink you want to remove and interface is the IP interface that might be configured over the EoIB datalink. Typically, the interface name is identical with the datalink name over which the interface is created.
Remove any interfaces built over the EoIB datalink.
```
# ipadm delete-ip interface
```
Remove the EoIB datalink.
```
# dladm delete-eoib link
```
Verify that the EoIB datalink is removed.
```
# dladm show-eoib link
```

Example 34 Removing an EoIB Datalink

In this example, the IP interface is first removed from the datalink eib1 before the datalink itself is removed. No VLANs nor VNICs are configured over the link.

# dladm show-eoib eib1
LINK    GWNAME  GWPORT   GWID FLAGS  SPEED MACADDRESS     OVER
eib1    nm2gw-1 0a-eth-2 1A8  aHnU-- 10000 0:25:8b:60:2:3 ibp1

# dladm show-vlan eib1
dladm: failed to show vlan eib1: object not found
# dladm show-vnic -l eib1
no output generated
# ipadm show-if eib1
IFNAME  CLASS  STATE  ACTIVE  OVER 
eib1    ip     ok     yes     --

# ipadm delete-ip eib1
# dladm delete-eoib eib1
# dladm show-eoib eib1
dladm: non-existent datalink 'eib1'