LINUX: mlx4_vnic_info command to list all details of Ethernet Interface (MTU, Link Status, VLAN, PKEY, MAC, Switch It is Associated etc.)

Below mlx4_vnic_info command on Linux node will list all details of Ethernet Interface (MTU, Link Status, VLAN, PKEY, MAC, Switch It is Associated etc.)

mlx4_vnic_info -i

Below is exanple output of above command.

NETDEV_REGIST yes 
NETDEV_NAME   eth1286_1.324 
NETDEV_LINK   up 
NETDEV_OPEN   yes 
NETDEV_QSTOP  no 
NETDEV_MTU    1500 
IOA_PORT      mlx4_0:1 
IOA_NAME      MT25408 ConnectX Mellanox Technologies-P1 
IOA_LID       0x007d 
IOA_GUID      91:9b:f9:97:XXXXXXXX
IOA_LOG_LINK  up 
IOA_PHY_LINK  active 
IOA_MTU       2048 
EPORT_STATE   up 
EPORT_NAME    0A-ETH-1 
EPORT_QPN     0x800000 
EPORT_LID     0x0011 
EPORT_ID      1286 
BX_NAME       switch01 
BX_GUID       00:10:e0:62:XXXXXXXX
GW_TYPE       LEGACY 
SW_RSS        no 
SW_RSS_SIZE   1 
RX_RINGS_NUM  1 
RX_RINGS_LIN  no 
TX_RINGS_NUM  1 
TX_RINGS_ACT  1 
NDO_TSS       no 
NDO_TSS_SIZE  1 
MCAST_PROMISC no 
MCAST_MASK    48 
PKEY          0x8007 
PKEY_INDEX    0x000b 
PKEY_MEMBER   full 
SL_DATA       1 
SL_CONTROL    2 
LRO           yes 
LRO_NUM       32 
NAPI          yes 
NAPI_WEIGHT   32 
QPN           0x5c0748 
MAC           00:21:f6:XXXXXX
ADMIN_MODE    network 
VLAN          0x144 
SHARED_MAC    N/A 
SHARED_IP     N/A 

Products to which Article Applies
All Linux Hosts using Mellanox mlx4 stack

Article Author: Tarun Boyella

Read more "LINUX: mlx4_vnic_info command to list all details of Ethernet Interface (MTU, Link Status, VLAN, PKEY, MAC, Switch It is Associated etc.)"

INFINIBAND: smpartition commands to add Port GUIDs to Partitions on IB Switches (How To Doc)

Below is the smpartition command sequences to add Port GUIDs to specific Partition key on IB switches.

smpartition start 
smpartition add -pkey <pkey> -port <GUID 1> <GUID 2> <GUID 3> ..... <GUID N> -m <membership> 
smpartition commit

<membership> in above smpartition add command can be full, both or limited.

 For e.g. if you want to add 0x0010eZZZZ1ca0271 0x0010eZZZZ1ca0272 GUIDs to partition key 8008 as both membership your commands will look as follows:

smpartition start 
smpartition add -pkey 0x0008 -port  0x0010eZZZZ1ca0271 0x0010eZZZZ1ca0272 -m both 
smpartition commit 

Products to which Article Applies
Infiniband Switches

Additional Reference
http://docs.oracle.com/cd/E36256_01/html/E36258/z400000a1907717.html

Article Author: Tarun Boyella

Read more "INFINIBAND: smpartition commands to add Port GUIDs to Partitions on IB Switches (How To Doc)"

INFINIBAND: How To Add Node/Host Port GUIDs To A Particular Partition On Infiniband (IB) Switches? ("smpartition" Command)

Follow below steps to follow on Infiniband Switch running SM Master to add Node/host port GUIDs to a particular partition.

1. Login to the IB Switch running SM master as root user. "getmaster" command can be used to identify which IB Switch is running the SM master.

2. Start the SM partition using below command.

smpartition start

3. Add the Node/Host Port GUIDs to a partition using below command.

# smpartition add -pkey <PKey> -port <Port GUID1> <Port GUID2> ... <Port GUIDN> -m <membership>

For e.g. if you want to add port GUIDs 0010e0000164e371 and 0010e0000164e372 as full members to partition key 8008, your command looks as follows:

# smpartition add -pkey 0x0008 -port 0x0010e0000164e371 0x0010e0000164e372 -m full

NOTE: We have to use 0x0008 for 8008 partition (as per new IB firmware version standards from 2.1.5 & above) and for GUIDs we have to append 0x at the beginning.

4. Now commit the partition so that the new partition key addition changes are committed using below command.

smpartition commit

5. Now run below smpartition command and check if newly created partition is seen.

smpartition list active

Products to which Article Applies

Infiniband Switches

Additional Reference

https://docs.oracle.com/cd/E26698_01/html/E26434/z40004162037218.html#scrolltoc
 

Read more "INFINIBAND: How To Add Node/Host Port GUIDs To A Particular Partition On Infiniband (IB) Switches? ("smpartition" Command)"

INFINIBAND: How To Create VNIC on Infiniband (IB) Switches? ("createvnic" Command)

Below is the command to create VNICs on Infiniband (IB) Switches.

createvnic <connector port> -GUID <GUID> -mac <MAC address> -vlan <VLAN ID> -pkey <partition key>

Lets assume the Node for which you want to create has GUID 0xabcde76232ac4df8 and HW address as 00:14:4f:f8:e3:27, and you want to create VNIC on connector port 0A-ETH-1 and partition key 8007, then your createvnic command will look as follows:

createvnic 0A-ETH-1 -GUID ab:cd:e7:62:32:ac:4d:f8 -mac 00:14:4f:f8:e3:27 -vlan 314 -pkey 0x0007

In above command for specifying the GUID 0xabcde76232ac4df8, you want to remove 0x at the beginning after every 2 characters you have to put ":". Please note 8007 partition key has to be specified as 0007 in createvnic command. Because in latest firmware versions of Infiniband after firmware version 2.1.5 & later the first number 8 of partition key is replaced with 0.

Products to which Article Applies

Infiniband Switches

Additional References

https://docs.oracle.com/cd/E26699_01/html/E26706/z40000401971679.html

Read more "INFINIBAND: How To Create VNIC on Infiniband (IB) Switches? ("createvnic" Command)"