Main Menu

Search

EXALOGIC: INFINIBAND: How to correlate which Physical Connector Ports of IB Switch are connected to which Compute Nodes?

On IB Switches typically Switch ports will have physical name for connector ports which is different than the Switch Port numbers seen in "ibnetdiscover" command. Names for Switch Ports will be 1A, 1B ... 14A, 14B ... etc. These names can be mapped to Switch Port numbers by looking at "listlinkup" command output.

For e.g. if you want to track the Switch connector port 13A below is how we can do it.

Run "listlinkup" command to see to which Switch Port the Switch Connector port 13A maps to. For e.g. from listlinkup command example output below we see as follows that connector port 13A corresponds to Switch Port 9.
 Connector 13A Present <-> Switch Port 9 up (Enabled) 
Now run "ibnetdiscover" command. From ibnetdiscover output we see switch Port 9 of both Switches is connected to Compute node 6 as seen in below example output. 

 Ca 2 "H-XXXXXXXXX" # "el01cn06 EL-C  XX.XX.XX.XX HCA-1" 
[2](ZZZZZZZZZZZZZZ) "S-00XXXXXXXXXX0a0"[9] # lid 25 lmc 0 "SUN IB QDR GW switch el01gw02 XX.XX.XX.XX leaf:2" lid 11 4xQDR 
[1](ZZZZZZZZZZZZZZ) "S-00XXXXXXXXXX0a0"[9] # lid 24 lmc 0 "SUN IB QDR GW switch el01gw01 XX.XX.XX.XX leaf:1" lid 41 4xQDR  



Products to which Article Applies
Infiniband Switches

Article Author: Tarun Boyella

No comments:

Post a Comment