Hmm, Interesting, I did notice that the Node GUID was different from the Port GUID's
So as long as the target address is the node GUID the IB will load balance ?
As an example:
# ibstat CA 'mlx4_0' CA type: MT25418 Number of ports: 2 Firmware version: 2.3.0 Hardware version: a0 Node GUID: 0x0002c9030002fb04 !!!!!!!!!!!!!!!!!!! System image GUID: 0x0002c9030002fb07 Port 1: State: Active Physical state: LinkUp Rate: 20 Base lid: 2 LMC: 0 SM lid: 1 Capability mask: 0x02510868 Port GUID: 0x0002c9030002fb05 !!!!!!!!!!!!!!!!!!! Port 2: State: Down Physical state: Polling Rate: 10 Base lid: 0 LMC: 0 SM lid: 0 Capability mask: 0x02510868 Port GUID: 0x0002c9030002fb06 !!!!!!!!!!!!!!!!!!!