The switch indicates all ports are disconnected even with a cable in any of them. I toggle the enable/disable ports and there is no difference. If I use direct connection between nodes using IPoIB it works fine. My card are on 2.7.1 fw version so they work in Windows 2012 with RDMA. Possible firmware issue between card and switch? The switch switch is on 0.8.6 FW which is old.
Worst case I can buy a newer Mellanox 8 port IS5022 I believe they are backward compatible with X-2
Thanks