So I have been delving into this and I've found the following:
I have managed to compile ofed 1.5.3 in CentOS 6.5 after following this post instructions (el5.10 ofed build problem.)
My infiniband nodes have these cards:
- computing nodes:
- Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]
- CA type: MT26428
- Firmware version: 2.9.1100
- GPFS servers:
- Mellanox Technologies MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE]
- CA type: MT26428
- Firmware version: 2.9.1000
- Other GPFS clients:
- Mellanox Technologies MT27500 Family [ConnectX-3]
- CA type: MT4099
- Firmware version: 2.10.300 (upgradable up to 2.11.500)
And, according to the release notes:
2.2
MLNX_OFED Rev 2.2-1.0.1 supports the following Mellanox network adapter cards:
• Connect-IB® (Rev 10.10.3000 and above)
• ConnectX®-3 Pro (Rev 2.31.5050 and above)
• ConnectX®-3 (Rev 2.31.5050 and above)
• ConnectX®-2 (Rev 2.9.1200 and above)
ConnectX®-2 does not support all the new functionality of MLNX_OFED 2.0.3-XXX. For the complete list of the supported features per HCA, please refer to the MLNX_OFED User Manual.
1.5.3
Mellanox supports the following adapters with MLNX_OFED_LINUX 1.5.3:
- Mellanox Technologies HCAs (SDR and DDR Modes are Supported):
- ConnectX-2 / ConnectX-2 EN (fw-ConnectX2 Rev 2.9.1000)
- ConnectX-3 VPI / ConnectX-3 EN (fw-4099 Rev 2.11.0500)
So, it seems that none of my current cards are compatible with ofed 2.2, and only some of my servers are compatible with the latest 1.5.3.
What should I do? Should I keep everything at 1.5.3? Should I update everything to 2.2? Would I win anything for moving to 2.2?
And when buying new nodes (with new cards)? Should we install them with 2.2? Should we downgrade them to 1.5.3? Can both 1.5.3 and 2.2 coexist in the same network? Will 1.5.3 last? Is it already "dead"?
Thanks in advance,
Txema