Re: Configuration settings for IPoIB performance
Pure centos 6.5 x86_64 1. echo "connected" > /sys/class/net/ib0/mode2. ifconfig ib0 mtu 65520 No other tuning! No external OFED install! service rdma start iperf -P 1 -c...
View ArticleSys log message
Hi , anyone know what these messages mean, anything to worry about and if not, how can I stop them from filling up my syslog files? Apr 25 16:12:29 hksw1001 issd[4840]: TID 1299130464: [issd.ERR]:...
View ArticleMXM ERROR failed to create send cq: Cannot allocate memory
I am trying to setup a small HPC cluster using Mellanox MT26428 [ConnectX VPI PCIe 2.0 5GT/s - IB QDR / 10GigE] cards and a M3601Q switch to work with openMPI and SLURM. I have read that I need to...
View ArticleRe: MXM ERROR failed to create send cq: Cannot allocate memory
For MTT values, you no longer need to set them if you are using MLNX_OFED 2.x versions. So which version of MLNX_OFED are you using? This seems that if you are getting memlock limit to 64KB, it has...
View ArticleRe: IPoIB performance issue!!
Thanks a lot "yairi" and "ingvar_j" for your response. Finally I was able to achieve ~20 Gbs on FDR. withOFED : MLNX_OFED_LINUX-2.0-3.0.0 (OFED-2.0-3.0.0)Firmaware: 2.30.3000Infiniband card type: x4...
View ArticleRe: Sys log message
Hi gandriano, Can you provide the code level your Mellanox Ethernet Switch is running on?I think it's a harmless message related to an Older code level, but I would like to get your code level just to...
View ArticleClik here to view.
Re: SX1012 Openflow => Defense4All via OpenDaylight Controller
Hi thanks for that, I was really just looking at options. In my case the DC are going to put in some thunder tps boxes from a10networks which are specifically for ddos But out of path ddos protection...
View ArticleRe: Configuration settings for IPoIB performance
Thanks wesb! I upgraded the IB drivers to latest Mellanox 2.1, set the system to "connected" mode and MTU size to 65520. Now, I'm getting performance of ~13.5Gb/s.I'm getting much less performance than...
View ArticleRe: Configuration settings for IPoIB performance
For the record I measured it with:ConnectX-2 cardsQDR switch2 * E5-2620/128GB boxesAgain, no playing with external OFED - just yum groupinstall "Infiniband Support"
View ArticleRe: MXM ERROR failed to create send cq: Cannot allocate memory
Good morning, thanks a lot for your answer.I spent the whole day yesterday trying to troubleshoot this problem. You are right, I had a system locked memory of 64Kb, which was peanuts. I have solved...
View ArticleClik here to view.
Re: MXM ERROR failed to create send cq: Cannot allocate memory
Good to know it works finally for you. The knem improves only for the large messages transfers betwen MPI processes within the node. It must be that memlock limit you set in the...
View ArticleTrouble with ConnectX-3 VPI adapter card over XenServer 6.2 (Service Pack 1)
Hi all, we are trying to use a ConnectX-3 VPI adapter card over XenServer 6.2, for this we have followed the following steps: 1) Install XenServer 6.2 on my system (Supermicro 1027GR-TRF) 2) Install...
View ArticleRe: Configuration settings for IPoIB performance
You cannot expect much better performance than this, you are hitting CPU barriers as all TCP error correction with IPOIB is done in software, not in hardware. You can try adjusting TCP window settings...
View ArticleClik here to view.
Re: Trouble with ConnectX-3 VPI adapter card over XenServer 6.2 (Service Pack 1)
Have you tried version 1_5_3-4_0_42 instead? You may need to contact Mellanox support for XenServer driver.
View ArticleRe: Strange рerformance problem with CX354A - ConnectX-3 QSFP with large...
Have you tried to connect to a different port on the switch to see if this problem exists with the port or the cable?
View ArticleRe: Strange рerformance problem with CX354A - ConnectX-3 QSFP with large...
Yes, I tried even different pair of servers with different cables and ports.
View ArticleRe: Issues with SRP and unexplainable "ibping" behaviour.
Hey,Have you tried upgrading the Firmware version?
View ArticleRe: Are ConnectX-3 VPI adapters compatible with the Red Hat MRG (i.e....
Hi,I've checked that and it does not yet support Red Hat Enterprise MRG.
View ArticleRe: Trouble with ConnectX-3 VPI adapter card over XenServer 6.2 (Service Pack 1)
Hi, I have tried with MLNX_OFED_LINUX-2.2-1.0.1-xenserver6.x-i686 and the firmware update, but I have obtained the same results that was shown on the first post. So I have some questions:Did you use...
View ArticleRe: PCIe Bracket for Connect-X EN2
Hi,I'll recommend contacting one of Mellanox sales department,depending on your regional.Contact Us - Mellanox Technologies
View Article