Hi!
Can you posting hour system configurations and OS version?
I'm also have a CX-2 based system in my personal lab.
I prefer to test in vSphere environment, but I remember that performance on Windows environment was always over 1Gb ETH connections.
If you show me your detailed configuration then I'll post result after weekend test.
P.S
Mellanox announced end of support CX-2.
Current WinOF release will be a last support CX-2 on Windows!
Check release notes and user guide.
Do you have subnet manager running on the network? This is required for an IB fabric to work. Since the switch you are using is unmanaged, this has to be run on a host machine.
ibv_devinfo will confirm if these hosts have addresses assigned which in turn will indicate SM availability.
The MC2207310 has QSFP on both ends and is a complete solution to connect QSFP to QSFP. The cable is offered in various lengths. The part # you mentioned is 3m cable.
MC2207411-SR4 is a QSFP optical module with MPO connector and would require an MPO cable to be attached in between a pair..
here is a link where you can find out more about the optical modules we offer:
http://www.mellanox.com/related-docs/prod_cables/PB_Active_Optical_Modules_QSFP_SFP_SFP+.pdf
Hi Nathan,
I did not see anything specific in the release notes on this, but Mellanox has a later version 4.80.50000 on their website. Might be worth a shot to try the new driver on a test sever.
Hi there,
Thanks.
Yes subnet manager was what I didn't know that I need to use I did the openSM, and it is running now.
Why does IB need a subnet manager?
I did run ib_devinfo, it just show the port_active, and not an address.
Under network properties, I assigned like 192.168.1.3/255.255.255.0, I don't need any subnet just like regular networking right ?
Also, since I am using an unmanaged switch, I don't mind running OpenSM on a host machine, but if I am just using IB for my backend storage, would the switch I have right now be sufficient ? or do I still need a managed one.. thinking about doing iSCSI
Ophir,
Yes, I got it going, thanks for the help, though I see following issues and not sure how to proceed about these issues.
1. With ib_send_bw
ib_send_bw -d mlx4_0 -i 1 -F --report_gbits 192.168.100.189
Infiniband has a kernel bypass characteristic.
Did you check your IB switch's log?
I thinki that's a basic check point.
ib_send_bw is script that is part of testperf package (you should have it with the installation of MLNX_OFED).
When using this script, you can test the bandwidth of the link between the servers.
there are similar other script that check latency and throughput.
In general, you need to run server on one host, and the client on another host.
on the server run:
#ib_send_bw -d mlx4_0 -i 1 -F --report_gbits
on the client run
#ib_send_bw -d mlx4_0 -i 1 -F --report_gbits 192.168.100.189
Try running ib_send_bw -h to see additional parameters of this command and some help.
#ib_send_bw -h
More tuning info can be found here:
Thanks,
Ophir
Subnet manager is the control plane of the fabric. It assigns addresses (L2 LID address) and establishes routing tables.
It will assign a Layer 2 identified, not an IP address. If the port is active, it should have an address. IB managed and unmanaged switches have the same functionality except ability to run SM. In addition, managing a managed switch is easier.
If you can run SM on a server, the QDR switch you have must suffice.
Anand
Hi all,
Can somebody write down what is the difference between MC2206130 and MCC4Q28C REV B0 cables?
I can see the MCC4Q28C's connector is much longer than MC2206130's but is there any other functional differencies?
tnx for answare!
Hello all!
Our company have obtained mellanox switch with two management modules MSX6000MAR PPC460.
The problem is that the 2nd mgmt module has a different software version installed (3.3.4402) and the master (slot#1) has 3.3.5006.
System can't recognise the 2nd module when starting.
We have tried to update image file into the management module via web console, but there was an error:
Error: *** Could not verify image webimage.tbz
How to do it correctly?
Thanks for all replies
Hi Yuri,
Please check the md5sum of the .img file, it should be:
2be840eb0a34b314d45a92a6cc2351dc image-PPC_M460EX-SX_3.3.5006.img
And if not the same please re download the .img file from the support website
Hi Ricardo,
Did you manage to overcome the issues?
Hi Danny,
MTS2400-24 is a Flextornics OEM switch.
I would like to advise you to contact Flextronics representatives:
Michael.Dolkin@il.flextronics.com
Tomer.Fridman@il.flextronics.com
You can also refer the following link to get more information :
Hi Eddie,
After downloading the image for the second time, we have solved our problem.
Thank you for you help!
Mon, 22 Sep 2014 23:44:01 -0700 от "eddie.notz" <socialmedia@mellanox.com>:
>Mellanox Interconnect Community
>Problem with update the new image file into MSX6000MAR PPC460 management module
>reply from eddie.notz in Yuri Murin - View the full discussion
Sorry for no answers - thought the question was ignored and lost the link .
The model of the Intel IB-cards is AXX1FDRIBIOM as i've researched. As an update - the NFSoRDMA hangs not only with Win VMs, but just any VMs with no way to predict - there may be 100s of errors Connection closed error -103, and all is fine, or 1-2 lines and hanged up connection...
I've encountered a problem while adding kernel support to the latest MLNX_OFED-2.3-1.0.1. I downloaded the latest version (MLNX_OFED_LINUX-2.3-1.0.1-xenserver6.x-i686, checked both: iso and tgz) from the website. Then I executed the following command on the DDK (XenServer-6.2.0-SP1-ddk.iso, CTX139817 - Driver Development Kit - For XenServer 6.2.0 Service Pack 1 - Citrix Knowledge Center):
# ./mlnx_add_kernel_support.sh -m /mnt/tmp/MLNX_OFED_LINUX-2.3-1.0.1-xenserver6.x-i686 --make-tgz -t /mnt/tmp/
Note: This program will create MLNX_OFED_LINUX TGZ for rhel5.7 under /tmp directory.
All Mellanox, OEM, OFED, or Distribution IB packages will be removed.
Do you want to continue?[y/N]:y
See log file /tmp/mlnx_ofed_iso.4987.log
Building OFED RPMs. Please wait...
ERROR: Failed executing "MLNX_OFED_SRC-2.3-1.0.0/install.pl -c /mnt/tmp//mlnx_iso.4987/ofed.conf --kernel 2.6.32.43-0.4.1.xs1.8.0.847.170785xen --kernel-sources /lib/modules/2.6.32.43-0.4.1.xs1.8.0.847.170785xen/build/ --builddir /mnt/tmp//mlnx_iso.4987 --disable-kmp --build-only"
ERROR: See /tmp/mlnx_ofed_iso.4987.log
/mnt - is the NFS share. I use tmp directory on this share since local DDK's tmp doesn't have enough space.
The logs indicate the following errors:
/bin/rpm -ihv --root /mnt/tmp//mlnx_iso.4987 /mnt/tmp//mlnx_iso.4987/OFED_topdir/RPMS/i686/kernel-ib-devel-2.3-2.6.32.43_0.4.1.xs1.8.0.847.170785xen_OFED.2.3.1.0.0.1.g793fc5d.i686.rpm
error: can't create transaction lock on /mnt/tmp/mlnx_iso.4987/var/lib/rpm/__db.000
and:
Processing files: iser-1.4.5-2.6.32.43_0.4.1.xs1.8.0.847.170785xen
error: File not found: /var/tmp/OFED/etc/depmod.d/iser.conf
corresponding logs are attached.
The same procedure with older version (MLNX_OFED_LINUX-2.2-1.0.1-xenserver6.x-i686) goes just fine producing the desired output.
So is this a bug or me missing something?
hmm,
I am assuming you are running as root?
Do you have any weird permissions on /mnt/ that would prevent rpm from executing?
Yes I know Connect X 'officially' has not been supported on ESXi5.x acoording to VMware: Firmware - Driver Compatibility Matrix.
http://www.mellanox.com/page/vmware_matrix?mtag=vmware_drivers
but I would like to know if anyone has tried C-X on ESXi5 and there are some issues on it.Checking old thread in this forum.I found this thread - it works good though It is not officially supported but there are some issues we must be careful.
http://community.mellanox.com/thread/1113
some issues or trials are updated lalely? please let me know the combinaton works good or not.