Re: Is there a way to download the latest OFED ISO via wget or curl?
Alkx, Thanks for your comment but it was not responsive to the question. We are fully aware of the means to download while accepting the EULA, as is obvious. We are operating in a closed environment...
View ArticleProper Use of Core-Direct/Cross Channel Communication
I wanted to ask a couple of questions about using Core-Direct/cross channel communication. The documentation I've found is a little bit sparse, and I was hoping you could fill in a couple gaps. Thus...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
If both hosts are the same, modules should load fine. There must be some difference between them. Try to compare the OS, kernel, and relevant kernel modules - size, checksum, location, etc. Most likely...
View ArticleClik here to view.
Re: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
This is exactly what I'm thinking, with the addition that host2 has been working fine (with that module loaded) for almost 2 months.OS and kernel are the same (CentOS 6.6, 2.6.32-504.el6.x86_64), also...
View ArticleHow do I configure the MAX_MTU and ACTIVE MTU of a Connect-X2 or -X3
I'm currently working a task to migrate some software from RHEL 6.3 to RHEL 6.7 (no, 7 isn't an option). I'm having issues getting our RDMA connection online, on our Connect-X2 cards. Specifically,...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Are you able to unload and load nvidia modules on the host1? What will happen if host1 will be rebooted? What is the output of "modinfo <MODULE> |grep srcversion" command, where <MODULE>...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Hi alkx, What will happen if host1 will be rebooted? Host1 has been rebooted several times, and nv_peer_mem service still starts successfully every time. Are you able to unload and load nvidia modules...
View ArticleClik here to view.
Where is the latest header file for windows libibverbs?
I have libibverbs.DLL installed by Mellanox WinOF 5.22 adapter in my system32 folder.Where can I find header file (verbs.h as I guess) and import library (LIB file) for it?I need the header file at least.
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Ok. Seems that there is no module loading issue, as all required module are loaded. You may run 'bash -x service nv_peer_mem start' or add more prints to startup scripts and check from the output what...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Two months later and still no reaction from Mellanox. They post lots of information here, mainly about new products, but what about taking care of existing products/customers? I have seen the 2.4.0...
View ArticleRe: nvidia_peer_memory for Cuda8 ?
Seems to be known issue: add support for NV dma mappings APIs · Issue #3 · Mellanox/nv_peer_memory · GitHub
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
Anything in dmesg?The only suspicious line seems to be "nv_p2p_dummy: exports duplicate symbol nvidia_p2p_free_page_table (owned by nvidia)", which appears 6 times in dmesg output, anyway I attach...
View ArticleClik here to view.
Re: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
I heard launching about new vSphere 6.5 yesterday. I'm also heard that Mellanox will drop a support Infiniband iSER on ConnectX-3 and belows from some source that I can't remember exactly now. I give...
View ArticleQuestion for how to use MTUSB on MSB7790?
Dear Admin, I have a customer who has MSB7790 EDR switch , 455A-ECAT EDR HCA and EDR AOC.The customer use the command(mst ib add) to add switch device under /dev/mst/.And use the latest MSB7790...
View ArticleRe: “Invalid module format” error while loading nv_peer_mem in CentOS 6.6
But from earlier comments, it looks like nv_peer_mem is loaded on vega2. Is there same prints about duplicate symbol on the other host comming from nv_p2p_dummy?There must be something different...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
What's your RDMA Storage target and OS?I prefer Solaris family ZFS COMSTAR but ESXi 6.0 and above won't work properly. Best Regards.
View ArticleClik here to view.
Re: 40Gb/s IPoIB only gives 5Gb/s real throughput?!
Hello I have actually gone ahead and buit a second computer with a PCIe 3.0 board.Unfortunately I cannot get the promised speed whatever I try:This is the same maximum speed as before: 5.8Gbit...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
At the moment I use SRP target provided by SCT over the latest Mellanox OFED distro (3.4.1) on CentOS 7.2. The storage I expose is ZFS on Linux (some SSD, some magnetic).
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
I'm also think to migration Solaris SRP Target to Linux LIO Target.But I have a question about stability of ZFS on Linux.What do you think about it? Best Regards.Jaehoon Choi
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
ZFS on Linux seems to be very stable for me.Bear in mind that with LIO you will be able to use SRP only with CentOS inbox drivers. If you choose to install Mellanox OFED, you will have access only to...
View Article