Re: RoCEv2 GID disappeared ?
scisoft13:~ % cat /sys/class/infiniband/mlx5_0/ports/1/gids/00000:0000:0000:0000:0000:0000:0000:0000scisoft13:~ % cat /sys/class/infiniband/mlx5_0/ports/1/gids/10000:0000:0000:0000:0000:0000:0000:0000...
View ArticleRe: RoCEv2 GID disappeared ?
Hi Raphael, Thank you for the information, it looks as an unexpected behaviour related to the driver and this specific Operating system.For us to continue and investigate it please send an email to...
View ArticleRe: MLNX+NVIDIA ASYNC GPUDirect - Segmentation fault: invalid permissions for...
Thanks a lot for the reply. It solved the above issue but after running mpirun, i do not see any latency difference with and without GDR My Questions : Why I do not see any latency difference with and...
View ArticleRe: MLNX+NVIDIA ASYNC GPUDirect - Segmentation fault: invalid permissions for...
I'm not sure have you resolved seg 11 problem by my way.As far as I see,I compile the openmpi with my ucx:./configure --prefix=/usr/local/openmpi-3.1.1 --with-wrapper-ldflags=-Wl,-rpath,/lib...
View ArticleWeb interface error on SX6036
I am trying to setup a SX6036 VPI switch, previously used at another institute. I've configured the mgmt interface and can connect to the web UI, however it immediately gives the following error:...
View ArticleRe: MLNX+NVIDIA ASYNC GPUDirect - Segmentation fault: invalid permissions for...
Yes using your way segmentation fault got resolved.I am using "Mellanox ConnectX-5" adapter. OS - CentOS74 Is the below topology looks good to you## nvidia-smi topo -m GPU0 mlx5_0 mlx5_1...
View ArticleRe: MLNX+NVIDIA ASYNC GPUDirect - Segmentation fault: invalid permissions for...
PHB:Connection traversing PCIe as well as a PCIe Host Bridge (typically the CPU) Based on the topo you give, the mlx5_1 and mlx5_0 is connected to gpu0 by a PCIe Host Bridge.It meas that, even gdr,...
View ArticleRe: DPDK with MLX4 VF on Hyper-v VM
Hello Hui, I have tested this internally and found that currently we don’t officially support WinOf driver versions with DPDK (except for WinOf driver for Azure). You should use Azure VMs and contact...
View ArticleInfiniBand amber port led flashing
We recently replaced IB switches (both of int-a,b) to newer model, SX6790 36 port IB switch.After replacing, we noticed that some port LEDs showing abnormal/non-defined behavior; i.e. Port#8 LED of...
View ArticleConnext-x3 roce mode
Hello, can someone confirm what roce mode should I use for my Windows 2016 S2D deployment? I am using Connect-X3 (not Pro). Thanks!
View ArticleRe: Connext-x3 roce mode
Hi Hassan, Please note that for ConnectX-3 or older adapter cards the only supported roce version is : RoCEv1.For your refernce please see the following : Mellanox Adapters - Comparison TableLatest...
View ArticleRe: sr-iov and vxlan used
Hi ,We have a new solution called ASAP2 - Accelerated Switch and Packet Processing.For your reference, please see the following link for additional information:...
View Articlemst start fails with ConnectX-4 on ppc64le
Hi, I'm trying to setup VFs using SRIOV on a ppc64le machine $ lsb_release -aNo LSB modules are available.Distributor ID: UbuntuDescription: Ubuntu 16.04.4 LTSRelease: 16.04Codename:...
View ArticleRe: mst start fails with ConnectX-4 on ppc64le
Hi Sood, Do you have Advance Toolchain Runtime installed on the machine?If yes please not for the following known issue and workaround at page 16...
View ArticleRe: Yocto embedded build of rdma-core
The solution to this problem was to make use of the incorporated recipes in the updated openembedded build. About a month ago, rdma-core was added to the mainlline tree. We had been trying to get...
View Articlerxe driver does not support kernel ABI
Getting a small error when I try to do an rping test. I'm building rxe into kernel 4.16 and rdma-core using yocto on an Arria10 socfpga containing a dual core A53 ARM processor. I get the kernel...
View ArticleRe: rxe driver does not support kernel ABI
After setting up the yocto build to include the various rdma-core modules according to yocto practices, this error went away.
View ArticleRe: rxe driver does not support kernel ABI
Its back. For some reason I keep getting this warning libibverbs: Warning: Driver rxe does not support the kernel ABI of 1 (supports 2 to 2) for device /sys/class/infiniband/rxe0
View Article