dma_map_single not able to receive capsules on ARM with mellanox card
Hi,I am receiving capsule with Mellanox card, the receive event is happening with ib calls. But my dma_map_single function receiving zero data. if I use dma_alloc_coherent instead of dma_map_single I...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
I have the same question as well. The drivers for connectx-4 have never really materialized for vmware and infiniband storage.
View ArticleRe: Windows, TCP/IP - lowest possible latency?
Hello Ed, Mellanox cards can probably get better numbers, especially if adding additional tuning to the server that can improve the numbers even more.You are welcome to review Mellanox performance...
View ArticleConnectX-3 RoCE fails send WRs when running multiple QPs
Hi all, I have spent the last 3 weeks building an event-driven I/O engine for RNICs.I have worked out most of the kinks, but there is an error I cannot understand.For test application, I have a single...
View ArticleRe: VMware ESXi 6.0 virtual ib_ipoib interfaces
Hi david,Can you confirm what type of HCA card(s) installed within the ESXI server?What is the port protocol configured as IB or Ethernet? Thank you,Sophie.
View ArticleConnecting SX1016 MLAG Pair to Cisco VSS
I have a SX1016 pair configured as an MLAG pair that I have connected to my Cisco 6509 VSS. I followed document linked below. We seem to be experiencing some strange behavior when attempting to access...
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
This is one of the reason I have given up on infiniband for our storage, dropping protocol support and dropping adapter support because newer versions appear. Just not worth it anymore.
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Will we have the honour of someone from Mellanox responding to this one? They seem to be monitoring these forums pretty closely, so no response so far looks a bit strange...
View ArticleRe: VMware ESXi 6.0 virtual ib_ipoib interfaces
I have a similar problem: i cant get IP over IB working.MT 27500 ConnectX-3 (PSID MT_1100120019) on ESX 6 (latest Updates 2 days ago). In the BIOS (SuperMicro) I set in the PCIe Configuration Page...
View ArticleRe: Windows, TCP/IP - lowest possible latency?
How low RTT could I expect to see with Mellanox hardware?
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
Mellanox SRP initiator in vSphere OFED 1 8.2.4 shows me a good performance.But it has a issue with ZFS SRP target that cause problem to VM auto start function in ESXi host.SRP is a native RDMA SCSI...
View ArticleQuestion about stacking
We just got two SX1012 swtiches for use with a SCALE cluster.We received a stacking cable with the pair, which I have plugged into port 10 on both switches.When I asked Scale, they said that plugging...
View Article'State: Initializing' but works
Hi all, I am linking 2 identical nodes with 2 IB cables (2 ports are in different subnet). I found the port 2 state is in 'Initializing' (till yesterday, both port status were Active).Subnet manager is...
View ArticleRe: 'State: Initializing' but works
Hi, Do you have a subnet manager running on the 2nd subnet via port 2?
View ArticleRe: Which ESXi driver to use for SRP/iSER over IB (not Eth!)?
This is mostly exactly the current question I am trying to answer for myself.We have a few ESXi hosts currently on v5.5 with dual port VPI adapters.We want to run SRP/iSER on one port back to our SAN...
View ArticleRe: MCX354A-FCBT & Switch Speed Issue
Sorry for the lack of response on this - I have been so busy lately this project has got delayed due to more important commitments.At this stage I think the FDR vs. FDR10 answer is the most likely...
View ArticleRe: Question about stacking
Hi Craig, The SX1012 switches don't support Stacking, it does support MLAG, can you try reviewing the below article (if you haven't reviewed it already). HowTo Configure MLAG on Mellanox Switches Also...
View ArticleRe: Question about stacking
Well i have it configured to talk over the port that the stacking cable is connected into, but if you are saying that it can't use a stacking cable, that is probably my issue. I will further investigate.
View ArticleRe: MCX354A-FCBT & Switch Speed Issue
Hi,MSX6015T-1SFSMSX6015T-1BRS These two models can only do FDR10. Its a hardware limitation.Normally there is a sticker on the switch with a part number and serial number. Try this:If you have a...
View Articlemlnx_tune does not detect the BIOS I/O non-posted prefetch settings?
I have four AIC SB122A-PH 1U all NVMe storage servers. Two of them have Intel E5-2620v3 2.4Ghz CPUs, 8 x 16GiB 1833Mhz DDR4 DIMMs, 2 x DC S3510 SATA SSDs, 8 x DC P3700 NVMe SSDsTwo of them have Intel...
View Article