ConnectX-4 LX: NFSoRDMA failures in MOFED-3.3

Hi,

CentOS-7.2: While trying NFS over RDMA in the new MOFED-3.3 run into the following kernel messages and NFS client failure (I think NFS works one way for client able to read but not write ;)

[ 1100.982756] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6267): Failed to prepare FAST_REG_MR WQE

[ 1100.982761] svcrdma: Error -12 posting RDMA_READ

[ 1100.993392] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6268): Failed to prepare FAST_REG_MR WQE

[ 1100.993396] svcrdma: Error -12 posting RDMA_READ

[ 1106.022300] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6267): Failed to prepare FAST_REG_MR WQE

[ 1106.022306] svcrdma: Error -12 posting RDMA_READ

[ 1116.038002] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6268): Failed to prepare FAST_REG_MR WQE

[ 1116.038018] svcrdma: Error -12 posting RDMA_READ

[ 1136.070196] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6267): Failed to prepare FAST_REG_MR WQE

[ 1136.070202] svcrdma: Error -12 posting RDMA_READ

[ 1166.085986] mlx5_warn:mlx5_0:mlx5_ib_post_send:4163:(pid 6268): Failed to prepare FAST_REG_MR WQE

[ 1166.085991] svcrdma: Error -12 posting RDMA_READ

Same setup works fine with ConnectX-3. Also, I think, I observed ConnectX-4 working OK earlier with either MOFED-3.2 or kernel.org (~4.6) versions of the drivers.

Any suggestions on it?

Regards,

    Philip