Hi.
I've been trying to find numbers for the number of RDMA reads/writes that can be supported by a Connect X-3 card. In my experiments, I have a server connected to several clients that perform RDMA reads (or writes) from the server. I'm interested in knowing the upper limit for the number of operations that the server can support.
I couldn't find spec sheet numbers for performance other than the basic 40Gbps bandwidth. The best I've got is that Connect X-3 can support about 35M operations per second. While that is pretty useful, I wanted to confirm if this number is unidirectional or bidirectional? That is, ignoring PCIe issues, can the server perform 35M reads/writes from the clients while the clients are issuing 35M reads/writes to the server? Any more details about this would be very helpful.
Actually, I had asked a similar question on linux-rdma: Mellanox RDMA performance — Linux RDMA and InfiniBand development. While the forum is great for software related questions, I don't get many performance related answers . I would be very thankful if a Mellanox engineer could answer my question.
Anuj Kalia,
Carnegie Mellon University