MPI startup():ofa fabric is not available and fallback fabric is not exist

Hello All,

I hope you are well. We are facing the above issue whenever we submit second simulation job. The first job goes through smoothly but the second job exits with the above error.

Any ideas what can be causing this and how we can fix this ?

We have Mellanox 56 GBps switch with connext x-3 cards on all nodes on a dell R630 14 node setup.

Thanks