The first question I ask is where is your Subnet Manager running. Even back to back connections need a subnet manager. If you are running Linux on both hosts - go to one host and run
$/etc/init.d/opensmd start (As root obviously)
If that doesn't bring up your link the next thing to look at is OFED drivers and things like that.