Re: Re: How should I use the ipoibd daemon from Mellanox Openstack Havana repo with SR-IOV?

Hi Itzik,

thanks for reply. I have already tried to start the ipoibd coming with Mellanox OFED 2.1 but it does not work. It does not creates a correct configuration. It also begin an infinite loop creating many ib0.8001 clones and enslaving them into eth2. This loop ends when it tries to create the 256-th clone.

[root@n02 ~]# ip a | grep ib0.8001 | wc -l

256

[root@n02 ~]# head -n 4 /sys/class/net/eth2/eth/{slaves,vifs}

==> /sys/class/net/eth2/eth/slaves <==

ib0.1

ib0.8001.1

ib0.8001.2

ib0.8001.3

==> /sys/class/net/eth2/eth/vifs <==

SLAVE=ib0.1      MAC=00:02:c9:50:60:8d VLAN=N/A

SLAVE=ib0.8001.1 MAC=00:02:c9:50:60:8d VLAN=1

SLAVE=ib0.8001.2 MAC=N/A              VLAN=N/A

SLAVE=ib0.8001.3 MAC=N/A              VLAN=N/A

[root@n02 ~]# tail -n 1 /sys/class/net/eth2/eth/{slaves,vifs}

==> /sys/class/net/eth2/eth/slaves <==

ib0.8001.255

==> /sys/class/net/eth2/eth/vifs <==

SLAVE=ib0.8001.83 MAC=N/A

As you can see above the vifs table is corrupted at line 83.

Moreover the ib0 pkey "tagged" clone ib0.8001.1 (the only one configured) has been enslaved with the mac address of eth2 instead, for example, of the mac address of the Neutron DHCP that is fa:16:3e:04:4c:f7

[root@n02 ~]# ip netns exec qdhcp-570dc494-a876-401c-a80d-6696e2140a5f ip a | grep -A2 'ns-'

15: ns-bf3135d2-4b: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000

    link/ether fa:16:3e:04:4c:f7 brd ff:ff:ff:ff:ff:ff

    inet 10.0.0.3/24 brd 10.0.0.255 scope global ns-bf3135d2-4b

    inet6 fe80::f816:3eff:fe04:4cf7/64 scope link

       valid_lft forever preferred_lft forever

Please have a look at the attached ipoibd log file /var/log/eipoib_daemon.log.

Thanks

Ale