Re: ESXi 5.5 & IB Dual Port Card card showing just a sinlge vmnic

Hi Guys

~ # esxcli network nic list

Name    PCI Device     Driver   Link  Speed  Duplex  MAC Address         MTU  Description

------  -------------  -------  ----  -----  ------  -----------------  ----  ------------------------------------------------------------------------------

vmnic0  0000:001:00.0  bnx2     Up     1000  Full    84:2b:2b:07:b7:d4  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic1  0000:001:00.1  bnx2     Up     1000  Full    84:2b:2b:07:b7:d6  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic2  0000:002:00.0  bnx2     Up     1000  Full    84:2b:2b:07:b7:d8  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic3  0000:002:00.1  bnx2     Up     1000  Full    84:2b:2b:07:b7:da  1500  Broadcom Corporation Broadcom NetXtreme II BCM5709 1000Base-T

vmnic4  0000:006:00.0  mlx4_en  Up    10000  Full    00:00:00:00:00:01  1500  Mellanox Technologies MT26418 [ConnectX VPI - 10GigE / IB DDR, PCIe 2.0 5GT/s]

~ # esxcli system module parameters set -m mlx4_core -p port_type_array=2,2

Unable to set module parameters the following params are invalid: port_type_array

~ # esxcli system module parameters list  -m mlx4_core

Name                    Type  Value  Description

----------------------  ----  -----  -----------------------------------------------------------------------------------------------------------------------------------------------------------------

debug_level             int          Enable debug tracing if > 0

enable_64b_cqe_eqe      bool         Enable 64 byte CQEs/EQEs when the the FW supports this if non-zero (default: 1)

enable_qos              bool         Enable Quality of Service support in the HCA (default: off)

enable_vxlan_offloads   int          Enable VXLAN offloads when supported by NIC (default: 1)

heap_initial            int          Initial heap size allocated for the driver.

heap_max                int          Maximum attainable heap size for the driver.

log_mtts_per_seg        int          Log2 number of MTT entries per segment (1-7)

log_num_mgm_entry_size  int          log mgm size, that defines the num of qp per mcg, for example: 10 gives 248.range: 9<= log_num_mgm_entry_size <= 12. Not in use with device managed flow steering

max_vfs                 int          enable #max_vfs functions if max_vfs > 0

msi_x                   int          attempt to use MSI-X if nonzero

mtu_4k                  int           configure 4k mtu (mtu_4k > 0)

skb_mpool_initial       int          Driver's minimum private socket buffer memory pool size.

skb_mpool_max           int          Maximum attainable private socket buffer memory pool size for the driver.

sriov_allow_uplink      bool         Enable PF uplink while working in SRIOV mode. (default: true)

~ # esxcli system module parameters list  -m mlx4_en

Name                    Type  Value  Description

----------------------  ----  -----  -------------------------------------------------------------------------

heap_initial            int          Initial heap size allocated for the driver.

heap_max                int          Maximum attainable heap size for the driver.

inline_thold            int          threshold for using inline data

netq                    uint         Enable netqueue or disabled (0), default: 1

netq_num_rings_per_rss  uint         Number of rings per RSS netq

    valid values: [0, 2, 4]

    default: 0

pfcrx                   uint         Priority based Flow Control policy on RX[7:0]. Per priority bit mask

pfctx                   uint         Priority based Flow Control policy on TX[7:0]. Per priority bit mask

skb_mpool_initial       int          Driver's minimum private socket buffer memory pool size.

skb_mpool_max           int          Maximum attainable private socket buffer memory pool size for the driver.

udp_rss                 uint         Enable RSS for incomming UDP traffic or disabled (0)

use_rx_frags            uint         Enable RX frags or disabled (0), default: 0

I've just installed the MFT & MST VIB package:

~ # mlxfwmanager

Querying Mellanox devices firmware ...

Device #1:

----------

  Device Type:      ConnectX

  Part Number:      483514-B21

  Description:      HP-EAST EAGLE IB DDR G2 R5 KIT

  PSID:             HP_09D0000008

  PCI Device Name:  /dev/mt26418_pci_cr0

  Port1 MAC:        000000000000 <-- At least the missing port is showing up here.

  Port2 MAC:        000000000001

  Versions:         Current        Available

     FW             2.6.0000       N/A

  Status:           No matching image found

I've looked up the HP part number:

HP IB 4X DDR Conn-X PCI-e G2 Dual-port HCA

HP Support document - HP Support Center

/tmp # flint -d /dev/mt26418_pci_cr0 -i fw-25408-2_9_1000-MHGH29-XTC_A2-A5.bin burn

    Current FW version on flash:  2.6.0

    New FW version:               2.9.1000

-E- PSID mismatch. The PSID on flash (HP_09D0000008) differs from the PSID in the given image (MT_0A50120005).

HP OEM - Mellanox Technologies

It seems that there is now newer image for HP branded cards.

I couldn't find any parameter to force it and I'm also not sure if it's a good idea.

However I'm considering to get another

MT25418

MHGH28-XTC

card which is working fine in the other host.

Thanks

Patrick