Issues using X520-DA2 adapter

[Harsesis]

Hi all,

this post is about my backup storage listed in my signature. I just moved my installation from 2 USB thumb sticks to some cheap 240GB SSD's. All I did was saving the config from the original installation, fresh install the latest freenas version on the SSD's and re-uploading the config. After that somehow I managed to cause weired networking issues with my Intel X520-DA2 network adapter.

Somehow I managed to delete the ix1 interface, under Network -> Interfaces, only the ix0 interface is listed now. When I now restart my system I always have to swap my SFP+ module from one port to the other to make the networking working through the remaining ix0 interface (seems like the mapping of ix0 is toggeling between the two phyisical ports).

When running pciconf -lv I get the following output related to the NIC:

Code:

ix0@pci0:2:0:0: class=0x020000 card=0x000c8086 chip=0x10fb8086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
    subclass   = ethernet
none2@pci0:2:0:1:       class=0x020000 card=0x000c8086 chip=0x10fb8086 rev=0x01 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82599ES 10-Gigabit SFI/SFP+ Network Connection'
    class      = network
    subclass   = ethernet

What can I do to re-add the missing network port? Maybe re-adding the interface properly solves the other issue with the "swapping" of the port mapping...

 

[Samuel Tai]

Did you have any tunables set for the NIC? How does the NIC appear in dmesg?

 

[Harsesis]

Hi,

on this system I have no tunables at all. Here my dmesg output:

Code:

root@freenas-backup[~]# dmesg | grep 'ix'
    root@mp20.tn.ixsystems.com:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
acpi0: Power Button (fixed)
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xd020-0xd03f mem 0xf7180000-0xf71fffff,0xf7204000-0xf7207fff irq 17 at device 0.0 on pci2
ix0: Using MSI-X interrupts with 5 vectors
ix0: Ethernet address: 00:1b:21:a1:4c:ec
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xd000-0xd01f mem 0xf7100000-0xf717ffff,0xf7200000-0xf7203fff irq 18 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Unsupported SFP+ module detected!
device_attach: ix1 attach returned 5
ses0: <IBM-ESXS SAS EXP BP 634A> Fixed Enclosure Services SPC-2 SCSI device
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xd000-0xd01f mem 0xf7100000-0xf717ffff,0xf7200000-0xf7203fff irq 18 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Unsupported SFP+ module detected!
device_attach: ix1 attach returned 5
da0: <ATA Hitachi HDS72404 A3B0> Fixed Direct Access SPC-4 SCSI device
da5: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device
da4: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device
da10: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device
da9: <ATA HGST HDS724040AL A580> Fixed Direct Access SPC-4 SCSI device
da8: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device
da7: <ATA HGST HDS724040AL A580> Fixed Direct Access SPC-4 SCSI device
da6: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device
da3: <ATA HGST HDS724040AL A580> Fixed Direct Access SPC-4 SCSI device
da1: <ATA HGST HDS724040AL A580> Fixed Direct Access SPC-4 SCSI device
da2: <ATA HGST HDS724040AL A580> Fixed Direct Access SPC-4 SCSI device
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xd000-0xd01f mem 0xf7100000-0xf717ffff,0xf7200000-0xf7203fff irq 18 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Unsupported SFP+ module detected!
device_attach: ix1 attach returned 5
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xd000-0xd01f mem 0xf7100000-0xf717ffff,0xf7200000-0xf7203fff irq 18 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Unsupported SFP+ module detected!
device_attach: ix1 attach returned 5
ix0: Unsupported SFP+ module type was detected.
ix0: Unsupported SFP+ module type was detected.
ix0: Unsupported SFP+ module type was detected.
ix0: Unsupported SFP+ module type was detected.
ix0: link state changed to UP

 

[Samuel Tai]

dmesg shows Unsupported SFP+ module detected! as an error. What SFP+ are you using?

 

[Harsesis]

I am using SFP+ modules from FS.com. I only have one SFP+ module plugged in, the secondary port is not used at the moment. The SFP+ modules work great in all my other servers and switches (also the primary freenas server). It also works without problems on the backup server after switching the port. Could it still be the reason for the issue?

 

[Samuel Tai]

It's easy enough to check. Try a different SFP+.

 

[Harsesis]

I don't have a spare one available right now, but I will try booting from the old thumb drives to check if I see the same errors there. If that does not help I have to take down one of the other servers to check with its SFP+ module.

Would this "error" cause the nic from not showing up in the UI? On my primary server I also only use one port of mx 2 port card but still both interfaces show up properly.

 

[Samuel Tai]

dmesg shows both NICs are being detected by the OS. As for the GUI, it can be a bit touchy.

 

[MG007]

I have the same issue. I would like to directly attach Freenas to an ESXi host. Here is the dmesg. I have no errors and I can see dual 10gig nic as ix0 and ix1 on the Freenas dashboard. Both disconnected.

Code:

 root@tnbuilds05.tn.ixsystems.net:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
acpi0: Power Button (fixed)
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xb800-0xb81f mem 0xfe980000-0xfe9fffff,0xfe97c000-0xfe97ffff irq 18 at device 0.0 on pci2
ix0: Using MSI-X interrupts with 5 vectors
ix0: Ethernet address: 90:e2:ba:33:b8:ec
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xb400-0xb41f mem 0xfe800000-0xfe87ffff,0xfe978000-0xfe97bfff irq 19 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Ethernet address: 90:e2:ba:33:b8:ed
ix1: PCI Express Bus: Speed 5.0GT/s Width x8
    root@tnbuilds05.tn.ixsystems.net:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
acpi0: Power Button (fixed)
ix0: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xb800-0xb81f mem 0xfe980000-0xfe9fffff,0xfe97c000-0xfe97ffff irq 18 at device 0.0 on pci2
ix0: Using MSI-X interrupts with 5 vectors
ix0: Ethernet address: 90:e2:ba:33:b8:ec
ix0: PCI Express Bus: Speed 5.0GT/s Width x8
ix1: <Intel(R) PRO/10GbE PCI-Express Network Driver, Version - 3.2.12-k> port 0xb400-0xb41f mem 0xfe800000-0xfe87ffff,0xfe978000-0xfe97bfff irq 19 at device 0.1 on pci2
ix1: Using MSI-X interrupts with 5 vectors
ix1: Ethernet address: 90:e2:ba:33:b8:ed
ix1: PCI Express Bus: Speed 5.0GT/s Width x8