Hi,
I've been running FreeNAS 11.x for a while on a SuperMicro box - with dual 10Gig NIC's (Intel PRO/10GbE aka 'ix' Interface).
This has worked reliably since I installed it. I just upgraded from that to TrueNAS Core 12.0 - and it appears to have broken the NIC's. They still work - but a couple of hours after starting the box - they just "stop"
'ifconfig' / 'netstat -b -n -i' et'al - show nothing wrong (interface is up, running etc.) - if I tcpdump the Interface - I can't see traffic, if I try to ping any host on the LAN - I can't, likewise - remote clients if they try to ping the TrueNAS Core box - all I can see on them via tcpdump is the classic "ARP - Who has x tell y" [where 'x' is the TrueNAS Core IP address].
'dmesg' output was also unremarkable (nothing listed - only "promiscuous mode enabled/disabled" caused by me running tcpdump).
I tried 'ifconfig ixX down' and 'up' - didn't fix anything. From the switch point of view - the link is up, at 10Gig and everything is fine (no errors counting up or anything).
Anyone seen similar?
dmesg for the cards initing is:
The box has 4 other onboard 10Gig NIC's - ix4 and ix5 are expansion slot SFP+ (onboards are all twisted pair).
ix5 is in a LAGG pair with ix0, but ix4 is on it's own - and both ix4 and ix5 stopped. ix0 (the other LAGG partner for ix5) is currently disconnected, hence always shows as:
This was actually "boringly reliable" with FreeNAS 11.3 etc. - so don't really know where to start troubleshooting it - other than the update has obviously broken something?
-Tacks
I've been running FreeNAS 11.x for a while on a SuperMicro box - with dual 10Gig NIC's (Intel PRO/10GbE aka 'ix' Interface).
This has worked reliably since I installed it. I just upgraded from that to TrueNAS Core 12.0 - and it appears to have broken the NIC's. They still work - but a couple of hours after starting the box - they just "stop"
'ifconfig' / 'netstat -b -n -i' et'al - show nothing wrong (interface is up, running etc.) - if I tcpdump the Interface - I can't see traffic, if I try to ping any host on the LAN - I can't, likewise - remote clients if they try to ping the TrueNAS Core box - all I can see on them via tcpdump is the classic "ARP - Who has x tell y" [where 'x' is the TrueNAS Core IP address].
'dmesg' output was also unremarkable (nothing listed - only "promiscuous mode enabled/disabled" caused by me running tcpdump).
I tried 'ifconfig ixX down' and 'up' - didn't fix anything. From the switch point of view - the link is up, at 10Gig and everything is fine (no errors counting up or anything).
Anyone seen similar?
dmesg for the cards initing is:
Code:
ix4: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xf020-0xf03f mem 0xfbc80000-0xfbcfffff,0xfbd04000-0xfbd07fff irq 50 at device 0.0 numa-domain 1 on pci10 ix4: Using 2048 TX descriptors and 2048 RX descriptors ix4: Using 8 RX queues 8 TX queues ix4: Using MSI-X interrupts with 9 vectors ix4: allocated for 8 queues ix4: allocated for 8 rx queues ix4: Ethernet address: 00:1b:21:d7:39:94 ix4: PCI Express Bus: Speed 5.0GT/s Width x8 ix4: link state changed to UP ix5: <Intel(R) PRO/10GbE PCI-Express Network Driver> port 0xf000-0xf01f mem 0xfbc00000-0xfbc7ffff,0xfbd00000-0xfbd03fff irq 52 at device 0.1 numa-domain 1 on pci10 ix5: Using 2048 TX descriptors and 2048 RX descriptors ix5: Using 8 RX queues 8 TX queues ix5: Using MSI-X interrupts with 9 vectors ix5: allocated for 8 queues ix5: allocated for 8 rx queues ix5: Ethernet address: 00:1b:21:d7:39:95 ix5: PCI Express Bus: Speed 5.0GT/s Width x8 ix5: link state changed to UP
The box has 4 other onboard 10Gig NIC's - ix4 and ix5 are expansion slot SFP+ (onboards are all twisted pair).
ix5 is in a LAGG pair with ix0, but ix4 is on it's own - and both ix4 and ix5 stopped. ix0 (the other LAGG partner for ix5) is currently disconnected, hence always shows as:
Code:
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500 description: lagg0 options=e53fbb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,WOL_UCAST,WOL_MCAST,WOL_MAGIC,VLAN_HWFILTER,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6> ether 0c:c4:7a:62:e5:84 inet x.x.x.x netmask 0xffffff00 broadcast x.x.x.255 laggproto failover lagghash l2,l3,l4 laggport: ix0 flags=1<MASTER> laggport: ix5 flags=4<ACTIVE> groups: lagg media: Ethernet autoselect status: active nd6 options=9<PERFORMNUD,IFDISABLED>
This was actually "boringly reliable" with FreeNAS 11.3 etc. - so don't really know where to start troubleshooting it - other than the update has obviously broken something?
-Tacks