SOLVED Jails keep dropping connection

Joined
Jul 2, 2019
Messages
648
Hi Folks - I thought I had the jail issue solved but the problem now is that after a few minutes the jail loses connection. This is with a single VNET and IP and two VNETs and IPs. When the jail is first started, I can ping, drill an IP, etc. but after a minute or so network connectivity is lost.

Suggestions?
 
D

dlavigne

Guest
FreeNAS version?

What is the full output of ifconfig within code tags?
 
Joined
Jul 2, 2019
Messages
648
FreeNAS version: FreeNAS-11.2-U5 (Build Date: Jun 24, 2019 18:41)

I will post the output once I get home. I tried a fresh install and the results were the same. The managed switch being used is a Ubiquiti US-24 with VLANs; FreeNAS ports are VLAN members not tagged interfaces and VLANs are not used on FreeNAS. If it is relevant, my ESXi server does not have any issues with the same switch. ESXi is an HP DL360g8. FreeNAS is running on:
  • Supermicro X9DR3-LN4F+ motherboard
  • 2 x Intel Xeon E5-2630 V1 Hex (6) Core 2.3GHzRAM
  • 32GB DDR RAM
  • LSI 9210-i8 HBA
  • 4 x Intel 1 Gbit/s onboard NICs
  • 2 x Kingston 120GB A400 SSDs (boot, mirrored)
  • (to be, still under testing) TANK_0 3 x 2 TB WD Red RAIDZ, TANK_1 5 x 3 TB WD Red RAIDZ (this is only my home lab system and I back up to another NAS)
*** Edit to include ESXi hardware and FreeNAS hardware
 
Last edited:
Joined
Jul 2, 2019
Messages
648
Hi @dlavigne - My ifconfig is below. I have not assigned igb1 yet.

Code:
igb0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
    ether 00:25:90:2f:87:c4
    hwaddr 00:25:90:2f:87:c4
    inet 192.168.20.170 netmask 0xffffff00 broadcast 192.168.20.255
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
igb1: flags=8c02<BROADCAST,OACTIVE,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
    ether 00:25:90:2f:87:c5
    hwaddr 00:25:90:2f:87:c5
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect
    status: no carrier
igb2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
    ether 00:25:90:2f:87:c6
    hwaddr 00:25:90:2f:87:c6
    inet 192.168.25.253 netmask 0xffffff00 broadcast 192.168.25.255
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
igb3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
    options=6403bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
    ether 00:25:90:2f:87:c7
    hwaddr 00:25:90:2f:87:c7
    inet 192.168.30.253 netmask 0xffffff00 broadcast 192.168.30.255
    nd6 options=9<PERFORMNUD,IFDISABLED>
    media: Ethernet autoselect (1000baseT <full-duplex>)
    status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
    options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
    inet6 ::1 prefixlen 128
    inet6 fe80::1%lo0 prefixlen 64 scopeid 0x5
    inet 127.0.0.1 netmask 0xff000000
    nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
    groups: lo


 
Last edited:
Joined
Jul 2, 2019
Messages
648
Some additional "symptoms":
  1. The web interface is bound to 192.168.20.170 - the web interface times out and/or is non-responsive until manually refreshed
  2. When performing a function (e.g., like trying to create a jail), the process starts but seems to hang. A manual page refresh shows the function has not completed
    • Error provided is
    • Code:
      Error: Fetching remote release choices failed.
      None: Max retries exceeded with url: /security/unsupported.html (Caused by None)
  3. ssh connections are dropped
    • Error is packet_write_wait: Connection to 192.168.20.170 port 22: Broken pipe
  4. There are no errors showing up with the dmesg command
  5. Ping from a remote host does not show the primary interface (192.168.20.170) packet loss...
 
Last edited:
Joined
Jul 2, 2019
Messages
648
Another item: If I delete the two other interfaces (igb2, igb3) and create the jail using igb0 (e.g., vnet0:bridge0) I have no issues at all... :(
 
Joined
Jul 2, 2019
Messages
648
I think that I have this figured out.

Somewhere along the line I manually added IPs to igb2 and igb3 for the .25.0/24 and .30.0/24 networks respectively. I deleted these assignments leaving the interfaces up but without addresses.

I then re-added the system tunables to rc.conf:
Code:
cloned_interfaces="bridge25 bridge30"
ifconfig_bridge25="addm igb2 up"
ifconfig_bridge30="addm igb3 up"
ifconfig_igb2="up"
ifconfig_igb3="up"


I also downed all my servers and network gear (other NASes, ESXi server, pfSense and managed switch) including the FreeNAS box to make sure everything was cleared out (e.g., arp tables, etc.).

I decided to go with two MiniDLNA jails, one for each of my user subnets (.25.0/24 and .30.0/24) each mounting the same media pools. I added my jails without any issues (so far...) using vnet0:bridge25 (for .25.0/24) physically assigned to igb2 and vnet0:bridge30 (for .30.0/24) physically assigned to igb3.

Let's see how this works out...

...Code edit, cut-and-paste missed the "up" after igb3. Hold it... that was a user error :)
 
Last edited:
Joined
Jul 2, 2019
Messages
648
Monday Update - everything seems stable... Stress testing continues :)
 
Joined
Jul 2, 2019
Messages
648
Wednesday Update - On Tuesday I destroyed the jails and rebuilt them using the same method. Everything is stable!

Closing this issue.
 
Top