SOLVED FreeNAS-11.2-U8 / No internet access from freenas and from jail

Leng

Cadet
Joined
Dec 29, 2018
Messages
5
I've been struggling with resolving this on my own by searching old threads and Reddit posts on the topic but now I'm just completely stuck!

I have FreeNAS 11.2-U8 installed on this set up: https://au.pcpartpicker.com/list/x4gbjc
We mainly use it for media storage with Plex (manual iocage installation) and as an SMB file server.

Everything was working fine up until our router died. Our old router used 10.1.1.x addresses and the new router uses 192.168.1.x addresses. No problem, I thought, I just need to reconfigure all of the IP addresses, etc and we'll be back in business.

I must have done something wrong though, because both the SMB file share and the Plex server cannot be accessed.

The router is an Archer VR1600v, with a default gateway of 192.168.1.1. DHCP is enabled with an address pool of 192.168.1.100 through 192.168.1.199. The FreeNAS server is the only wired connection, with the IP addresses for FreeNAS and Plex both being reserved: 192.168.1.199 (FreeNAS) and 192.168.1.111 (Plex).

In the FreeNAS Global Network Configuration, the IPv4 default gateway is set to 192.168.1.1 and I have one interface: em0 which has DHCP enabled.

The plex jail properties:
Code:
root@freenas:~ # iocage get all plex
CONFIG_VERSION:14.1
allow_chflags:0
allow_mlock:0
allow_mount:0
allow_mount_devfs:0
allow_mount_nullfs:0
allow_mount_procfs:0
allow_mount_tmpfs:0
allow_mount_zfs:0
allow_quotas:0
allow_raw_sockets:1
allow_set_hostname:1
allow_socket_af:0
allow_sysvipc:0
allow_tun:0
available:readonly
basejail:no
boot:on
bpf:yes
children_max:0
cloned_release:11.2-RELEASE-p7
comment:none
compression:lz4
compressratio:readonly
coredumpsize:off
count:1
cpuset:off
cputime:off
datasize:off
dedup:off
defaultrouter:192.168.1.1
defaultrouter6:none
depends:none
devfs_ruleset:4
dhcp:on
enforce_statfs:2
exec_clean:1
exec_fib:0
exec_jail_user:root
exec_poststart:/usr/bin/true
exec_poststop:/usr/bin/true
exec_prestart:/usr/bin/true
exec_prestop:/usr/bin/true
exec_start:/bin/sh /etc/rc
exec_stop:/bin/sh /etc/rc.shutdown
exec_system_jail_user:0
exec_system_user:root
exec_timeout:60
host_domainname:none
host_hostname:plex
host_hostuuid:plex
host_time:yes
hostid:0e638849-509f-11e6-9ad3-d017c293bb4a
hostid_strict_check:off
interfaces:vnet0:bridge0
ip4:new
ip4_addr:192.168.1.111/24
ip4_saddrsel:1
ip6:new
ip6_addr:none
ip6_saddrsel:1
jail_zfs:off
jail_zfs_dataset:iocage/jails/plex/data
jail_zfs_mountpoint:none
last_started:2022-02-21 01:58:29
login_flags:-f root
mac_prefix:02ff60
maxproc:off
memorylocked:off
memoryuse:off
mount_devfs:1
mount_fdescfs:1
mount_linprocfs:0
mount_procfs:0
mountpoint:readonly
msgqqueued:off
msgqsize:off
nmsgq:off
notes:none
nsemop:off
nshm:off
nthr:off
openfiles:off
origin:readonly
owner:root
pcpu:off
priority:99
pseudoterminals:off
quota:none
release:11.2-RELEASE-p7
reservation:none
resolver:/etc/resolv.conf
rlimits:off
securelevel:2
shmsize:off
stacksize:off
state:up
stop_timeout:30
swapuse:off
sync_state:none
sync_target:none
sync_tgt_zpool:none
sysvmsg:new
sysvsem:new
sysvshm:new
template:no
type:jail
used:readonly
vmemoryuse:off
vnet:on
vnet0_mac:02ff6014fa09 02ff6014fa0a
vnet1_mac:none
vnet2_mac:none
vnet3_mac:none
vnet_default_interface:auto
vnet_interfaces:none
wallclock:off


ifconfig from the FreeNAS shell:
Code:
root@freenas:~ # ifconfig
em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=98<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM>
        ether d0:17:c2:93:bb:4a
        hwaddr d0:17:c2:93:bb:4a
        inet 192.168.1.199 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x2
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        ether 02:6f:81:df:bc:00
        nd6 options=1<PERFORMNUD>
        groups: bridge
        id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
        maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
        root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
        member: vnet0:2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 5 priority 128 path cost 2000
        member: epair0a flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 4 priority 128 path cost 2000
        member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
                ifmaxaddr 0 port 1 priority 128 path cost 20000
epair0a: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8<VLAN_MTU>
        ether 02:e2:d0:00:04:0a
        hwaddr 02:e2:d0:00:04:0a
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair
vnet0:2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
        description: associated with jail: plex as nic: epair0b
        options=8<VLAN_MTU>
        ether 02:ff:60:14:fa:09
        hwaddr 02:e2:d0:00:05:0a
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair


netstat -rn from the FreeNAS shell:
Code:
root@freenas:~ # netstat -rn
Routing tables

Internet:
Destination        Gateway            Flags     Netif Expire
default            192.168.1.1        UGS         em0
127.0.0.1          link#2             UH          lo0
192.168.1.0/24     link#1             U           em0
192.168.1.199      link#1             UHS         lo0

Internet6:
Destination                       Gateway                       Flags     NetifExpire
::/96                             ::1                           UGRS        lo0
::1                               link#2                        UH          lo0
::ffff:0.0.0.0/96                 ::1                           UGRS        lo0
fe80::/10                         ::1                           UGRS        lo0
fe80::%lo0/64                     link#2                        U           lo0
fe80::1%lo0                       link#2                        UHS         lo0
ff02::/16                         ::1                           UGRS        lo0


ping from the FreeNAS shell:
Code:
root@freenas:~ # ping 192.168.1.1
PING 192.168.1.1 (192.168.1.1): 56 data bytes
64 bytes from 192.168.1.1: icmp_seq=0 ttl=64 time=1.082 ms
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=0.504 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=0.439 ms
64 bytes from 192.168.1.1: icmp_seq=3 ttl=64 time=0.718 ms
^C
--- 192.168.1.1 ping statistics ---
4 packets transmitted, 4 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.439/0.686/1.082/0.251 ms
root@freenas:~ # ping 192.168.1.111
PING 192.168.1.111 (192.168.1.111): 56 data bytes
64 bytes from 192.168.1.111: icmp_seq=0 ttl=64 time=0.054 ms
64 bytes from 192.168.1.111: icmp_seq=1 ttl=64 time=0.077 ms
64 bytes from 192.168.1.111: icmp_seq=2 ttl=64 time=0.074 ms
64 bytes from 192.168.1.111: icmp_seq=3 ttl=64 time=0.092 ms
^C
--- 192.168.1.111 ping statistics ---
4 packets transmitted, 4 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.054/0.074/0.092/0.014 ms
root@freenas:~ # ping 8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
^C
--- 8.8.8.8 ping statistics ---
5 packets transmitted, 0 packets received, 100.0% packet loss


ifconfig from inside the plex jail:
Code:
root@plex:~ # ifconfig
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
        inet6 ::1 prefixlen 128
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x1
        inet 127.0.0.1 netmask 0xff000000
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
        groups: lo
epair0b: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8<VLAN_MTU>
        ether 02:ff:60:14:fa:0a
        hwaddr 02:e2:d0:00:06:0b
        inet 192.168.1.111 netmask 0xffffff00 broadcast 192.168.1.255
        nd6 options=1<PERFORMNUD>
        media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
        status: active
        groups: epair


netstat -rn from inside the plex jail:
Code:
root@plex:~ # netstat -rn
Routing tables

Internet:
Destination        Gateway            Flags     Netif Expire
default            192.168.1.1        UGS     epair0b
127.0.0.1          link#1             UH          lo0
192.168.1.0/24     link#2             U       epair0b
192.168.1.111      link#2             UHS         lo0

Internet6:
Destination                       Gateway                       Flags     NetifExpire
::/96                             ::1                           UGRS        lo0
::1                               link#1                        UH          lo0
::ffff:0.0.0.0/96                 ::1                           UGRS        lo0
fe80::/10                         ::1                           UGRS        lo0
fe80::%lo0/64                     link#1                        U           lo0
fe80::1%lo0                       link#1                        UHS         lo0
ff02::/16                         ::1                           UGRS        lo0


ping from inside the plex jail:
Code:
root@plex:~ # ping 192.168.1.1
PING 192.168.1.1 (192.168.1.1): 56 data bytes
64 bytes from 192.168.1.1: icmp_seq=0 ttl=64 time=0.697 ms
64 bytes from 192.168.1.1: icmp_seq=1 ttl=64 time=0.575 ms
64 bytes from 192.168.1.1: icmp_seq=2 ttl=64 time=0.658 ms
64 bytes from 192.168.1.1: icmp_seq=3 ttl=64 time=0.567 ms
^C
--- 192.168.1.1 ping statistics ---
4 packets transmitted, 4 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.567/0.624/0.697/0.055 ms
root@plex:~ # ping 192.168.1.199
PING 192.168.1.199 (192.168.1.199): 56 data bytes
64 bytes from 192.168.1.199: icmp_seq=0 ttl=64 time=0.044 ms
64 bytes from 192.168.1.199: icmp_seq=1 ttl=64 time=0.062 ms
64 bytes from 192.168.1.199: icmp_seq=2 ttl=64 time=0.088 ms
64 bytes from 192.168.1.199: icmp_seq=3 ttl=64 time=0.074 ms
^C
--- 192.168.1.199 ping statistics ---
4 packets transmitted, 4 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.044/0.067/0.088/0.016 ms
root@plex:~ # ping 8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes
^C
--- 8.8.8.8 ping statistics ---
3 packets transmitted, 0 packets received, 100.0% packet loss


The contents of resolv.conf from the FreeNAS shell:
Code:
root@freenas:~ # cat /etc/resolv.conf
# Generated by resolvconf
search local
nameserver 192.168.1.1
nameserver 8.8.8.8


The contents of resolv.conf from inside the plex jail:
Code:
root@plex:~ # cat /etc/resolv.conf
# Generated by resolvconf
search local
nameserver 192.168.1.1
nameserver 8.8.8.8


Long story short: I can ping the default gateway and the plex jail from the freenas server; and I can also ping the default gateway and the freenas server from within the plex jail. But any attempts to ping an address outside fails.

Any help would be greatly appreciated, as I've spent weeks trying to solve this myself and am failing to get anywhere!
 

Leng

Cadet
Joined
Dec 29, 2018
Messages
5
I must have done something wrong though, because both the SMB file share and the Plex server cannot be accessed.
A quick update on this note.

I thought perhaps it was a function of me using such an old version of FreeNAS so this morning I did a manual upgrade to 11.3-U3. The issues still persisted.

I figured out the fix for SMB file share issue though not the root cause—all it took to get it working was to stop and start the SMB service again. *facepalm* I wish I had thought of trying that earlier because it would have saved me a lot of headaches.

Regarding the lack of internet access from the freenas server and within the plex jail:

1. Freenas (192.168.1.199) and the plex jail (192.168.1.111) and the router (192.168.1.1) can all happily talk to each other if the network interface is set to use DHCP (IP addresses are reserved using MAC addresses in the router's configuration)

2. If I try to set a static IP, the plex jail goes down completely and trying to ping it results in a "Host is down" message.

Not sure what to try next at the moment. If I look at "Network Summary" in the GUI, I have the following:

Default gateway
192.168.1.1

Nameservers
192.168.1.1
8.8.8.8
1.1.1.1
192.168.1.1
0.0.0.0

1.1.1.1 was a new nameserver I tried adding this morning to see if it would make any difference (it did not). I have no idea why 192.168.1.1 is being listed twice. If I check in the Global Configuration on nameservers, I only see the first three lines: 192.168.1.1, 8.8.8.8 and 1.1.1.1.
 

Leng

Cadet
Joined
Dec 29, 2018
Messages
5
I do not know if I am being incredibly dumb...maybe I am? So more googling around suggested that perhaps the problem is the fact that I have DHCP enabled on my router, which would explain why I have extra nameservers getting passed through.

OK, so I went into my router's DHCP server configurations and double checked:
IP address is 192.168.1.1
DHCP server is enabled
Address pool is 192.168.1.100 - 192.168.1.199
Default Gateway is 192.168.1.1

I've also now set Primary DNS (marked as optional) to 8.8.8.8 and Secondary DNS to 8.8.4.4. After a reboot of the freenas server, the weird extra nameservers disappeared.

I then changed EVERYTHING via the FreeNAS web GUI interface (em0 and my plex jail) to use static IPs only.

Unfortunately, I still can't ping 8.8.8.8 from the freenas shell or the plex jail shell. :frown:
 

Leng

Cadet
Joined
Dec 29, 2018
Messages
5
I had a new thought, which was maybe the issue is caused by FreeNAS and the Plex jail having IP addresses that are within the router's DHCP address pool. So I tried following the steps in this thread to see whether that would help. No luck. And switching everything back over to static means the Plex jail can't ping anything again. I can still ping the router from the FreeNAS shell but can't ping the Plex jail itself.

Does anyone have any ideas whatsoever?
 

Leng

Cadet
Joined
Dec 29, 2018
Messages
5
Reporting back with the solution to my problem, feeling like the dumbest person in the world:

There was nothing wrong with my FreeNAS network configuration.

I had set up security controls on my router to require whitelisted MAC addresses.

I did not add the MAC addresses for FreeNAS or the Plex jail.

Once those MAC addresses were whitelisted, both were able to access the internet just fine.

Excuse me while I go facepalm and headdesk.
 
Top