So after building a newer Truenas box instead of retiring my old Supermicro X8 based box I stuffed it with now cheap 3TB drives and decided to use as a backup of sorts and only power it up once in a while to sync with the primary nas. I have syncthing installed in a jail on both boxes, each with it's own IP. Both truenas instances updated to latest version of 13.
So when I powered up the old one to let syncthing sync the new files to old truenas I was faced with extremely slow speeds and both boxes using an internet relay for transfer despite them being on the same switch. Fixing syncthing to the lan IP didn't work either. In looking deeper I noticed that the Jail Ips on both systems are dropping pings randomly. Main Truenas IP was rock solid but jail Ips consistently dropped. There were no IP conflicts, each box and jail had its own IP. The big giveaway was when I noticed that the packet drop was only happening while the backup box was powered on. Sadly it took a while for this to register.
With that in mind it was easy to trace the problem to the syncthing template using a fixed MAC for vnet0_mac:
Once I changed mac on one of the jails no more drops. The truenas installs were done independently, nothing was copied over.
I thought it may be useful for someone running two Truenas systems with syncthing on the same network segment.
So when I powered up the old one to let syncthing sync the new files to old truenas I was faced with extremely slow speeds and both boxes using an internet relay for transfer despite them being on the same switch. Fixing syncthing to the lan IP didn't work either. In looking deeper I noticed that the Jail Ips on both systems are dropping pings randomly. Main Truenas IP was rock solid but jail Ips consistently dropped. There were no IP conflicts, each box and jail had its own IP. The big giveaway was when I noticed that the packet drop was only happening while the backup box was powered on. Sadly it took a while for this to register.
With that in mind it was easy to trace the problem to the syncthing template using a fixed MAC for vnet0_mac:
Once I changed mac on one of the jails no more drops. The truenas installs were done independently, nothing was copied over.
I thought it may be useful for someone running two Truenas systems with syncthing on the same network segment.
Code:
root@freenas:~ # iocage get all syncthing CONFIG_VERSION:28 allow_chflags:0 allow_mlock:0 allow_mount:0 allow_mount_devfs:0 allow_mount_fusefs:0 allow_mount_nullfs:0 allow_mount_procfs:0 allow_mount_tmpfs:0 allow_mount_zfs:0 allow_quotas:0 allow_raw_sockets:0 allow_set_hostname:1 allow_socket_af:0 allow_sysvipc:0 allow_tun:0 allow_vmm:0 assign_localhost:0 available:readonly basejail:1 boot:1 bpf:0 children_max:0 comment:none compression:lz4 compressratio:readonly coredumpsize:off count:1 cpuset:off cputime:off datasize:off dedup:off defaultrouter:192.168.2.1 defaultrouter6:auto depends:none devfs_ruleset:4 dhcp:0 enforce_statfs:2 exec_clean:1 exec_created:/usr/bin/true exec_fib:0 exec_jail_user:root exec_poststart:/usr/bin/true exec_poststop:/usr/bin/true exec_prestart:/usr/bin/true exec_prestop:/usr/bin/true exec_start:/bin/sh /etc/rc exec_stop:/bin/sh /etc/rc.shutdown exec_system_jail_user:0 exec_system_user:root exec_timeout:60 host_domainname:none host_hostname:syncthing host_hostuuid:syncthing host_time:1 hostid:49434d53-0200-9098-2500-989025003318 hostid_strict_check:0 interfaces:vnet0:bridge0 ip4:new ip4_addr:vnet0|192.168.2.6/24 ip4_saddrsel:1 ip6:new ip6_addr:none ip6_saddrsel:1 ip_hostname:0 jail_zfs:0 jail_zfs_dataset:iocage/jails/syncthing/data jail_zfs_mountpoint:none last_started:2022-10-26 12:48:58 localhost_ip:none login_flags:-f root mac_prefix:022590 maxproc:off memorylocked:off memoryuse:off min_dyn_devfs_ruleset:1000 mount_devfs:1 mount_fdescfs:1 mount_linprocfs:0 mount_procfs:0 mountpoint:readonly msgqqueued:off msgqsize:off nat:0 nat_backend:ipfw nat_forwards:none nat_interface:none nat_prefix:172.16 nmsgq:off notes:none nsem:off nsemop:off nshm:off nthr:off openfiles:off origin:readonly owner:root pcpu:off plugin_name:syncthing plugin_repository:https://github.com/freenas/iocage-ix-plugins.git priority:99 pseudoterminals:off quota:none readbps:off readiops:off release:13.1-RELEASE-p2 reservation:none resolver:/etc/resolv.conf rlimits:off rtsold:0 securelevel:2 shmsize:off stacksize:off state:up stop_timeout:30 swapuse:off sync_state:none sync_target:none sync_tgt_zpool:none sysvmsg:new sysvsem:new sysvshm:new template:0 type:pluginv2 used:readonly vmemoryuse:off vnet:1 vnet0_mac:0225905b07f8 0225905b07f9 vnet0_mtu:auto vnet1_mac:none vnet1_mtu:auto vnet2_mac:none vnet2_mtu:auto vnet3_mac:none vnet3_mtu:auto vnet_default_interface:auto vnet_default_mtu:1500 vnet_interfaces:none wallclock:off writebps:off writeiops:off
Code:
root@truenas7[~]# iocage get all syncthing CONFIG_VERSION:28 allow_chflags:0 allow_mlock:0 allow_mount:0 allow_mount_devfs:0 allow_mount_fusefs:0 allow_mount_nullfs:0 allow_mount_procfs:0 allow_mount_tmpfs:0 allow_mount_zfs:0 allow_quotas:0 allow_raw_sockets:0 allow_set_hostname:1 allow_socket_af:0 allow_sysvipc:0 allow_tun:0 allow_vmm:0 assign_localhost:0 available:readonly basejail:1 boot:1 bpf:0 children_max:0 comment:none compression:lz4 compressratio:readonly coredumpsize:off count:1 cpuset:off cputime:off datasize:off dedup:off defaultrouter:auto defaultrouter6:auto depends:none devfs_ruleset:4 dhcp:0 enforce_statfs:2 exec_clean:1 exec_created:/usr/bin/true exec_fib:0 exec_jail_user:root exec_poststart:/usr/bin/true exec_poststop:/usr/bin/true exec_prestart:/usr/bin/true exec_prestop:/usr/bin/true exec_start:/bin/sh /etc/rc exec_stop:/bin/sh /etc/rc.shutdown exec_system_jail_user:0 exec_system_user:root exec_timeout:60 host_domainname:none host_hostname:syncthing host_hostuuid:syncthing host_time:1 hostid:00000000-0000-0000-0000-002590476c7c hostid_strict_check:0 interfaces:vnet0:bridge0 ip4:new ip4_addr:vnet0|192.168.2.8/24 ip4_saddrsel:1 ip6:new ip6_addr:none ip6_saddrsel:1 ip_hostname:0 jail_zfs:0 jail_zfs_dataset:iocage/jails/syncthing/data jail_zfs_mountpoint:none last_started:2022-10-25 00:50:59 localhost_ip:none login_flags:-f root mac_prefix:022590 maxproc:off memorylocked:off memoryuse:off min_dyn_devfs_ruleset:1000 mount_devfs:1 mount_fdescfs:1 mount_linprocfs:0 mount_procfs:0 mountpoint:readonly msgqqueued:off msgqsize:off nat:0 nat_backend:ipfw nat_forwards:tcp(80:8384) nat_interface:none nat_prefix:172.16 nmsgq:off notes:none nsem:off nsemop:off nshm:off nthr:off openfiles:off origin:readonly owner:root pcpu:off plugin_name:syncthing plugin_repository:https://github.com/freenas/iocage-ix-plugins.git priority:99 pseudoterminals:off quota:none readbps:off readiops:off release:13.1-RELEASE reservation:none resolver:/etc/resolv.conf rlimits:off rtsold:0 securelevel:2 shmsize:off stacksize:off state:up stop_timeout:30 swapuse:off sync_state:none sync_target:none sync_tgt_zpool:none sysvmsg:new sysvsem:new sysvshm:new template:0 type:pluginv2 used:readonly vmemoryuse:off vnet:1 vnet0_mac:0225905b07f8 0225905b07f9 vnet0_mtu:auto vnet1_mac:none vnet1_mtu:auto vnet2_mac:none vnet2_mtu:auto vnet3_mac:none vnet3_mtu:auto vnet_default_interface:auto vnet_default_mtu:1500 vnet_interfaces:none wallclock:off writebps:off writeiops:off
