Slow transfer speeds to FreeNAS

[KevDog]

Hi - I've heard others post with the same question over the span of many years, but I didn't quite find a solution. I'm getting really slow transfer speeds to my FreeNAS
Testing setup

Macbook Pro --->>>wireless-->>Unifi AP-->>unifi switch--->>unmanaged switch (Gigabit)--->>FreeNAS 11.2 U6
.............................................................................. |
...............................................................................|
..............................................................xcp-ng hypervisor<--- pfsense router VM
.......................................................................................... <--- ubuntu VM
...........................................................................................<---- arch VM

Hopefully that makes sense
ipef2 from MBP to FreeNAS

Code:

iperf -c 10.0.1.197 -i 2                                 ✔  175  06:38:00
------------------------------------------------------------
Client connecting to 10.0.1.197, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 10.0.1.107 port 40530 connected with 10.0.1.197 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 2.0 sec  1.25 MBytes  5.24 Mbits/sec
[  3]  2.0- 4.0 sec   434 KBytes  1.78 Mbits/sec
[  3]  4.0- 6.0 sec  0.00 Bytes  0.00 bits/sec
[  3]  6.0- 8.0 sec  1.25 MBytes  5.24 Mbits/sec
[  3]  8.0-10.0 sec  1.12 MBytes  4.72 Mbits/sec
[  3]  0.0-10.5 sec  4.05 MBytes  3.24 Mbits/sec

iperf from MBP to arch VM

Code:

iperf -c 10.0.1.107 -p 5001 -i 2          ✔  601  06:29:59
------------------------------------------------------------
Client connecting to 10.0.1.107, TCP port 5001
TCP window size:  129 KByte (default)
------------------------------------------------------------
[  4] local 10.0.1.178 port 63627 connected with 10.0.1.107 port 5001
[ ID] Interval       Transfer     Bandwidth
[  4]  0.0- 2.0 sec  31.9 MBytes   134 Mbits/sec
[  4]  2.0- 4.0 sec  32.9 MBytes   138 Mbits/sec
[  4]  4.0- 6.0 sec  30.4 MBytes   127 Mbits/sec
[  4]  6.0- 8.0 sec  30.2 MBytes   127 Mbits/sec
[  4]  8.0-10.0 sec  29.0 MBytes   122 Mbits/sec
[  4]  0.0-10.0 sec   154 MBytes   129 Mbits/sec

iperf archVM to FreeNAS

Code:

iperf -c 10.0.1.197 -i 2                                 ✔  178  06:47:30
------------------------------------------------------------
Client connecting to 10.0.1.197, TCP port 5001
TCP window size:  136 KByte (default)
------------------------------------------------------------
[  3] local 10.0.1.107 port 40534 connected with 10.0.1.197 port 5001
[ ID] Interval       Transfer     Bandwidth
[  3]  0.0- 2.0 sec  5.00 MBytes  21.0 Mbits/sec
[  3]  2.0- 4.0 sec  5.88 MBytes  24.6 Mbits/sec
[  3]  4.0- 6.0 sec  8.00 MBytes  33.6 Mbits/sec
[  3]  6.0- 8.0 sec  5.38 MBytes  22.5 Mbits/sec
[  3]  8.0-10.0 sec  4.62 MBytes  19.4 Mbits/sec
[  3]  0.0-10.1 sec  28.9 MBytes  23.9 Mbits/sec

Cat5e cabling for wired connection

Kernel parameters for freenas:

iohyve_enable YES rc
iohyve_flags kmod=1 net=igb0 rc
kern.ipc.maxsockbuf 4194304 sysctl
kern.ipc.nmbclusters 4073002 sysctl
net.inet.tcp.delayed 0 sysctl
net-inet.tcp.mssdfit 1448 sysctl
net.inet.tcp.reass.maxqueuelen 4096 sysctl
net.inet.tcp.recvbuf_inc 524288 sysctl
net.inet.tcp.recvbuf_max 16777216 sysctl
net.inet.tcp.recvspace 262144 sysctl
net.inet.tcp.sendbuf_inc 16384
net.inet.tcp.sendbuf_max 16777216
net.inet.tcp.sendspace 262144
....
vfs tunables after this

 

[JohnDigital]

Seems like your wireless is functioning about as advertised. Id expect at least those speeds to FN as well ( 0.0-10.0 sec 154 MBytes 129 Mbits/sec). What happens when you run the same tests with the MBP connected (wired) to the same switch that FN is connected? Same tests, results? I would think your VMs should hit FN at around 850-1000mbs. The cable that feeds from UniFi to GB FN Switch is this a long run say over 100ft? Is it run right next to power at any point? I had an ethernet run out of an attic once that ran right next to the AC's 220 line that caused issues, something to consider. If this a dual NIC machine is there any difference if use em1 instead? Finally, is this a new build and issue or just started happening to a machine that previously worked as expected?

I run a verry similar rig and I have never tweaked any kernel params dealing with network and my iperf test:

TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[ 3] local 10.0.0.101 port 35144 connected with 10.0.0.171 port 5001
[ ID] Interval Transfer Bandwidth
[ 3] 0.0-10.0 sec 1.09 GBytes 940 Mbits/sec

 

[KevDog]

Hey thanks for pointing me in the right direction. The network cabling coming from the wall was channeled through an UPS cyberpower 1500AVRLCD.
Immediately when not channeling the network cable through the UPS the network speed dramatically improved.
Crazy. I went searching on the internet after this problem, and supposedly I'm not the only one https://forums.tomshardware.com/threads/cyberpower-1500va-ups-causing-slow-internet.2649352/
I'm not saying CP is junk, I'm just saying there network filtering needs to go away

 

[JohnDigital]

You got it my dude!