We recently acquired a new server to replace an aging FreeNAS box at a satellite location. This machine is a replication target for offsite backup, and the sites are connected at 200Mbps.
We installed FreeNAS (11.3-U4.1) and started the replication. No matter what settings we tried in the replication task, we could never get transfers above 10Mbps. I won't go through everything we tried, but we turned just about every switch and turned every knob. We also tried various speed tests from various machines, and even some straight scp tests that confirmed that transferring at 200Mbps was possible. I finally did a manual replication from the command line, and... 200Mbps! I checked the logs and began manually typing in the zfs send/receive commands, stripping out the various options specified in the tasks generated from the GUI, but now kept getting 10Mbps.
It boiled down to this. In my manual replication from command line, I was piping to ssh. The replication task commands were piping to /usr/local/bin/ssh. I ran `which ssh`, and discovered it uses /usr/bin/ssh. Yup. There are two completely different ssh's.
/usr/local/bin/ssh -V -> 8.0p1 (the slow one)
/usr/bin/ssh -V -> 7.5p1 (the fast one)
Is this on purpose?
We installed FreeNAS (11.3-U4.1) and started the replication. No matter what settings we tried in the replication task, we could never get transfers above 10Mbps. I won't go through everything we tried, but we turned just about every switch and turned every knob. We also tried various speed tests from various machines, and even some straight scp tests that confirmed that transferring at 200Mbps was possible. I finally did a manual replication from the command line, and... 200Mbps! I checked the logs and began manually typing in the zfs send/receive commands, stripping out the various options specified in the tasks generated from the GUI, but now kept getting 10Mbps.
It boiled down to this. In my manual replication from command line, I was piping to ssh. The replication task commands were piping to /usr/local/bin/ssh. I ran `which ssh`, and discovered it uses /usr/bin/ssh. Yup. There are two completely different ssh's.
/usr/local/bin/ssh -V -> 8.0p1 (the slow one)
/usr/bin/ssh -V -> 7.5p1 (the fast one)
Is this on purpose?