Matt Reynolds
Dabbler
- Joined
- Sep 27, 2013
- Messages
- 10
Hi all
I have two FreeNAS boxes, one is for production and the second a replica only. The production server has uses a 10Gb NIC, while the replica only a 1Gb NIC. When I was running FreeNAS 9.1.0 the transfer speed for ZFS replication was pretty much maxing out the 1Gb connection.
After upgrading both boxes to 9.1.1 my replication speed has plummeted to an average of 200Mb/sec. This appears to be something to do with transferring over SSH, as copying files over SMB I'm seeing 1Gb speeds, however when I use scp to copy files between the servers as a test it sits at 200Mb.
If I change the scp cipher to arcfour, I can push ~560Mb until it halts every time at 17% transferred with a 5GB iso I'm using as a test.
As a test, I unplugged the 10Gb port on the production server and configured the 1GB port it has on the same network card. Using the arcfour cipher I can still only get ~560Mb but it doesn't stall and transfers happily. It's not an ideal speed, but it shows that the replica server can handle the transfer (the CPU on the replica server does sit at 90% for the transfer process).
So I'm hoping you guys can point me in the right direction of where to look further. The transfer speeds were fine in 9.1.0, so I don't know what has changed with 9.1.1. Any advice on what to try would be greatly appreciated.
Server specs are...
Production Server:
CPU: Intel(R) Xeon CPU E5-2609 0 @ 2.40GHz
RAM: 32GB
NIC: Ethernet Controller 10 Gigabit X540-AT2
Replica Server:
CPU: Intel(R) Core 2 CPU 6400 @ 2.13GHz
RAM: 6GB
NIC: 82546EB Gigabit Ethernet Controller
Thanks!
Matt
I have two FreeNAS boxes, one is for production and the second a replica only. The production server has uses a 10Gb NIC, while the replica only a 1Gb NIC. When I was running FreeNAS 9.1.0 the transfer speed for ZFS replication was pretty much maxing out the 1Gb connection.
After upgrading both boxes to 9.1.1 my replication speed has plummeted to an average of 200Mb/sec. This appears to be something to do with transferring over SSH, as copying files over SMB I'm seeing 1Gb speeds, however when I use scp to copy files between the servers as a test it sits at 200Mb.
If I change the scp cipher to arcfour, I can push ~560Mb until it halts every time at 17% transferred with a 5GB iso I'm using as a test.
As a test, I unplugged the 10Gb port on the production server and configured the 1GB port it has on the same network card. Using the arcfour cipher I can still only get ~560Mb but it doesn't stall and transfers happily. It's not an ideal speed, but it shows that the replica server can handle the transfer (the CPU on the replica server does sit at 90% for the transfer process).
So I'm hoping you guys can point me in the right direction of where to look further. The transfer speeds were fine in 9.1.0, so I don't know what has changed with 9.1.1. Any advice on what to try would be greatly appreciated.
Server specs are...
Production Server:
CPU: Intel(R) Xeon CPU E5-2609 0 @ 2.40GHz
RAM: 32GB
NIC: Ethernet Controller 10 Gigabit X540-AT2
Replica Server:
CPU: Intel(R) Core 2 CPU 6400 @ 2.13GHz
RAM: 6GB
NIC: 82546EB Gigabit Ethernet Controller
Thanks!
Matt