oRAirwolf
Explorer
- Joined
- Dec 6, 2016
- Messages
- 55
Hi all,
I am currently in the process of copying over my zpool to a new server. I am using rsync, but I am getting the painfully slow rsync blues. I am transferring from a 8x8TB E5-2430 v2 48GB server to a 8x10TB E3-1230 v2 16GB server over a 10Gbe link. Both servers are running FreeNAS 11.2 U6. I am using regular rsync, as opposed to rsync over SSH with the following command:
With this command, I get anywhere from 50 MB/s to about 90 MB/s, with an average of about 50 MB/s when the transfers finish on large files. Both arrays can read and write at 600+ MB/s and the CPU usage is not maxing out on either server. If I open new SSH sessions and run 10 rsync transfers simultaneously, the aggregate bandwidth will be about 250 MB/s.
The problem with this option is that the smaller directories finish and I end up with 1 or 2 very large directories with 1000+ folders in them eventually being the only ones transferring, so I have to wait for those to complete at 50 MB/s, which takes days. I was hoping to use a parallel command to speed up the transfer, but it appears that FreeNAS does not offer this ability:
I have been looking around, but I do not see anything else I can use in place of parallel. I was hoping somebody on here could advise on a way to speed up these transfers. Any help would be appreciated.
I am currently in the process of copying over my zpool to a new server. I am using rsync, but I am getting the painfully slow rsync blues. I am transferring from a 8x8TB E5-2430 v2 48GB server to a 8x10TB E3-1230 v2 16GB server over a 10Gbe link. Both servers are running FreeNAS 11.2 U6. I am using regular rsync, as opposed to rsync over SSH with the following command:
rsync -avp --progress --inplace /mnt/RAIDZ1Pool/RAIDZ1Pool/ airwolf@10.10.0.56::a/a/
With this command, I get anywhere from 50 MB/s to about 90 MB/s, with an average of about 50 MB/s when the transfers finish on large files. Both arrays can read and write at 600+ MB/s and the CPU usage is not maxing out on either server. If I open new SSH sessions and run 10 rsync transfers simultaneously, the aggregate bandwidth will be about 250 MB/s.
The problem with this option is that the smaller directories finish and I end up with 1 or 2 very large directories with 1000+ folders in them eventually being the only ones transferring, so I have to wait for those to complete at 50 MB/s, which takes days. I was hoping to use a parallel command to speed up the transfer, but it appears that FreeNAS does not offer this ability:
ls /mnt/RAIDZ1Pool/RAIDZ1Pool/Test/ | parallel -j 10 -i rsync -avp --progress --inplace {} airwolf@10.10.0.56::a/a/
parallel: Command not found.
I have been looking around, but I do not see anything else I can use in place of parallel. I was hoping somebody on here could advise on a way to speed up these transfers. Any help would be appreciated.