Maximilious
Dabbler
- Joined
- Jun 20, 2023
- Messages
- 15
Hey All,
I'm in the middle of a migration from my 40TB QNAP to a new TrueNAS SCALE server. I'm about half-way through my data transfer when I noticed that my rsync speeds are very slow compared to a different rsync I had to do of the same data last month between a Buffalo and QNAP device. On the latter I was transferring roughly 4TB in 12 hours, but now I'm transferring 1TB in 12 hours - painfully slow.
My system is in my signature, I do have LZ4 compression on the destination dataset with deduplication disabled. The server has 10GB fiber (verified speed) and the source QNAP has a 2.5GB uplink (also verified). They are on different switches but I've also verified the 10GB link between has correct speed as well. My iPerf3 test between systems is pulling 1.5GB transfer speed, but my rsync is capping around 17MB max.
The rsync command I'm using is the following:
sudo rsync -avhtP --stats --progress --exclude '.@__thumb*' --exclude '@Recycle' --exclude '@Recently-Snapshot' <QNAPsource> <TrueNASdestination>
I'm running this from SSH session with mounted folders through fstab. Perhaps this is not the best way to handle as it's not through the GUI but it is the method I was used to. I also recently read about the "zfs send" command but have not done any research into it yet. Should I perhaps use this method of migration instead?
It's also worth mentioning that the QNAP source unit is running QuTS Hero with native zfs support, and I do have compression and dedupe enabled on some of those data sets, which perhaps is also part of the issue. My TrueNAS CPU does not seem crunched at all but I've not investigated my QNAP resources either.
I'm coming up on my largest 20TB volume (not deduped or compressed on source unit) and do not want to suffer through a long transfer time of a month at the current state. Any suggestions would be appreciated!
I'm in the middle of a migration from my 40TB QNAP to a new TrueNAS SCALE server. I'm about half-way through my data transfer when I noticed that my rsync speeds are very slow compared to a different rsync I had to do of the same data last month between a Buffalo and QNAP device. On the latter I was transferring roughly 4TB in 12 hours, but now I'm transferring 1TB in 12 hours - painfully slow.
My system is in my signature, I do have LZ4 compression on the destination dataset with deduplication disabled. The server has 10GB fiber (verified speed) and the source QNAP has a 2.5GB uplink (also verified). They are on different switches but I've also verified the 10GB link between has correct speed as well. My iPerf3 test between systems is pulling 1.5GB transfer speed, but my rsync is capping around 17MB max.
The rsync command I'm using is the following:
sudo rsync -avhtP --stats --progress --exclude '.@__thumb*' --exclude '@Recycle' --exclude '@Recently-Snapshot' <QNAPsource> <TrueNASdestination>
I'm running this from SSH session with mounted folders through fstab. Perhaps this is not the best way to handle as it's not through the GUI but it is the method I was used to. I also recently read about the "zfs send" command but have not done any research into it yet. Should I perhaps use this method of migration instead?
It's also worth mentioning that the QNAP source unit is running QuTS Hero with native zfs support, and I do have compression and dedupe enabled on some of those data sets, which perhaps is also part of the issue. My TrueNAS CPU does not seem crunched at all but I've not investigated my QNAP resources either.
I'm coming up on my largest 20TB volume (not deduped or compressed on source unit) and do not want to suffer through a long transfer time of a month at the current state. Any suggestions would be appreciated!