Scharbag
Guru
- Joined
- Feb 1, 2012
- Messages
- 620
I have a 2 vDev Z2 production pool that I backup to a 2 vDev Z2 backup pool. Speed is never a big deal when doing differentials each night. Recently, I destroyed my old 12 drive 1 vDev Z2 backup pool in order to re-arrange it to a 2x9 pool and the initial RSYNC is going to take a loooong time.
Typical RSYNC speeds seem to be on the order of 50MBps according to RSYNC and zpool iostat. I use RSYNC as I selectively backup some items and others I do not. Given I have more backup space than production space now, I guess I should have considered replication - which I still may in the future.
Anyway, just wondering why RSYNC seems so slow. The HDDs were able to test at an average of ~150MBps each. Right now, write rates seem to be at about 3MBps on each of the backup pool HDDs. I am using the --inplace modifier on RSYNC. Did not seem to make much of a difference on speeds.
This is not a big deal, just wondering if this is normal when using RSYNC.
UPDATE: So, I now have my system doing parallel RSYNC tasks (tmux is the bombdigity). Transferring at around 180MBps now. What is the limiting factor on RSYNC I wonder...
Thanks,
Typical RSYNC speeds seem to be on the order of 50MBps according to RSYNC and zpool iostat. I use RSYNC as I selectively backup some items and others I do not. Given I have more backup space than production space now, I guess I should have considered replication - which I still may in the future.
Anyway, just wondering why RSYNC seems so slow. The HDDs were able to test at an average of ~150MBps each. Right now, write rates seem to be at about 3MBps on each of the backup pool HDDs. I am using the --inplace modifier on RSYNC. Did not seem to make much of a difference on speeds.
This is not a big deal, just wondering if this is normal when using RSYNC.
UPDATE: So, I now have my system doing parallel RSYNC tasks (tmux is the bombdigity). Transferring at around 180MBps now. What is the limiting factor on RSYNC I wonder...
Thanks,
Last edited: