rsync performance

Status
Not open for further replies.

brosky

Cadet
Joined
Feb 7, 2018
Messages
2
Hi,

I have a weird situation.

FreeBSD 11.0-STABLE (FreeNAS.amd64) #0 r321665+25fe8ba8d06(freenas/11.0-stable): Mon Sep 25 06:24:11 UTC 2017

RAIDZ2 made from 12 8TB disks.
1Gbps Ethernet link, 1Gbps Internet, flat.

I rsync from the shell and I got maximum 4-5MB/s per connection, maximum 30MB/s
From another machine I export the same folder via NFS and run the same rsync from there, I got 80-90MB/s - so it's not a disk-write issue.

Did anyone encounter this?

Dan.
 
Last edited by a moderator:

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I rsync from the shell and I got maximum 4-5MB/s per connection, maximum 30MB/s
There may be some additional details about exactly what you are doing that might answer the question, but I use an rsync command to backup my data from my main pool to my backup pool internally in my NAS and the only thing that limits how fast that runs is the CPU. It totally maxes out all cores and completes the backup in under 30 minutes. If I had a faster CPU, it might finish even faster. So, the point is, there isn't anything inherent in FreeNAS that makes rsync slow. There may be something about how you are executing it.
Where is the data that you are trying to copy? Where are you trying to put the data? What is the command you are using? What kind of network is the data traversing?

I export the same folder via NFS and run the same rsync from there
Is that an actual rsync, or some other kind of copy command running over NFS?
 
Status
Not open for further replies.
Top