Slow write with NFS share

[alveolina]

Hi,

I've read a few posts and it seems to be a common problem. I have a dataset on a z1 pool that is shared via NFS4 (setting to NFS 3 makes no difference). I am rsyncing from another server to this TrueNAS-SCALE-22.12.0 server. I have tried syncing large files which seem to go at high speeds. With many small files (thumbnails, etc.), speeds deteriorate significantly. See chart below. Below is also the output of zpool.

The rsync command is rsync -avAHS --progress --stats --whole-file --delete --no-perms /mnt/zeus1/Backup/ /mnt/zeus2P1/

Are there any tweaks that could be made to make the pool operate a bit faster with small files.

admin@truenas[~]# sudo zpool iostat -v capacity operations bandwidth pool alloc free read write read write ---------------------------------------- ----- ----- ----- ----- ----- ----- boot-pool 2.64G 203G 0 0 4.97K 3.39K sda3 2.64G 203G 0 0 4.97K 3.39K ---------------------------------------- ----- ----- ----- ----- ----- ----- zeus2_P1 868G 4.59T 1 184 38.0K 10.3M raidz1-0 868G 4.59T 1 184 38.0K 10.3M 8d13a2e0-5501-4fe8-be1c-f1864c879349 - - 0 61 12.7K 3.43M 35ebc4d5-b45c-4c4a-8012-67f84db2a13c - - 0 61 12.7K 3.43M d12ba286-f740-45c9-a85c-bd7c066425b2 - - 0 61 12.7K 3.43M ---------------------------------------- ----- ----- ----- ----- ----- -----

 

[alveolina]

I accept that maybe I shoudl have provided more info. I can't work out how to edit my posts

The rsync is from a Debian 11 server (zeus1). When I rsync from there to my linux desktop, its a breeze, so it excludes that the originator machine is the problem.

The Trunas machine (zeus2) is mounted on zeus1 with the following in /etc/mtab:

192.168.20.2:/mnt/zeus2P1/Backup /mnt/Zeus2P1 nfs4 rw,relatime,vers=4.2,rsize=1048576,wsize=1048576,namlen=255,hard,proto=tcp,timeo=600,retrans=2,sec=sys,clientaddr=192.1 68.20.5,local_lock=none,addr=192.168.20.2 0 0

The z1 pool has 3 identical 2GB drives that are connected to a RAID card (the idea is that I could hopefully pull out the raid card, the drives and the SSD where Truenas is installed and plug it all in another identical spare machine I have in case the current failed) in pass through mode (no raid configured on the raid card).

The machine is not a monster of performance:
Intel(R) Xeon(R) CPU X3430 @ 2.40GHz
12 GB ram (always about 2 GB free ram)

I don't think its a hardware problem or undersized rig otherwise you would have high speeds with large files?

Only installed Truenas 2 days ago so pretty new to this and not a massive linux espert anyway. Is there any other output/config I can provide.