Replication Stream Compression: disabled vs. lz4 vs. pigz vs. plzip

glauco

Guru
Joined
Jan 30, 2017
Messages
526
I'm setting up a Replication Task from my main TrueNAS Core box to a backup TrueNAS Core box.
lz4 seems to work very well: CPU is just slightly taxed and my 1Gb/sec ethernet link is maxed out.
plzip seems to work very badly: CPU is maxed out (4 cores, 8 threads, all at 100% for hours) and network fluctuates between 10 and 45 MB/s.
Since all my datasets are lz4 compressed, what if I disable stream compression altogether?
I haven't tried pigz yet...
1694505015039.png
 
Joined
Jul 3, 2015
Messages
926
If they are on the same secure network you could consider NETCAT.

Over SSH historically I have found disabling replication compression to be the fastest.
 

glauco

Guru
Joined
Jan 30, 2017
Messages
526
If they are on the same secure network you could consider NETCAT.
They are on the same network now that I'm testing, but eventually the backup box will be moved offsite where network speed is poor, so I'd rather use settings that make sense under poor network speed conditions.
 
Joined
Jul 3, 2015
Messages
926
Sure. Try disabling the replication compression and see if that's better.
 
Top