Abnormally slow 15MB/s write speed on 6xSSD RAIDz1?

ee21

Dabbler
Joined
Nov 2, 2020
Messages
33
Very new to FreeNAS, just built a box the other week and am experimenting with it.. I just successfully tested disk I/O and was a little shocked by the results. I was hoping the community might weigh in as to what the problem is, or if this is just normal.

Specs:
TrueNAS 12 CORE
MSI B550 AM4 motherboard
Ryzen 3100
32GB non-ECC DDR4
3x Samsung EVO 850 SSD
3x Samsung EVO 860 SSD
2.5G Base-T NIC using RTL8125B

I've tried two pool configurations:
A: all 6 SSDs as data vDevs in Raid z1
B: 5 SSDs as data vDev in Raid z1 + 1 SSD as SLOG

Testing performed using iperf3 on a client with a direct attached 2.5G NIC (no switch in between) also based on RTL8125B:

Memory to Memory:
server: iperf3 -s
client: iperf3 -c 10.0.1.1 -i1 -t 40

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-40.00 sec 9.18 GBytes 1.97 Gbits/sec sender
[ 4] 0.00-40.00 sec 9.18 GBytes 1.97 Gbits/sec receiver



Memory (of client) to Disk (on the FreeNAS):
server: iperf3 -s -F /mnt/ssd/test.out
client: iperf3 -c 10.0.1.1 -i1 -t 40

[ ID] Interval Transfer Bandwidth
[ 4] 0.00-40.00 sec 1.77 GBytes 381 Mbits/sec sender
[ 4] 0.00-40.00 sec 1.77 GBytes 381 Mbits/sec receiver

The second test results average to about 45MB/s disk write speed, obviously less than will saturate the NIC. These SSDs were taken from my old Windows box which was running them in RAID 5, and could write files at 300MB/s+ easily.
 
Top