Performance?

[truenasinterested]

Hi,
i think there is decent hardware that should allow for 10Gbe-NAS:
Asrock Rack E3C246L2T2, Xeon 2148G, 64GB ECC, 10x Toshiba MG10ACA20TEin a RAIDZ2, LSI 9400-16i Adapte IT, Mellanox 10Gbps card, StarTech PCIe-Expander m.2 NVMe SSDs, SATA Crucial 256GB MX500 Bootdrive

(Just FYI, I tested with iperf3 10Gbe over network is fine. Jumbo frames are enabled.)

With dd i tested locally performance on some datasets with different settings, i.e. compression, deduplication and encryption enabled and disabled. The results disappoint me a little bit but that's probably because i am a beginner and i hope there can be some improvements made. The MG10ACA easily delivers >270MB/s sequentially so i guess the combined 8 drives should be able to maintain 10Gbe minus overhead. But the local tests show only 380MB/s with compression disabled (and this should be sequential traffic):
dd if=/dev/random of=./bigfile.bin bs=1M count=10000
10000+0 records in
10000+0 records out
10485760000 bytes transferred in 28.008608 secs (374376335 bytes/sec)

What should i check, what can i optimize? Of course i don't need to optimize network if locally the performance does not suffice.
Thankyou.

 

[artlessknave]

sequentially so i guess the combined 8 drives should be able to maintain 10Gbe minus overhead.

no. raidz2 will generally exhibit the performance of a single drive. 270MB/s is really good. raidz2 is the bottleneck.

 

[ChrisRJ]

Please spend a couple of hours reading up on ZFS etc. Some links can be found in my signature (recommended readings).