Help with benchmark ( Weird Results )

mikefnasr

Cadet
Joined
Aug 15, 2023
Messages
1
Hello everyone,

I recently noticed decrease in performance in my VM's running on PVE, so i decided to do a local benchmark on my storage, which turned out to be weird.
a 3 way mirror should perform much better then a raidz3 one, never the less, Core should be way more performante then SCALE.
Please correct me if i am wrong in that regards, but most importantly, can anyone make sense of the attached results?

Test Command: ( dataset: tank/clb-vm )
fio --name=randwrite --ioengine=posixaio --iodepth=32 --rw=randwrite --bs=1M --size=256M --numjobs=32 --time_based --runtime=300

Primary storage:
TrueNAS Core 12.0-U8.1, 3 mirrored vdev's with 3x 3TB 7200 RPM each ( 30% pool used ) ( no special vdev's )
96GB RAM, 1 CPU 4 cores @ 2.00 GHZ
AHCI Bios, no RAID controllers , no JBOD modes, 6Gb/s SATA ( hardware isilon x200 )
dataset sync off and noatime off, block size default ( 128K )

Secondary storage:
TrueNAS Scale 22.12.3.3, raidz3, 12x3TB 7200 RPM ( 0% pool used ) ( no special vdev's )
96GB RAM, 1 CPU 4 cores @ 2.00 GHZ
AHCI Bios, no RAID controllers , no JBOD modes, 6Gb/s SATA ( hardware isilon x200 )
dataset sync off and noatime off, block size default ( 128K )

Thank you
 

Attachments

  • Primary Storage.png
    Primary Storage.png
    280.3 KB · Views: 67
  • Secondary Storage.png
    Secondary Storage.png
    147.1 KB · Views: 64
Top