Evan Richardson
Explorer
- Joined
- Dec 11, 2015
- Messages
- 76
I want to try and get a good benchmark of my filesystem to see what my max througput is. After reading this post, I gave IOZONE a try, but first, it took almost a day to run, and second, the results seem way off:
I ran the following command:
My system is a 24 Drive, RaidZ2 config, made up of 5400rm 8TB drives. I have 128GB of ram, so based on the post, i used a file size of 256GB to rule out memory. If I'm reading the results right, I'm getting somewhere in the vacinity of 10GB/sec throughput? That seems impossible, given that if you take the average drive write speed, say 150MB/s, x 16 drives (24-8 parity drives, is only 2.4GB/sec, so how am I able to get ~10+GB/sec throughput?
I've started a new test, with 1 file size, and already it looks way off, 2GB/sec?
whats going on here?
Edit, after reading this post, seems i needed to add some flags to prevent compressible data. now my Zpool status shows ~1.8+ GB/sec write speeds
I ran the following command:
Code:
iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls
My system is a 24 Drive, RaidZ2 config, made up of 5400rm 8TB drives. I have 128GB of ram, so based on the post, i used a file size of 256GB to rule out memory. If I'm reading the results right, I'm getting somewhere in the vacinity of 10GB/sec throughput? That seems impossible, given that if you take the average drive write speed, say 150MB/s, x 16 drives (24-8 parity drives, is only 2.4GB/sec, so how am I able to get ~10+GB/sec throughput?
I've started a new test, with 1 file size, and already it looks way off, 2GB/sec?
Code:
iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile2.dat -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls Iozone: Performance Test of File I/O Version $Revision: 3.487 $ Compiled for 64 bit mode. Build: freebsd Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins Al Slater, Scott Rhine, Mike Wisner, Ken Goss Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, Vangel Bojaxhi, Ben England, Vikentsi Lapa, Alexey Skidanov, Sudhir Kumar. Run began: Mon Feb 28 22:54:35 2022 File size set to 268435456 kB Record Size 1024 kB Excel chart generation enabled Command line used: iozone -i 0 -i 1 -i 2 -s 256G -r 1m -R -f /mnt/sirius/media/testfile2.dat -b /mnt/sirius/homes/iozone-SIRIUS-local-size-256g-2.xls Output is in kBytes/sec Time Resolution = 0.000001 seconds. Processor cache size set to 1024 kBytes. Processor cache line size set to 32 bytes. File stride size set to 17 * record size. random random bkwd record stride kB reclen write rewrite read reread read write read rewrite read fwrite frewrite fread freread 268435456 1024 2183045 2568102
whats going on here?
Edit, after reading this post, seems i needed to add some flags to prevent compressible data. now my Zpool status shows ~1.8+ GB/sec write speeds
Last edited: