Suggestions for 24-disk pool and migration

Steffwiz

Cadet
Joined
Jul 5, 2019
Messages
3
Hello all,

I am looking for some advice on a new pool. My current pool is comprised of a single vdev of 8x10TB disks in RAIDZ2. I have purchased 10 more 10TB drives and have 6x4TB drives from my prior pool to use. My current pool is 100% full and I need to start migrating it to a new pool. I plan to replace the 4TBs with 10TBs later. This pool is strictly for media and file storage. VMs/jails/other stuff is on mirrored SSD pool. This server is located at my home so replacing a failed drive will be done same day.

Some options...
3x6-disk RAIDZ2 10TB vdevs; 1x6-disk RAIDZ2 4TB vdev -- 136TB raw/160TB after 4TBs are replaced
2x8-disk RAIDZ2 10TB vdevs; 1x8-disk RAIDZ2 (6x4TB;2x10TB) -- 144TB raw/180TB after 4TBs are replaced
1x12-disk RAIDZ3 10TB vdev; 1x12-disk RAIDZ3 (6x4TB;6x10TB) -- 126TB raw/180TB after 4TBs are replaced

I'm leaning toward 4x6 RAIDZ2 currently. With the Norco 4224 and the HBAs, I can hook up the drives in such a way that a backplane failure or HBA failure will not bring the pool offline. This setup also gives me more than double my existing storage and even more after I buy some more drives. It's also easier to upgrade by buying 6 drives at a time and IOPS performance should be better across 4 vdevs than the other configurations, although this performance isn't required. Additionally, rebuild times should be better across 6 disks than the alternatives. Of course, feel free to point out gaps in my ZFS knowledge.

I haven't considered hot spares since I will keep a cold spare and will replace failed disks same day. I would rather have those bays contributing to my total storage since bays are limited. This pool is backed up entirely to Google Drive and I have a 1Gb fiber connection so restoring from backup should not be too excruciating.

Thoughts? I appreciate any advice you can give. Thank you!

Hardware:
Motherboard: SuperMicro MBD-X11SSH-LN4F-O
CPU: Intel Xeon E3-1230 V6
RAM: 32GB DDR4-2133 ECC (plan to upgrade to 64GB soon)
HBAs: 3x LSI 9211-8i flashed to latest IT fw
Case: Norco 4224
Drives: 18xWD100EMAZ 6xST4000VN008
FreeNAS 11.2-U5
 

Jessep

Patron
Joined
Aug 19, 2018
Messages
379
Some options...
3x6-disk RAIDZ2 10TB vdevs; 1x6-disk RAIDZ2 4TB vdev -- 136TB raw/160TB after 4TBs are replaced
Agreed this is your best option.
 
Top