Supermicro X9SRL-F Build Check

[MrRobot245]

Looking to put together a TrueNas scale build, I'm going to repurpose some components, but bought some from ebay as well:


MotherBoard: Supermicro X9SRL-F
CPU: Xeon E5-2690v2
RAM:128GB DDR3 1600MHz RAM ECC (Bought as CPU+MB+RAM combo)
HDD: 12x 8TB WD Easystore, 1x 10TB Ironwolf (13x8TB)
PSU: Can't remember, some 1000W system I have in my current NAS
UPS: CyberPower 1500VA
NIC: Intel X540-T1
HBA:2x LSI 9220-8i

I have 1x 8tb and 1x10tb drive I was going to re-purpose for this build. Going to buy 11 more 8tb Easystores, and I realize I'll lose 2TB off the 10TB HDD
Was planning on a Raidz2 so 88 TB usable. Any issues that I cant think of?

 

[NugentS]

Use case?

 

[MrRobot245]

Consolidate a Linux host that runs plex + 20 other dockers, host my current 60tb library

 

[NugentS]

Then I would suggest that you don't have enough disk space. You are starting at 68% full, which is in my opinion not a good starting point as expanding ZFS pools is not as simple as one might hope (yet).
I would also suggest a small faster pool (SSD) to run the dockers off

 

[MrRobot245]

I have a few 1TB ssds I was going to throw into another pool for the VMs, just mostly confirming the hardware looks good. It should take me 5+ years to get closer to 90%

 

[NugentS]

I still think you don't have enough disk space. Just be aware that ZFS performance degrades the fuller it gets.
Also a 12 wide Z2 is (IMHO) at the edge of large. Z3 would be better, but splitting that into 2 Z2's would be better still, obviously that will cost disk capacity.
So back to not enough disk space.
You do have 20 connections 8*2+6

 

[MrRobot245]

I can budget for another 8tb to bring it up to 14.
Should I do 2 raidz1 with 7 drives each or 1 14z2? I have a few ssds I was going to throw in as slogs and the data is just Movies/TV

 

[NugentS]

Neither.
Again my opinion. Z1 is unsafe with 8TB drives. Z2 is better
14 Wide is too wide for a single vdev
I would suggest 2 * 7 wide vdevs in Z2. Which is of course 4 drives redundancy

It depends on the level of importance of the data and how replaceable it is. Do you / Will you have a backup? If you have a regular backup then maybe Z1
SLOG won't help unless you are doing sync writes & 128GB RAM is plenty.
Core or Scale? I guess Scale unless you are running a docker host VM under bhyve

I have no idea if docker or KVM uses sync writes or not. But that might be important to know. SSD's would be better used in a small pool for docker+VM (depending on how many you have). SLOG if useful has specific requirements and what you have may not be right for a SLOG

 

[MrRobot245]

Going SCALE,
Everything is backed up on GDrive as well as the server I'm taking parts from, and I have a 1Gig symmetrical connection so not too worried about losing data as I can restore it easy.

I have 2 256gb SSDs I was going to mirror for boot, and a pair of 1tb ssds I was going to mirror for the VMs/docker. Most of the data will be large file transfer either ~700mb or ~8-10GB would the SLOG help on either? Or would it just be thrown into RAM and written to disk before it would hit the SLOG

 

[NugentS]

The only time a SLOG will help is with sync transfers - which are slow. A SLOG can help speed them up, but not to the speed of async transfers. Sync transfers only happen with iSCSI or NFS. SMB does not use sync. Hardware requirement for a SLOG is as follows:
1. Ultra Low Latency this effects how performant the SLOG is
2. High Speed effects how performant the SLOG is
3. PLP this is 100% to let the SLOG do its job. Most consumer drives do not have PLP, even when they imply they might perhaps.
4. Size not an issue. 20GB is more than enough for 10Gb. I think 10Gb needs 6.5GB of SLOG space, but may need 2-3 multiple of that - I really don't know - so I just assign 20GB from an Optane

Good SLOG's: Optane 900p or better. RMS-300 type cards (rare as the proverbial rocking horse deposits). RMS-200 - just as rare

256 Boot is on the large size - but they are free if you already have them!!

1TB SSD's for VM's/Docker = Good

 

[Ericloewe]

MotherBoard: Supermicro X10SLH-F
CPU: Xeon E5-2690v2
RAM:128GB DDR3 1600MHz RAM ECC (Bought as CPU+MB+RAM combo)

That's not going to fly. The X10SLH-F is an LGA1150 board and will neither take that CPU nor that much memory. With all LGA1150 processors, the best you can do is 32 GB in 8 GB DIMMs.

 

[MrRobot245]

Apparently I copied the MB info wrong, it comes as a combo but the actual MB is X9SRL-F

 

[Ericloewe]

Ok, that should all work together, then.