48TB NAS Build / Compile Hardware List

[thepixelgeek]

48TB usable?

Nope. I'm planning on 48TB total which will leaves me about 38TB usable.

 

[Donny Davis]

It looks pretty good, I would just add the recommended size l2arc ssd. You can try without it, and it will probably run fine. I have an oversized l2arc SSD in my plex machine and it rarely touches the pool for streaming. Reliably has also been magic. Freenas is my go to for this kind of stuff.

 

[thepixelgeek]

It looks pretty good, I would just add the recommended size l2arc ssd. You can try without it, and it will probably run fine. I have an oversized l2arc SSD in my plex machine and it rarely touches the pool for streaming. Reliably has also been magic. Freenas is my go to for this kind of stuff.

That's something I haven't researched fully yet...but I was under the impression that I didn't need to do L2ARC.

 

[Spearfoot]

That's something I haven't researched fully yet...but I was under the impression that I didn't need to do L2ARC.

There's about a 99% chance you don't need an L2ARC. Home users and small workgroups won't see much benefit from having one. They're intended to boost performance when a system is stressed by a large number of users.

 

[thepixelgeek]

There's about a 99% chance you don't need an L2ARC. Home users and small workgroups won't see much benefit from having one. They're intended to boost performance when a system is stressed by a large number of users.

I see....I will be the only user, using it mostly for storage and Plex. The guide said to max out RAM before thinking about L2ARC, so that's what I'll do first. Starting with 32Gb then moving up if I need more. Guessing there is a test I can run after using it for a bit?

 

[Spearfoot]

I see....I will be the only user, using it mostly for storage and Plex. The guide said to max out RAM before thinking about L2ARC, so that's what I'll do first. Starting with 32Gb then moving up if I need more. Guessing there is a test I can run after using it for a bit?

You can look at the ARC size, hit ratio, requests, etc., in Reporting->ZFS. But with only a single user and <64GB of RAM, you're just not going to need an L2ARC.

 

[thepixelgeek]

Updated Specs:

MOBO: SUPERMICRO MBD-X11SSM-F-O Micro ATX Server Motherboard LGA 1151 Intel C236 Purchased
CPU: Intel Xeon E3-1230 v5 SkyLake 3.4 GHz 8MB L3 Cache LGA 1151 80W BX80662E31230V5 Purchased
RAM: (2) Crucial 32GB Kit (2 x 16GB) DDR4-2400 ECC UDIMM CT7982365 Purchased 32gb
HDD: (6) WD Red 4TB NAS HDD - 5400 RPM Purchased 2
HDD: (6) Seagate Ironwolf NAS 4TB HDD - 5400 RPM Purchased 2
BOOT: (2) ADATA Premier SP600 32GB SATA III (ASP600S3-32GM-C) ($30) Purchased
PSU: SeaSonic SS-1050XP3 1050W ($169) Purchased
CASE: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230) iStarUSA M-3120-ATX 12-Bay Trayless Storage Purchased
PSU: APC Back-UPS Pro 1000VA (BR1000G) ($122)
HBA: IBM Serveraid M1015 SAS/SATA Controller 46M0831 ($130) Purchased
ADD: StarTech.com SAS8087S450 50cm Serial Attached SCSI SAS Cable - SFF-8087 to 4x Latching SATA ($25)Purchased
(3) Noctua NF-F12 PWM Cooling Fan Purchased
(2) Noctua NF-A6x25 PWM Purchased
Noctua NH-D9L cpu cooler Purchased

 

[thepixelgeek]

Starting to build! And....got questions already.

 

[Stux]

Updated Specs:

MOBO: SUPERMICRO MBD-X11SSM-F-O Micro ATX Server Motherboard LGA 1151 Intel C236 Purchased
CPU: Intel Xeon E3-1230 v5 SkyLake 3.4 GHz 8MB L3 Cache LGA 1151 80W BX80662E31230V5 Purchased
RAM: (2) Crucial 32GB Kit (2 x 16GB) DDR4-2400 ECC UDIMM CT7982365 Purchased 32gb
HDD: (6) WD Red 4TB NAS HDD - 5400 RPM Purchased 2
HDD: (6) Seagate Ironwolf NAS 4TB HDD - 5400 RPM Purchased 2
BOOT: (2) ADATA Premier SP600 32GB SATA III (ASP600S3-32GM-C) ($30) Purchased
PSU: SeaSonic SS-1050XP3 1050W ($169) Purchased
CASE: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230) iStarUSA M-3120-ATX 12-Bay Trayless Storage Purchased
PSU: APC Back-UPS Pro 1000VA (BR1000G) ($122)
HBA: IBM Serveraid M1015 SAS/SATA Controller 46M0831 ($130) Purchased
ADD: StarTech.com SAS8087S450 50cm Serial Attached SCSI SAS Cable - SFF-8087 to 4x Latching SATA ($25)Purchased
(3) Noctua NF-F12 PWM Cooling Fan Purchased
(2) Noctua NF-A6x25 PWM Purchased
Noctua NH-D9L cpu cooler Purchased

You're going to need two breakout cables right?

only 8 sata ports on the mobo, and you're using 2 for your boot drives. So, you're two ports short.

I suspect you've seen my build (since you're cooling is very similar ;)), but if not here

Might help with thermal setup/testing :)

 

[thepixelgeek]

You're going to need two breakout cables right?

By breakout cables, you mean SFF-8087 to SFF-8087? Yes, 2 cables going from backplane to M1015 for a total of 8 drives. Backplane suggests each 8087 connector powers 4 drives.

NORCO C-SFF8087-D SFF-8087 to SFF-8087 Internal Multilane SAS Cable

only 8 sata ports on the mobo, and you're using 2 for your boot drives. So, you're two ports short.

M1015 will power 8 drives, the motherboard will power the other 6.

4 drives using this cable: NORCO Computer Parallel Cables (C-SFF8087-4S)
2 drives will use sata cables to the motherboard.

I suspect you've seen my build (since you're cooling is very similar ;)), but if not here
Might help with thermal setup/testing :)

YES! Awesome build...will be reading that again soon.

 

[thepixelgeek]

I'm looking for better Molex cables now. PSU supplied 18awg and only supplied 5 molex. I need 12!

 

[Stux]

If your backplanes have sff-8087 connectors and you want to connect them to the motherboard Sata connectors you need a reverse breakout cables.

 

[thepixelgeek]

If your backplanes have sff-8087 connectors and you want to connect them to the motherboard Sata connectors you need a reverse breakout cables.

I just learned that! Such a tiny thing makes a huge difference! It says in the description that these are "Discrete to SFF-8087 (Reverse breakout) cable"....thinking I'm ok?

NORCO Computer Parallel Cables (C-SFF8087-4S)

 

[Stux]

Should be okay.

Why do you need so many molecules (peripheral) cables?

...

I see.

Truth be told one molex (4P peripheral) is easily rated for two Sata drives. You could probably get away with two runs of 3 to each side.

 

[thepixelgeek]

Should be okay.

Why do you need so many molecules (peripheral) cables?

...

I see.

Truth be told one molex (4P peripheral) is easily rated for two Sata drives. You could probably get away with two runs of 3 to each side.

I think I follow...
Here's my thinking so far...My backplane has 12 molex connectors. My PSU has 5 pcie 6pin connectors. I want to run 12 HD / 2 SSDs....So, I'll need these power cables:


(4) pwr cables --- 6pin to 3 molex connectors...looking for 16 awg...{for the HDs}
(1) pwr cable --- 6pin to 2 sata....{for the SSDs}

In the end, I may just make the cables myself...been interested in doing that for my PC build.

 

[Arwen]

Please note that you should check the disk back planes. It's entirely possible that
each MOLEX connector only supplies power to 1 disk. Thus, the need for all 12
MOLEX connectors wired up, (if using 12 disks). Just check before you commit
to partial population. (I'd use visual checking first, and if inconclusive, an Ohm
meter.)

 

[thepixelgeek]

Please note that you should check the disk back planes. It's entirely possible that
each MOLEX connector only supplies power to 1 disk. Thus, the need for all 12
MOLEX connectors wired up, (if using 12 disks). Just check before you commit
to partial population. (I'd use visual checking first, and if inconclusive, an Ohm
meter.)

Thanks...my assumption is each molex powers 1 hard drive. Thus, 4 x power cables (pcie 6pin) to 3 molex connectors...that would power all 12 drives.

 

[Stux]

Might be old info, but apparently you can get them from Antron Electronics.

http://www.overclock.net/t/1256457/where-to-buy-extra-seasonic-platinum-cables

Think it seems a good idea to order an extra 3 peripheral cables with 3 molex connectors per cable. You already have one of them, and then use a SATA chain for any other SSDs you add.

 

[Stux]

BTW The corsair RMx1000 comes with 6 PSU side peripheral/sata connectors (6 pin) and it comes with 12 molex (3 cables, with 4 connectors each) connectors and 11 sata connectors...

And they sell additional cables direct form their website.

If anyone is looking in the future. It would've been a more appropriate PSU.

 

[thepixelgeek]

BTW The corsair RMx1000 comes with 6 PSU side peripheral/sata connectors (6 pin) and it comes with 12 molex (3 cables, with 4 connectors each) connectors and 11 sata connectors...

And they sell additional cables direct form their website.

If anyone is looking in the future. It would've been a more appropriate PSU.

Good to know...I'm going to do custom wiring for most of my cables. Does Corsairs use 16 or 18 awg? Hard to tell from the site.