48TB NAS Build / Compile Hardware List

[Jailer]

http://ark.intel.com/m/compare/90578,90594

Uhhggg, you mobile guys.......

http://ark.intel.com/compare/90578,90594

 

[thepixelgeek]

Thanks all! I'm reading/learning more about the LSI 3008 here.

 

[thepixelgeek]

Now searching for answers:

What additional accessories/cables will I need to purchase if going with the X11SSL?
Any issues with the Rosewill RSV-L4412 backplane?

 

[thepixelgeek]

If you know for certain you are going to add more drives this is the route I would go. It can be flashed to IT mode just like the IBM 1015 so no worries there and it would save some money on your build.

More PCIe lanes, more USB 3.0 ports and more virtualization specific features.

C232: http://ark.intel.com/products/90578/Intel-GL82C232-PCH#@product/specifications

C236: http://ark.intel.com/products/90594/Intel-GL82C236-PCH#@product/specifications

Good to know! And it doesn't seem like I'll need the C236 extras--not using USB and the X11SSL board is capable of 14 drives.

However, I'm now curious if there is any bottleneck with the LSI using x8 PCIe? Assuming no because of the "12Gb/s", and the WD Reds are "6Gbps SATA"....I realize that may be a ridiculous question, but the PCIe usage/specs is a little beyond my current knowledge. ! Yet another thing I've been researching/learning !

And, since the LSI3008 is onboard, does that mean I connect the drives directly to the board?...looking at the mobo manual...I don't see where drives would connect...LSI appears to be a chip onboard...guessing an additional card in the PCIe slot is needed?

 

[thepixelgeek]

New build...updated mobo/ram:

MOBO: Supermicro MBD-X11SSL-CF ($270)
CPU: Intel Xeon E3-1270 v5 @ 3.60GHz ($360 / Passmark 10107)
RAM: (2) Crucial 32GB Kit (2 x 16GB) DDR4-2400 ECC UDIMM (CT7982583) ($254/ea)
HDD: (12) WD Red 4TB NAS Hard Disk Drive - 5400 RPM ($140/ea)
BOOT: ADATA Premier SP600 32GB SATA III (ASP600S3-32GM-C) ($30)
PSU: SeaSonic SS-1050XP3 1050W ($169)
CASE: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230)
PSU: APC Back-UPS Pro 1000VA (BR1000G) ($122)

TOTAL: $3369 / $84.225 per TB === 32TB usable space (80% rule)

Something to consider...with 6TB drives, the cost per TB comes way down:

HDD: (12) WD Red 6TB NAS Hard Disk Drive - 5400 RPM ($230)
TOTAL: $4449 / $74.15 per TB === 48TB usable space (80% rule)

 

[Arwen]

...
And, since the LSI3008 is onboard, does that mean I connect the drives directly to the board?...looking at the mobo manual...I don't see where drives would connect...LSI appears to be a chip onboard...guessing an additional card in the PCIe slot is needed?

The SAS specification allows different types of connectors. For example, the more common
type is a 4 port SAS connector, so a 8 port controller chip might have 2. Or a system board
could have 4 SATA type connectors and 1 x 4 port SAS connector.

So, for the 4 port SAS connector, if you are not using a back plane, you may need a break
out cable. That would take 1 single 4 port SAS connector and give you 4 SATA. All depends
on the system board and the disk connections.

PS. I've not bothered to look up the Supermicro X11SSL-CF to see what it needs.

 

[thepixelgeek]

The SAS specification allows different types of connectors. For example, the more common
type is a 4 port SAS connector, so a 8 port controller chip might have 2. Or a system board
could have 4 SATA type connectors and 1 x 4 port SAS connector.

So, for the 4 port SAS connector, if you are not using a back plane, you may need a break
out cable. That would take 1 single 4 port SAS connector and give you 4 SATA. All depends
on the system board and the disk connections.

PS. I've not bothered to look up the Supermicro X11SSL-CF to see what it needs.

Thanks!

X11SSL-CF:

1. 6 SATA3 (6Gbps) via C232; RAID 0, 1, 5, 10
2. 8 SAS3 (12Gbps) via LSI 3008; RAID 0, 1, 10

Chassis: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230)

Totals 14 drives....just not sure yet how it all hooks up.

The below image only shows 6 SATA ports and miniSAS. I'm assuming I'll need a miniSAS connector that connects the additional drives?

 

[Ericloewe]

I'm assuming I'll need a miniSAS connector that connects the additional drives?

Two SFF-8643 breakout cables to connect to SATA-style ports.

 

[thepixelgeek]

Ended up buying mobo/cpu for ($464.28) :

• 1x Intel Xeon E3-1230 v5 SkyLake 3.4 GHz 8MB L3 Cache LGA 1151 80W BX80662E31230V5 Server Processor
• 1x SUPERMICRO MBD-X11SSM-F-O Micro ATX Server Motherboard LGA 1151 Intel C236

 

[thepixelgeek]

Two SFF-8643 breakout cables to connect to SATA-style ports.

Now that I purchased the X11SSM, will these cables work with added IBM Serveraid M1015 SAS/SATA Controller 46M0831?

Or do I need something different?

• 3WARE Cable Multi-lane Internal Cable (SFF-8087)

[Updated:] Now reading this thread.

 

[KevDog]

I have the X11SSL-CF motherboard. It doesn't come with the cables for the LSI connectors. I had to order them. The models of the cable was:

• 2 x CBL-SAST-0616 Supermicro MiniSAS HD to 4x SATA 50/50cm Cable (CBL-SAST-0616

I contacted Supermicro and there are various lengths. I can see you purchased another motherboard, however I'm only listing this here for help for others who may be interested in this board, since I found it strange the board didn't come with cables by default

 

[Ericloewe]

Now that I purchased the X11SSM, will these cables work with added IBM Serveraid M1015

No, the SAS2 equivalent is SFF-8087.

 

[Spearfoot]

Now that I purchased the X11SSM, will these cables work with added IBM Serveraid M1015 SAS/SATA Controller 46M0831?

Or do I need something different?

• 3WARE Cable Multi-lane Internal Cable (SFF-8087)

[Updated:] Now reading this thread.

For an IBM M1015 you will need an SFF-8087-to-SATA forward breakout cable, like this one: https://www.amazon.com/gp/product/B004KDO22K/?tag=ozlp-20

 

[thepixelgeek]

Updated build specs:

MOBO: SUPERMICRO MBD-X11SSM-F-O Micro ATX Server Motherboard LGA 1151 Intel C236 ($209.99) Purchased
CPU: Intel Xeon E3-1230 v5 SkyLake 3.4 GHz 8MB L3 Cache LGA 1151 80W BX80662E31230V5 ($259.99) Purchased
RAM: (2) Crucial 32GB Kit (2 x 16GB) DDR4-2400 ECC UDIMM CT7982365 ($254/ea)
HDD: (12) WD Red 4TB NAS Hard Disk Drive - 5400 RPM ($140/ea)
BOOT: ADATA Premier SP600 32GB SATA III (ASP600S3-32GM-C) ($30)
PSU: SeaSonic SS-1050XP3 1050W ($169)
CASE: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230)
PSU: APC Back-UPS Pro 1000VA (BR1000G) ($122)
HBA: IBM Serveraid M1015 SAS/SATA Controller 46M0831 ($130)
ADD: StarTech.com SAS8087S450 50cm Serial Attached SCSI SAS Cable - SFF-8087 to 4x Latching SATA ($25)

TOTAL: $3364 / $84 per TB === 32TB usable space (80% rule)

Something to consider...with 6TB drives, the cost per TB comes way down:

HDD: (12) WD Red 6TB NAS Hard Disk Drive - 5400 RPM ($230)
TOTAL: $4444 / $74 per TB === 48TB usable space (80% rule)

 

[Spearfoot]

Updated build specs:

MOBO: SUPERMICRO MBD-X11SSM-F-O Micro ATX Server Motherboard LGA 1151 Intel C236 ($209.99) Purchased
CPU: Intel Xeon E3-1230 v5 SkyLake 3.4 GHz 8MB L3 Cache LGA 1151 80W BX80662E31230V5 ($259.99) Purchased
RAM: (2) Crucial 32GB Kit (2 x 16GB) DDR4-2400 ECC UDIMM CT7982365 ($254/ea)
HDD: (12) WD Red 4TB NAS Hard Disk Drive - 5400 RPM ($140/ea)
BOOT: ADATA Premier SP600 32GB SATA III (ASP600S3-32GM-C) ($30)
PSU: SeaSonic SS-1050XP3 1050W ($169)
CASE: Rosewill RSV-L4412 - 4U - 12 SATA / SAS Hot-swap Drives ($230)
PSU: APC Back-UPS Pro 1000VA (BR1000G) ($122)
HBA: IBM Serveraid M1015 SAS/SATA Controller 46M0831 ($130)
ADD: StarTech.com SAS8087S450 50cm Serial Attached SCSI SAS Cable - SFF-8087 to 4x Latching SATA ($25)

TOTAL: $3364 / $84 per TB === 32TB usable space (80% rule)

Something to consider...with 6TB drives, the cost per TB comes way down:

HDD: (12) WD Red 6TB NAS Hard Disk Drive - 5400 RPM ($230)
TOTAL: $4444 / $74 per TB === 48TB usable space (80% rule)

Not bad! Though I have to admit I'm leery of the Rosewill cases; rumor has it that they don't have the best build quality. Perhaps someone else who has actual experience with them will chime in and inform us. In the meantime, you might explore eBay for used Supermicro rackmount chassis. You may be able to pick up a 4U chassis w/ dual power supplies for a very reasonable sum.

 

[thepixelgeek]

Not bad! Though I have to admit I'm leery of the Rosewill cases; rumor has it that they don't have the best build quality. Perhaps someone else who has actual experience with them will chime in and inform us. In the meantime, you might explore eBay for used Supermicro rackmount chassis. You may be able to pick up a 4U chassis w/ dual power supplies for a very reasonable sum.

Thanks!
I did read a few comments about that regarding the plastic face and HD drive cages. Some say those are not "high quality", but given that it's a 12 hot swappable bay 4U for $200, and it will be on my shelf (static), I don't think I need a higher quality chassis. All this is for home use.

 

[thepixelgeek]

Although, after some more searching...I could go with an iStarUSA M-3120-ATX 12-Bay...it's $500...not bad but is the extra $300 worth it??

Additionally, the iStar does have an additional mounting space for a 2.5". The Rosewill doesn't according to the specs. I guess I could make a mount?

 

[thepixelgeek]

Awe yeah! First pieces delivered...one good looking board!

 

[Ericloewe]

Ah, it's on its side! All the electrons are going to fall out!

 

[Donny Davis]

48TB usable?

I have 3 retired emc x400s that run freenas like a boss backing my openstack environment. You can pick them up on eBay for a good price and work out of the box. For the most part I can saturate my 10GB network.