ornias
Wizard
- Joined
- Mar 6, 2020
- Messages
- 1,458
After running a year with my first ever home-NAS server hybrid (nicknamed "Dozer"), I finally managed to bring it too its knees a little too often for my taste.
CPU is huring with big transfers (due to zstd) and the 2*3 mirrored disks are more than 80% full.
Being active within the ZSTD community I already know what was comming, so have been preparing for quite some months by now:
I knew I needed a faster CPU for zstd and wanted more disk-slots to use DRaid once it launches. It's a SCALE focused build, with enough processing power to decently run some containers/VM's as well as provide some storage
And above all, it needed to be affortable.
Meet Dozers big brother: Acco. Named after the Acco Super Bulldozer https://en.wikipedia.org/wiki/Acco_super_bulldozer
Save a 1 or 2 parts, everything is finally ordered to start the build.
Case: Inter-Tech IPC 4U-4424 (24 bay, dumb backplane)
Caseaddons: 3x pci-slot 2.5" sata bays
Motherboard: Fujitsu D3643-H
PSU: be quiet! Pure Power 11 400W
PSU: Corsair AX 860i (860W)
CPU: Intel I7 9700 (still waiting for a good deal to show up though)
CPU Cooler: Cryorig H7
RAM: 2x16gb DDR4 (non ECC)
HBA: Dell H310 (flashed to IT mode)
SAS expander: intel res2sv240
NIC: Connectx-3 dual port
OS SSD's: 2x Kingston SSD Now 60gb
Metadata SSD's: 3x Kingston SSD Now 60gb (placeholder)
Future additions (not included in current build or price estimate):
GPU: Nvidia 1660 (Future upgrade for hardware transcoding)
Some QA:
Q: Why go for a port multiplier card?
A: The case was an insanely good deal and a dumb backplane is easier to repair in the future. The expander card can just be replaced without much downtime
Q: Why no ECC
A: Personal preference, sorry I'm not a ecc "believer" for some linux-iso's and quadrouple backuped personal documents.
Q: Is the Connectx-3 stable?
A: It had some issues on 11.3 where it didn't get detected on reboot sometimes. under 12 thats solved and it's rock solid
Q: That motherboard doesn't have enough PCI-E slots!
A: It does, the NIC is going into a 1x slot, i'm happy with that throughput.
Q: But those X1 slots don't fit a connectx-3 card, they are closed
A: There is such a thing called a riser cable and/or a thing called a "file". ;)
Q: That PSU is not enough for the peak power consumption
A: I expect the max 22 harddrives to at most consume 480W at spinup (thats a worst case), which is a little above the recommended load but not too bad. PSU is sized on average expected peak load, not absolute maximum expected load.
Q: Why that CPU?
A; It's not too expensive, I already had the motherboard and it doesn't suffer much from the Intel SMT bugs.
Q: That GPU is never going to fit
A: There exist single slot 1660(ti) cards ;-)
Q: What disk setup are you planning to run?
A: At first I will use a placeholder setup (raidz2 or something), goal is to run DRAID with 3 groups of 7 disks with double parity and 1 hot-spare and a tripple mirror metadatavdev
Q: Those metadata ssd's suck
A: I know, those are going to be replaced someday. Those where just a VERY good deal.
Q: No L2ARC or SLOG?
A: I want to max ram before adding L2ARC and don't really have much need for SLOG at the moment. It's a long-term todo.
Q: You do know you are pushing the limits of your hardware?
A: Ain't that the fun of it? ;)
Q: And what did this thing cost you?
A: 1 kidney and 2 livers.
Okey just kidding, close to 1300 euro's including all cables and shipping expanses.
CPU is huring with big transfers (due to zstd) and the 2*3 mirrored disks are more than 80% full.
Being active within the ZSTD community I already know what was comming, so have been preparing for quite some months by now:
I knew I needed a faster CPU for zstd and wanted more disk-slots to use DRaid once it launches. It's a SCALE focused build, with enough processing power to decently run some containers/VM's as well as provide some storage
And above all, it needed to be affortable.
Meet Dozers big brother: Acco. Named after the Acco Super Bulldozer https://en.wikipedia.org/wiki/Acco_super_bulldozer
Save a 1 or 2 parts, everything is finally ordered to start the build.
Case: Inter-Tech IPC 4U-4424 (24 bay, dumb backplane)
Caseaddons: 3x pci-slot 2.5" sata bays
Motherboard: Fujitsu D3643-H
PSU: Corsair AX 860i (860W)
CPU: Intel I7 9700 (still waiting for a good deal to show up though)
CPU Cooler: Cryorig H7
RAM: 2x16gb DDR4 (non ECC)
HBA: Dell H310 (flashed to IT mode)
SAS expander: intel res2sv240
NIC: Connectx-3 dual port
OS SSD's: 2x Kingston SSD Now 60gb
Metadata SSD's: 3x Kingston SSD Now 60gb (placeholder)
Future additions (not included in current build or price estimate):
GPU: Nvidia 1660 (Future upgrade for hardware transcoding)
Some QA:
Q: Why go for a port multiplier card?
A: The case was an insanely good deal and a dumb backplane is easier to repair in the future. The expander card can just be replaced without much downtime
Q: Why no ECC
A: Personal preference, sorry I'm not a ecc "believer" for some linux-iso's and quadrouple backuped personal documents.
Q: Is the Connectx-3 stable?
A: It had some issues on 11.3 where it didn't get detected on reboot sometimes. under 12 thats solved and it's rock solid
Q: That motherboard doesn't have enough PCI-E slots!
A: It does, the NIC is going into a 1x slot, i'm happy with that throughput.
Q: But those X1 slots don't fit a connectx-3 card, they are closed
A: There is such a thing called a riser cable and/or a thing called a "file". ;)
Q: That PSU is not enough for the peak power consumption
A: I expect the max 22 harddrives to at most consume 480W at spinup (thats a worst case), which is a little above the recommended load but not too bad. PSU is sized on average expected peak load, not absolute maximum expected load.
Q: Why that CPU?
A; It's not too expensive, I already had the motherboard and it doesn't suffer much from the Intel SMT bugs.
Q: That GPU is never going to fit
A: There exist single slot 1660(ti) cards ;-)
Q: What disk setup are you planning to run?
A: At first I will use a placeholder setup (raidz2 or something), goal is to run DRAID with 3 groups of 7 disks with double parity and 1 hot-spare and a tripple mirror metadatavdev
Q: Those metadata ssd's suck
A: I know, those are going to be replaced someday. Those where just a VERY good deal.
Q: No L2ARC or SLOG?
A: I want to max ram before adding L2ARC and don't really have much need for SLOG at the moment. It's a long-term todo.
Q: You do know you are pushing the limits of your hardware?
A: Ain't that the fun of it? ;)
Q: And what did this thing cost you?
A: 1 kidney and 2 livers.
Okey just kidding, close to 1300 euro's including all cables and shipping expanses.
Last edited: