What kind of performance can I expect?

[jbondhus]

Hi all, I'm migrating my current storage (14 TB on a Synology) to FreeNAS because I want better performance and more reliable storage.

With the Synology I can get 110 MB/s maximum (the network maxes out), and I can't install a 10 gigabit card so I can't speed that up for single file transfers. Local benchmarks done on the command line suggest a 150-200 MB/s throughput taking the disks out of the mix, which is unacceptable for me.

I'm hoping for performance around 300-400 MB/s with a 10 gigabit network link. Is that achievable with FreeNAS in a raidz3 configuration?

Below is the system build I have planned.

There are a few things I would like to note about this build.

First, the network equipment isn't in the build sheet since I'm factoring that in separately and I'm still deciding on which equipment to get for that.

Second, there are only 6 drives listed. I have 6 drives of the same size and model already in my Synology. To reduce costs, since those drives are very new and will be sufficient for my needs, I plan to backup my data, initialize the 12 disks in a 36 TB raidz3 configuration, and then restore it.

Third, the 6 core Xeon processor would normally be overkill, but it will be used for Plex and possibly a few other FreeBSD jails.

Fourth, I already have a power supply I'll be using, and the video card I believe is needed because the Xeon processor doesn't have on-board graphics and I need to be able to run a console for the occasional configuration off the network. If this isn't needed I can remove it.

Fifth, I'm going overboard on the storage so that I don't have to worry about running out for a long time and can snapshot my disks regularly without worrying about using up too much space.

My budget for this build is $3,500, but lower is obviously preferred if it gets me the same performance and storage space. For example, I may not need 32 GB of ram, or the video card.

PCPartPicker part list / Price breakdown by merchant

CPU: Intel Xeon E5-2620 V3 2.4GHz 6-Core Processor ($391.95 @ SuperBiiz)
CPU Cooler: Noctua NH-D14 SE2011 CPU Cooler ($78.98 @ Newegg)
Memory: Crucial 16GB (1 x 16GB) DDR4-2133 Memory ($180.99 @ SuperBiiz)
Memory: Crucial 16GB (1 x 16GB) DDR4-2133 Memory ($180.99 @ SuperBiiz)
Storage: Samsung 850 EVO-Series 250GB 2.5" Solid State Drive ($114.99 @ Newegg)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Storage: Western Digital RE 4TB 3.5" 7200RPM Internal Hard Drive ($249.00 @ B&H)
Other: Merlin SM8 Case ($399.95)
Other: SuperMicro MBD-X10SRA-F -B Server Motherboard ($399.99)
Other: IO Crest 4 Port SATA III PCI-e 2.0 x1 Controller Card Marvell Non-Raid with Low Profile Bracket SI-PEX40064 ($33.77)
Total: $3275.61
Prices include shipping, taxes, and discounts when available
Generated by PCPartPicker 2015-03-20 22:35 EDT-0400

 

[anodos]

Get a proper HBA. Save some money by going WD RED.

 

[SweetAndLow]

why a dual proc cpu? I would go with the 1620v3
Motherboard isn't a good chose. Go with the X10SRL
You can save money by choosing wd reds not RE's.
Why do you have a ssd? you can and should install the os on a usb stick or sata dom.
also don't get that Marvell Controller it is probably garbage. Get a proper lsi based HBA card from the recommended hardware list.

with these suggestions you will get a better build and cheaper.

 

[zambanini]

what workload do you expect?

 

[Ericloewe]

You might want to look at an X10SRH-F, since it will already have an appropriate HBA onboard. IPMI includes a basic video adapter that will handle anything a server might need.

The Xeon E5-1650 v3 would be significantly faster and the E5-1620 might be cheaper for similar performance (if you're ok with 8 threads). They're both limited to a single socket, which is clearly not an issue here.
The CPU cooler is also serious overkill here and might not fit in a narrow ILM board. A NH-U12DX i4 might make more sense.