damienginty
Dabbler
- Joined
- Jan 23, 2019
- Messages
- 15
We have been running freenas on a Dell PowerEdge R720 for about 18 months. The pool is made up of 47 vdevs (mirrors made up of 600gb 10k sas drives) 14 caches (made up of intel 480gb ssd) and a log made up of an intel p4800 nvme pcie drive.
All of the spinning disks are installed in 4 x dell PV MD1220 each connected to its own HBA (4 x 12dnw flashed with IT FW). The JBODs are operating in split mode offering 2 x SFF-8088 connections to each HBA (8 sas lanes to each JBOD).
All SSDs are installed into the Pe r720 which also has 384 gb ram and 2 x xeon e5-2695 v2 CPUs
The pool is connected to three servers that operate in a MS failover cluster, they connect to freenas via iscsi using 4 x 10gbe connections…….. sync is set to always
The read speeds of the system has never been an issue but the write speeds are sometimes a concern.
Can anything be done to the setup to improve the write speeds? Is the limiting factor the spinning disks? (As they don’t appear to be doing much while simulating 1tb of data being written to the array (see attached))
I have attached a number of crystal disk mark screen shots (sync always and sync disabled from within a VM running from Freenas) that show the performance and a video of iostat while 1tb of data is being copied to the array.
I'm just looking for options into how things can be improved (if at all).
Any help or advice would be very much appreciated.
Sincerely
All of the spinning disks are installed in 4 x dell PV MD1220 each connected to its own HBA (4 x 12dnw flashed with IT FW). The JBODs are operating in split mode offering 2 x SFF-8088 connections to each HBA (8 sas lanes to each JBOD).
All SSDs are installed into the Pe r720 which also has 384 gb ram and 2 x xeon e5-2695 v2 CPUs
The pool is connected to three servers that operate in a MS failover cluster, they connect to freenas via iscsi using 4 x 10gbe connections…….. sync is set to always
The read speeds of the system has never been an issue but the write speeds are sometimes a concern.
Can anything be done to the setup to improve the write speeds? Is the limiting factor the spinning disks? (As they don’t appear to be doing much while simulating 1tb of data being written to the array (see attached))
I have attached a number of crystal disk mark screen shots (sync always and sync disabled from within a VM running from Freenas) that show the performance and a video of iostat while 1tb of data is being copied to the array.
I'm just looking for options into how things can be improved (if at all).
Any help or advice would be very much appreciated.
Sincerely
