Good evening TrueNAS afficionados,
This may have been approached from another angle, but if so I didn't see it.
I have a TrueNAS 12 configured on a chassis with E5 processor, 128 GB RAM, 9 SAS drives in a zraid 3, and 500 gb SSD ZIL, backing a production virtual machine cluster on a 10 gbit dedicated storage network.
With one vm, I can push about 1.3 GB/ second across the wire ... For about 4.5 seconds, then the VM crashes for a drive fault.
As near as I can tell, I am pushing data across the wire about 3 times as fast as the SSD for the ZIL will take it, so the RAM cache fills up as the ZIL operations queue up, and the VM chokes. I observe the drive spikes to 100% busy under that load (no kidding).
What are some options for speeding up the ZIL? I aim to eventually hit 40 gbit throughput, but even a moderate (4x) increase in the ZIL performance to 2GB/s for sustained writes would be great.
I have seen some SSD's that advertise write speed up to 3GB/S. Would this give me the throughout for sustained writes performance that I am looking for? Or are there other bottlenecks I need to be looking at first?
This may have been approached from another angle, but if so I didn't see it.
I have a TrueNAS 12 configured on a chassis with E5 processor, 128 GB RAM, 9 SAS drives in a zraid 3, and 500 gb SSD ZIL, backing a production virtual machine cluster on a 10 gbit dedicated storage network.
With one vm, I can push about 1.3 GB/ second across the wire ... For about 4.5 seconds, then the VM crashes for a drive fault.
As near as I can tell, I am pushing data across the wire about 3 times as fast as the SSD for the ZIL will take it, so the RAM cache fills up as the ZIL operations queue up, and the VM chokes. I observe the drive spikes to 100% busy under that load (no kidding).
What are some options for speeding up the ZIL? I aim to eventually hit 40 gbit throughput, but even a moderate (4x) increase in the ZIL performance to 2GB/s for sustained writes would be great.
I have seen some SSD's that advertise write speed up to 3GB/S. Would this give me the throughout for sustained writes performance that I am looking for? Or are there other bottlenecks I need to be looking at first?