Specs
Running TrueNAS for the first time as a new homelab enjoyer so bear with me... I'm getting performance that starts in the 100+MBps realm and drops to a miserable 10 or less MBps after a few seconds (assuming this is after my RAM stops owning the transfer?). fio results to a 1% full Pool to follow. Hoping to use this for mass storage and getting 50MBps or higher would be great for my needs. Looking for general advice on things I may simply not understand about optimizing TrueNAS. The Pool is only 1% full and I can even re-format if it's in the cards. Much appreciated.
- Chassis/MB
- Dell r730 LFF
- CPU
- 2x E5-2667 v3 @ 3.20GHz (4 threads assigned to TrueNAS Core)
- RAM
- 8GB DDR4 assigned to VM, but can bump this as necessary.
- HDD's
- Proxmox on Raid1 480GB NVME SM953
- TrueNAS Core VM on Raid1 1TB NVME 2280
- Pool = 8x 6TB 7.2k SAS 4K MG04SCA60EA in RAID-Z3
- Hard disk controllers
- Perc H330 Mini Mono in HBA mode (NOT flashed to IT mode).
- Network cards
- Intel I350 GbE
Running TrueNAS for the first time as a new homelab enjoyer so bear with me... I'm getting performance that starts in the 100+MBps realm and drops to a miserable 10 or less MBps after a few seconds (assuming this is after my RAM stops owning the transfer?). fio results to a 1% full Pool to follow. Hoping to use this for mass storage and getting 50MBps or higher would be great for my needs. Looking for general advice on things I may simply not understand about optimizing TrueNAS. The Pool is only 1% full and I can even re-format if it's in the cards. Much appreciated.
Code:
fio --ramp_time=5 --gtod_reduce=1 --numjobs=1 --bs=1M --size=100G --runtime=60s --readwrite=write --name=testfile testfile: (g=0): rw=write, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=1 fio-3.28 Starting 1 process testfile: Laying out IO file (1 file / 102400MiB) Jobs: 1 (f=1): [W(1)][0.2%][w=15.3MiB/s][w=15 IOPS][eta 10h:10m:21s] testfile: (groupid=0, jobs=1): err= 0: pid=70940: Thu Jan 25 18:55:22 2024 write: IOPS=2, BW=3030KiB/s (3103kB/s)(199MiB/67243msec); 0 zone resets bw ( KiB/s): min= 1950, max=27945, per=100.00%, avg=5518.86, stdev=5351.65,samples=69 iops : min= 1, max= 27, avg= 4.57, stdev= 5.38, samples=69 cpu : usr=0.04%, sys=0.26%, ctx=1617, majf=0, minf=1 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,199,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=1 Run status group 0 (all jobs): WRITE: bw=3030KiB/s (3103kB/s), 3030KiB/s-3030KiB/s (3103kB/s-3103kB/s), io=199MiB (209MB), run=67243-67243msec