So I have been up and running with freenas storage system hosted on a VM server (drive passthrough so direct connection on storage to freenas) and no issues for 7+ months. A month ago, I noticed movie play back was acting up and since then I have gone to town with changing settings (hopefully changing back) and actually have left off with autotune turned on. The one constant is all of this is the horrible 1.17MB read and 1.18MB/sec write (CIFS based on the NAS Performance tester 1.4). I have watched FTP transfer and it appears to be just as slow (though no official measurement numbers). As an FYI: I have updated zfs version to 28 and have done a ZFS scrub.
I really am at a loss as to why such a horrible performance on something that has been working decently for so long and not sure at all any steps to take except maybe create another storage pool (ufs) and copy everything over and ditch using zfs.
the esxi server shows no signs of bottlenecks (not the main box or the specific vm) and having all other vms turned off (freenas only hosts data, no vms) doesn't change anything.
Thanks for reading this and any thoughts you could share!!!
Here is some information on my freenas system (not sure what will be helpful)
Build :FreeNAS-8.3.0-RELEASE-x64 (r12701M)
Platform: Intel(R) Core(TM) i5 CPU 760 @ 2.80GHz
Memory: 10224MB
System Time: Wed Dec 26 13:01:19 PST 2012
Uptime: 1:01PM up 26 mins, 0 users
Load Average: 0.25, 0.11, 0.04
Name Serial Description Transfer Mode HDD Standby Advanced Power Mgmt Acoustic Level Enable S.M.A.R.T. S.M.A.R.T. Extra Options
da1 ML4220F3153AKK Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da2 ML4220F3153J6K Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da3 ML4220F3153J8K Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da4 ML4220F31569VK Member of nas1 raidz Auto Always On Disabled Disabled TRUE
nas1 /mnt/nas1 4.0 TiB (76%) 1.2 TiB 5.2 TiB HEALTHY
zdb -U /data/zfs/zpool.cache | grep ashift
ashift: 12
Reporting
System Load:
1 min .07 Avg
5 min .07 Avg
15 min .04 Avg
CPU: never gets to 60
Swap Utilization: 8GB freee
Physical mem utilization: Active doesn't cross 1GB
Fragmentation: .7 and .1 % (not sure the commands to see so not sure which refers to the system drive vs the storage) but either way, very low number
CIFS Settings
Authentication Model: Anonymous
DOS charset: CP437
UNIX charset: UTF-8
Log level: Minimum
Local Master: UNchecked
Time Server for Domain: UNchecked
Guest account: guest
File mask: empty
Directory mask: empty
Large RW support: checked
Send files with sendfile(2): checked
EA Support: UNchecked
Support DOS File Attributes: checked
Allow Empty Password: checked
Auxiliary parameters: empty
Enable home directories: UNchecked
Enable home directories browsing: UNchecked
Home directories: empty
Homes auxiliary parameters: empty
Unix Extensions: checked
Enable AIO: UNchecked
Minimum AIO read size: 4096
Minimum AIO write size: 4096
Zeroconf share discovery: checked
Hostnames lookups: checked
I really am at a loss as to why such a horrible performance on something that has been working decently for so long and not sure at all any steps to take except maybe create another storage pool (ufs) and copy everything over and ditch using zfs.
the esxi server shows no signs of bottlenecks (not the main box or the specific vm) and having all other vms turned off (freenas only hosts data, no vms) doesn't change anything.
Thanks for reading this and any thoughts you could share!!!
Here is some information on my freenas system (not sure what will be helpful)
Build :FreeNAS-8.3.0-RELEASE-x64 (r12701M)
Platform: Intel(R) Core(TM) i5 CPU 760 @ 2.80GHz
Memory: 10224MB
System Time: Wed Dec 26 13:01:19 PST 2012
Uptime: 1:01PM up 26 mins, 0 users
Load Average: 0.25, 0.11, 0.04
Name Serial Description Transfer Mode HDD Standby Advanced Power Mgmt Acoustic Level Enable S.M.A.R.T. S.M.A.R.T. Extra Options
da1 ML4220F3153AKK Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da2 ML4220F3153J6K Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da3 ML4220F3153J8K Member of nas1 raidz Auto Always On Disabled Disabled TRUE
da4 ML4220F31569VK Member of nas1 raidz Auto Always On Disabled Disabled TRUE
nas1 /mnt/nas1 4.0 TiB (76%) 1.2 TiB 5.2 TiB HEALTHY
zdb -U /data/zfs/zpool.cache | grep ashift
ashift: 12
Reporting
System Load:
1 min .07 Avg
5 min .07 Avg
15 min .04 Avg
CPU: never gets to 60
Swap Utilization: 8GB freee
Physical mem utilization: Active doesn't cross 1GB
Fragmentation: .7 and .1 % (not sure the commands to see so not sure which refers to the system drive vs the storage) but either way, very low number
CIFS Settings
Authentication Model: Anonymous
DOS charset: CP437
UNIX charset: UTF-8
Log level: Minimum
Local Master: UNchecked
Time Server for Domain: UNchecked
Guest account: guest
File mask: empty
Directory mask: empty
Large RW support: checked
Send files with sendfile(2): checked
EA Support: UNchecked
Support DOS File Attributes: checked
Allow Empty Password: checked
Auxiliary parameters: empty
Enable home directories: UNchecked
Enable home directories browsing: UNchecked
Home directories: empty
Homes auxiliary parameters: empty
Unix Extensions: checked
Enable AIO: UNchecked
Minimum AIO read size: 4096
Minimum AIO write size: 4096
Zeroconf share discovery: checked
Hostnames lookups: checked