SMB performance drops over time on 11.2.U2

keson

Dabbler
Joined
Jan 24, 2019
Messages
12
Team,
I can read several threads about SMB performance issues, but not many seem to be related to 11.2.U2. As I have red that the SMB implementation has changed rapidly in U2, I would perhaps not link this issue to those on older version.

The thing is that when I fresh boot FreeNas and for several days after the restart it seems to do very well, I can see some 70-80 MB/s on RED Was on HP Microserver G10. Quite OK for me I would say. However suddenly the next day I can see only 3-6 MB/s both on writing and reading.

Not sure what it can cause, I see no particular errors, but the speed is slow until next restart. Some shares are available for guests, some not, also using SMB for Time machine, which really does work great. I do not use any other but default permissions. So either owner or goes access scenario so to say. I see no obvious errors in console, no alerts...

Here is a bit from my SMB configuration, affects basically all shares the same way. Not sure what else shall I post here for better troubleshooting?

[root@freenas ~]# testparm -s
Registered MSG_REQ_POOL_USAGE
Registered MSG_REQ_DMALLOC_MARK and LOG_CHANGED
Load smb config files from /usr/local/etc/smb4.conf
Processing section "[Archiv]"
Processing section "[Deti]"
Processing section "[Filmy]"
Processing section "[Hudba]"
Processing section "[Knihy]"
Processing section "[Satelit]"
Processing section "[TimeMachinePetrSMB]"
Processing section "[TimemachineradkaSMB]"
Processing section "[homes]"
Loaded services file OK.
Server role: ROLE_STANDALONE

# Global parameters
[global]
deadtime = 15
disable spoolss = Yes
dns proxy = No
dos charset = CP437
hostname lookups = Yes
kernel change notify = No
lm announce = Yes
load printers = No
logging = file
map to guest = Bad User
max log size = 51200
max open files = 218918
netbios aliases = FREENAS
nsupdate command = /usr/local/bin/samba-nsupdate -g
obey pam restrictions = Yes
panic action = /usr/local/libexec/samba/samba-backtrace
printcap name = /dev/null
security = USER
server min protocol = SMB2_02
server role = standalone server
server string = FreeNAS Server na Srubu
time server = Yes
workgroup = SRUB
idmap config *: range = 90000001-100000000
idmap config * : backend = tdb
acl allow execute always = Yes
create mask = 0666
directory mask = 0777
directory name cache size = 0
dos filemode = Yes
strict locking = No


[Archiv]
path = "/mnt/tank/Archiv"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[Deti]
guest ok = Yes
path = "/mnt/tank/Deti"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[Filmy]
path = "/mnt/tank/Movies"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[Hudba]
guest ok = Yes
path = "/mnt/tank/Music"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[Knihy]
guest ok = Yes
path = "/mnt/tank/Books"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[Satelit]
guest ok = Yes
path = "/mnt/tank/Satelit"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream


[TimeMachinePetrSMB]
path = "/mnt/tank/TMPetr"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:volume_uuid = a5d9226e-be85-4a9b-a72d-de0f5e36bb3e
fruit:time machine = yes
fruit:resource = stream
fruit:metadata = stream


[TimemachineradkaSMB]
path = "/mnt/tank/TMRadka"
read only = No
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:volume_uuid = 52317f07-1aee-4579-958c-75b5db0f9b3f
fruit:time machine = yes
fruit:resource = stream
fruit:metadata = stream


[homes]
browseable = No
comment = Domaci slozky
path = "/mnt/tank/Homes/%U"
read only = No
valid users = %U
veto files = /.snapshot/.windows/.mac/.zfs/
vfs objects = zfs_space zfsacl fruit streams_xattr
zfsacl:acesort = dontcare
nfs4:chown = true
nfs4:acedup = merge
nfs4:mode = special
fruit:resource = stream
fruit:metadata = stream
[root@freenas ~]#
 

keson

Dabbler
Joined
Jan 24, 2019
Messages
12
Hi,
didn't find any pattern so far. Unfortunately yesterday due to storm I switched off the server to prevent data loss from dying UPS so now the server is again freshly started and delivers full performance. As I am not that strong with linux troubleshooting, I would appreciate any kind of advice what to measure and what to deliver for testing. If there is anything you can think off I shall check or monitor, I will do that.
 

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12
I believe we are possibly experiencing the same issue. We use our FreeNAS for backing up a mix of Windows and Linux machines via SMB shares. In fact, that is all it is used for. Every 5 to 7 days the SMB service goes sideways and the machine becomes unresponsive. The console shows swap errors, and we then have to do a hard shutdown. Logs give no useful information, and I NEVER see any swap being used at all while I'm watching. That is the troubling part.

Anyways, just wanted to see if anyone else is having this issue. I just reverted back to 11.2 ( first release), as we never experienced this before the last 2 updates. I will see if this fixes the issue.
 

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12
Just wanted to follow up on this after rolling back to version 11.2 (first release). It has definitely solved the issue. We have been up for well over a week without any issues. There is definitely something wrong with SMB on the most current release.
 
Joined
Jan 4, 2014
Messages
1,644
@dschuett Are you also using a HP Microserver Gen10? If not, what constitutes your FreeNAS hardware?
 

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12
@dschuett Are you also using a HP Microserver Gen10? If not, what constitutes your FreeNAS hardware?
1x SUPERMICRO SuperChassis CSE-846TQ-R900B Black 4U Rackmount Server Case
1x SUPERMICRO MBD-X10SRL-F Server Motherboard LGA 2011 R3
1x Intel Xeon E5-1620 V4 Broadwell-EP 3.5 GHz LGA 2011-3 140W BX80660E51620V4
4x Hynix HMA42GR7MFR4N-TF 16GB DDR4-2133 2Rx4 ECC REG
3x LSI LSI00301 (9207-8i) PCI-Express 3.0 x8 Low Profile SATA / SAS Host Controller Card
24x WD Red 8TB NAS Hard Disk Drive - 5400 RPM Class SATA 6Gb/s 128MB Cache 3.5 Inch - WD80EFZX
 

anodos

Sambassador
iXsystems
Joined
Mar 6, 2014
Messages
9,545
Can you try disabling samba's AIO. This must be done on a per-share basis by adding the following as auxiliary parameters:
Code:
aio write size = 0
aio read size = 0
 

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12
Can you try disabling samba's AIO. This must be done on a per-share basis by adding the following as auxiliary parameters:
Code:
aio write size = 0
aio read size = 0
I would gladly do this, but I don't know if I can afford to upgrade to test it.
 

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12

dschuett

Dabbler
Joined
Mar 13, 2019
Messages
12
Joined
Jan 4, 2014
Messages
1,644
Joined
Jan 4, 2014
Messages
1,644
@keson Is the SMB performance issue present for both Windows and Mac clients? Why I ask is because I'm a Windows shop with HP Microservers and haven't noticed the issues described in this thread with FreeNAS 11.2-U2.1 at all.
 

keson

Dabbler
Joined
Jan 24, 2019
Messages
12
@keson Is the SMB performance issue present for both Windows and Mac clients? Why I ask is because I'm a Windows shop with HP Microservers and haven't noticed the issues described in this thread with FreeNAS 11.2-U2.1 at all.
Morning,
We are at home solely Mac/Linux users so no Windows tests. I do use it 95% from Mac. As I was installing UPS, I had to restart the NAS several times in past 2 weeks, I do not have long running system enough to tell, but so far after 3 days it seems the speed is still OK, I am on 11.2-U3 so fingers crossed.
 
Top