Slow SMB Transfer Speeds Around 5MB/s

Status
Not open for further replies.
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
Does anyone have any idea why I am getting pool SMB transfer speeds in the region of 5MB/s?

Currently only using the 1GbE links in the server for SMB but I will be migrating to the 10GbE links fairly soon when my new 10GbE switch arrives for my home lab so I need to resolve this speed issue asap. upload_2017-6-12_15-42-34.png

Build FreeNAS-9.10.2-U5 (561f0d7a1)
Server Dell PowerEdge R810 + LSI SAS HBA 9200-8e + Dell MD 1220 + Dell MD 1200
Platform 4 x Intel(R) Xeon(R) CPU E7- 4870 @ 2.40GHz
Memory 32 x 16GB = 524245MB
Network 4 x 1GbE in LACP to Cisco WS-C3750E-48PD-E

zpool status Data
pool: Data
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
Data ONLINE 0 0 0
raidz1-0 ONLINE 0 0 0
gptid/a8bda634-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/aa2294ea-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/ab9533d7-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/acffdc9d-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
gptid/ae5b709d-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/afcf884f-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/b149dad7-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0
gptid/b2c59ae4-3cb6-11e7-9ea4-d067e5f9fc4b ONLINE 0 0 0

upload_2017-6-12_15-42-34.png
 
anodos

anodos

Sambassador
iXsystems
Joined
Mar 6, 2014
Messages
9,554
Has the speed dropped to 5MB/s or is this new behavior?
What does /usr/local/etc/smb4.conf look like?
Anything in /var/log/samba4/log.smbd?
If you turn off LAGG and use only single gigabit link, does performance improve?
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
This is new behaviour my backup box is still able to saturate 1GbE both read and write and it has way less resources.

Build FreeNAS-9.10.2-U5 (561f0d7a1)
Server Dell PowerEdge R510 + LSI SAS HBA 9211-8i
Platform Intel(R) Xeon(R) CPU X5675 @ 3.07GHz
Memory 8 x 16GB = 131029MB
Network 2 x 1GbE in LACP to Cisco WS-C3750E-48PD-E

upload_2017-6-12_15-50-36.png
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
tail log.smbd | grep error = NO RESULTS

SMB4.CONF

[global]
server min protocol = SMB3
server max protocol = SMB3_11
interfaces = 127.0.0.1 192.168.1.203
bind interfaces only = yes
encrypt passwords = yes
dns proxy = no
strict locking = no
oplocks = yes
deadtime = 15
max log size = 51200
max open files = 15098240
logging = file
load printers = no
printing = bsd
printcap name = /dev/null
disable spoolss = yes
getwd cache = yes
guest account = nobody
map to guest = Bad User
obey pam restrictions = yes
directory name cache size = 0
kernel change notify = no
panic action = /usr/local/libexec/samba/samba-backtrace
nsupdate command = /usr/local/bin/samba-nsupdate -g
server string = FreeNAS Server
ea support = yes
store dos attributes = yes
lm announce = yes
hostname lookups = yes
time server = yes
acl allow execute always = true
dos filemode = yes
multicast dns register = yes
domain logons = no
local master = yes
idmap config *: backend = tdb
idmap config *: range = 90000001-100000000
server role = standalone
netbios name = FREENAS
workgroup = WORKGROUP
security = user
pid directory = /var/run/samba
create mask = 0666
directory mask = 0777
client ntlmv2 auth = yes
dos charset = CP437
unix charset = UTF-8
log level = 1
ea support = no
store dos attributes = no
map archive = no
map hidden = no
map readonly = no
map system = no
 
anodos

anodos

Sambassador
iXsystems
Joined
Mar 6, 2014
Messages
9,554
Post the /var/log/samba4/log.smbd. Depending on what's going on in your system, the last 10 lines of the log won't necessarily contain useful debugging info.
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
CONTENTS OF: /var/log/samba4/log.smbd

[2017/06/12 16:31:06.948002, 1] ../source3/profile/profile_dummy.c:30(set_profile_level)
INFO: Profiling support unavailable in this build.
[2017/06/12 16:31:06.994307, 1] ../source3/smbd/files.c:218(file_init_global)
file_init_global: Information only: requested 15098240 open files, 59392 are available.
[2017/06/12 16:31:07.016924, 0] ../lib/util/become_daemon.c:124(daemon_ready)
STATUS=daemon 'smbd' finished starting up and ready to serve connections
[2017/06/12 16:33:32.098215, 1] ../source3/printing/printer_list.c:234(printer_list_get_last_refresh)
Failed to fetch record!
[2017/06/12 16:33:32.098610, 1] ../source3/smbd/server_reload.c:69(delete_and_reload_printers)
pcap cache not loaded
[2017/06/12 16:33:38.815183, 1] ../source3/printing/printer_list.c:234(printer_list_get_last_refresh)
Failed to fetch record!
[2017/06/12 16:33:38.815510, 1] ../source3/smbd/server_reload.c:69(delete_and_reload_printers)
pcap cache not loaded
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
I have powered off all of my VMs which are running on another pool comprised entirely of SSD and I am going to reboot.
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
Post reboot the transfer speed has NOT changed it is still around 5MB/s
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
I have removed all of the Auto Tune generated Tunabled and turned off Auto Tune and rebooted again.
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
OK, So post reboot with NO Tunables the transfer speed is still around 5MB/s
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
Just building a CentOS box to test NFS performance
 
Spearfoot

Spearfoot

He of the long foot
Moderator
Joined
May 13, 2015
Messages
2,478
@Simon Sparks : Have you run iperf to test the network speed?
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
Its not a network issue, I have 2 FreeNAS boxes connected in exactly the same way and nothing has changed except and upgrade to FreeNAS-9.10.2-U5 which has been fine on 1 box and the other box has decided to become slow....
 
m0nkey_

m0nkey_

MVP
Joined
Oct 27, 2015
Messages
2,739
Spearfoot said:
@Simon Sparks : Have you run iperf to test the network speed?
Click to expand...
Simon Sparks said:
Its not a network issue, I have 2 FreeNAS boxes connected in exactly the same way and nothing has changed except and upgrade to FreeNAS-9.10.2-U5 which has been fine on 1 box and the other box has decided to become slow....
Click to expand...
Best to rule it out anyway. Please post results of iperf.

Edit: While you're at it, please post the output of ifconfig too.
 
SweetAndLow

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Run iperf with lagg enabled.
Run iperf with lagg disabled.
make sure to run it with freenas as the client and as the server, both directions is important.

Saturating a gigabit network is super easy to do, the hardware specs do not matter. Just a single hdd can do it.
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
SHOWING CONTENTS OF: ifconfig - NOTE all SMB is over the lagg0 interface
Code:
bce0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: connected to WS-C3750E-48PD (Gi1/0/9)
		options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
		ether d0:67:e5:f9:fc:4b
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
bce1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: connected to WS-C3750E-48PD (Gi2/0/9)
		options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
		ether d0:67:e5:f9:fc:4b
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
bce2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: connected to WS-C3750E-48PD (Gi2/0/21)
		options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
		ether d0:67:e5:f9:fc:4b
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
bce3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		description: connected to WS-C3750E-48PD (Gi1/0/21)
		options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
		ether d0:67:e5:f9:fc:4b
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (1000baseT <full-duplex>)
		status: active
ix0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		description: connected to WS-C3750E-48PD (Te1/0/1)
		options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
		ether 90:e2:ba:0e:4b:38
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Token ring UTP/100Mbit <full-duplex,flag0,EarlyTokenRelease,Dedicated,Classic> instance 8 (10Gbase-SR <full-duplex,rxpause,txpause>)
		status: active
ix1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		description: connected to WS-C3750E-48PD (Te4/0/2)
		options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
		ether 90:e2:ba:0e:4b:39
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (10Gbase-SR <full-duplex,rxpause,txpause>)
		status: active
ix2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
		ether 90:e2:ba:0e:4e:6c
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect
		status: no carrier
ix3: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		options=e407bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,TSO6,LRO,VLAN_HWTSO,RXCSUM_IPV6,TXCSUM_IPV6>
		ether 90:e2:ba:0e:4e:6d
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect
		status: no carrier
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
		options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
		inet6 ::1 prefixlen 128
		inet6 fe80::1%lo0 prefixlen 64 scopeid 0x9
		inet 127.0.0.1 netmask 0xff000000
		nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
		options=c01bb<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,JUMBO_MTU,VLAN_HWCSUM,TSO4,VLAN_HWTSO,LINKSTATE>
		ether d0:67:e5:f9:fc:4b
		inet 192.168.1.203 netmask 0xffffff00 broadcast 192.168.1.255
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect
		status: active
		laggproto lacp lagghash l2,l3,l4
		laggport: bce0 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
		laggport: bce1 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
		laggport: bce2 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
		laggport: bce3 flags=1c<ACTIVE,COLLECTING,DISTRIBUTING>
vlan40: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		options=303<RXCSUM,TXCSUM,TSO4,TSO6>
		ether 90:e2:ba:0e:4b:38
		inet 10.0.40.1 netmask 0xffffff00 broadcast 10.0.40.255
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Token ring UTP/100Mbit <full-duplex,flag0,EarlyTokenRelease,Dedicated,Classic> instance 8 (10Gbase-SR <full-duplex,rxpause,txpause>)
		status: active
		vlan: 40 parent interface: ix0
vlan41: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
		options=303<RXCSUM,TXCSUM,TSO4,TSO6>
		ether 90:e2:ba:0e:4b:39
		inet 10.0.41.1 netmask 0xffffff00 broadcast 10.0.41.255
		nd6 options=9<PERFORMNUD,IFDISABLED>
		media: Ethernet autoselect (10Gbase-SR <full-duplex,rxpause,txpause>)
		status: active
		vlan: 41 parent interface: ix1
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
Just noticed an un-related issue 1 of my 10GbE links is not showing up correctly.... however the switch thinks its OK...

TenGigabitEthernet1/0/1 is up, line protocol is up (connected)
Code:
Hardware is Ten Gigabit Ethernet, address is 9caf.ca76.41b5 (bia 9caf.ca76.41b5)
  Description: FreeNAS
  MTU 9198 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
	 reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive not set
  Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-SR
  input flow-control is off, output flow-control is unsupported
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:21, output 00:00:00, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 54
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 191000 bits/sec, 5 packets/sec
  5 minute output rate 815000 bits/sec, 43 packets/sec
	 415405688 packets input, 1342698907354 bytes, 0 no buffer
	 Received 280817 broadcasts (271218 multicasts)
	 0 runts, 0 giants, 0 throttles
	 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
	 0 watchdog, 271218 multicast, 51 pause input
	 0 input packets with dribble condition detected
	 911577373 packets output, 1529797787178 bytes, 0 underruns
	 0 output errors, 0 collisions, 1 interface resets
	 0 unknown protocol drops
	 0 babbles, 0 late collision, 0 deferred
	 0 lost carrier, 0 no carrier, 0 pause output
	 0 output buffer failures, 0 output buffers swapped out

TenGigabitEthernet2/0/1 is up, line protocol is up (connected)
  Hardware is Ten Gigabit Ethernet, address is 0022.9028.42b6 (bia 0022.9028.42b6)
  Description: FreeNAS
  MTU 9198 bytes, BW 10000000 Kbit/sec, DLY 10 usec,
	 reliability 255/255, txload 1/255, rxload 1/255
  Encapsulation ARPA, loopback not set
  Keepalive not set
  Full-duplex, 10Gb/s, link type is auto, media type is 10GBase-SR
  input flow-control is off, output flow-control is unsupported
  ARP type: ARPA, ARP Timeout 04:00:00
  Last input 00:00:28, output 00:00:16, output hang never
  Last clearing of "show interface" counters never
  Input queue: 0/75/0/0 (size/max/drops/flushes); Total output drops: 70
  Queueing strategy: fifo
  Output queue: 0/40 (size/max)
  5 minute input rate 209000 bits/sec, 3 packets/sec
  5 minute output rate 653000 bits/sec, 60 packets/sec
	 414567571 packets input, 1344429435127 bytes, 0 no buffer
	 Received 289833 broadcasts (272270 multicasts)
	 0 runts, 0 giants, 0 throttles
	 0 input errors, 0 CRC, 0 frame, 0 overrun, 0 ignored
	 0 watchdog, 272270 multicast, 39 pause input
	 0 input packets with dribble condition detected
	 911978640 packets output, 1529186871057 bytes, 0 underruns
	 0 output errors, 0 collisions, 1 interface resets
	 0 unknown protocol drops
	 0 babbles, 0 late collision, 0 deferred
	 0 lost carrier, 0 no carrier, 0 pause output
	 0 output buffer failures, 0 output buffers swapped out
 
Simon Sparks

Simon Sparks

Explorer
Joined
May 24, 2016
Messages
57
I deleted and re created the vlan40 interface and still the same...

vlan41: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
options=303<RXCSUM,TXCSUM,TSO4,TSO6>
ether 90:e2:ba:0e:4b:39
inet 10.0.41.1 netmask 0xffffff00 broadcast 10.0.41.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (10Gbase-SR <full-duplex,rxpause,txpause>)
status: active
vlan: 41 parent interface: ix1

vlan40: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 9000
options=303<RXCSUM,TXCSUM,TSO4,TSO6>
ether 90:e2:ba:0e:4b:38
inet 10.0.40.1 netmask 0xffffff00 broadcast 10.0.40.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Token ring UTP/100Mbit <full-duplex,flag0,EarlyTokenRelease,Dedicated,Classic> instance 8 (10Gbase-SR <full-duplex,rxpause,txpause>)
status: active
vlan: 40 parent interface: ix0

Does anyone know why this is happening ?
 
Status
Not open for further replies.

Similar threads

L
  • Locked
Slow resilvering speed after replacing second disk
Replies
10
Views
2K
level3
L
Z
  • Locked
Deleting files is extremely slow
Replies
12
Views
11K
wblock
wblock
P
  • Locked
Issue writing via SMB from Macs
Replies
2
Views
2K
phillipsnick
P
NickF
  • Locked
Problem with writes painfully slow on CIFS
Replies
3
Views
804
NickF
NickF
C
  • Locked
SOLVED Slow resilvering speeds
Replies
6
Views
4K
Ericloewe
Ericloewe
Top