Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.

Read/Write speed drops to 0

Joined
Jul 28, 2019
Messages
5
Thanks
0
#1
  • Motherboard: SuperMicro X9DBL
  • CPU: Intel Xeon E5 2470v2
  • RAM: 6x 16 GB Samsung DDR3 ECC 1666
  • Boot: 2x USB mirror 64Gb
  • Hard drives: 5x Seagate IronWolf 4TB RAIDZ2

So my problem with dropping read/write, network is 1Gbit, so sometimes it runs 100Mb/s and then could drops to 0, as you can see on screenshot, this is full range from 0 to 100Mb/s speed. Same thing happen via FTP, i already check.
So my question is: could ZFS or Freenas write some logs on system drive (usb pen drive my case)?
Turns out that this USB stick is very slow (system start up takes 10 minutes) and when i check "reporting" page in freeNas UI, in time of pool disk usage, there is system drive usage with write as well (screen 2).
I will move system to SSD but now iam not sure that it helps.
So could very slow system disk affect read/write pool performance?
 

Attachments

dlavigne

Storage Engineering
Administrator
Moderator
iXsystems
Joined
May 24, 2011
Messages
11,644
Thanks
1,017
#2
Post the full output of ifconfig (within code tags).

Also, anything related in /var/log/messages when the speed drops?
 
Joined
Jul 28, 2019
Messages
5
Thanks
0
#3
Post the full output of ifconfig (within code tags).

Also, anything related in /var/log/messages when the speed drops?
Here is ifconfig
em0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 150 0
options=2098<VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC>
ether 00:25:90:92:f5:da
hwaddr 00:25:90:92:f5:da
inet 192.168.1.44 netmask 0xffffff00 broadcast 192.168.1.255
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect (1000baseT <full-duplex>)
status: active
em1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
options=209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC >
ether 00:25:90:92:f5:db
hwaddr 00:25:90:92:f5:db
nd6 options=9<PERFORMNUD,IFDISABLED>
media: Ethernet autoselect
status: no carrier
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384
options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>
inet6 ::1 prefixlen 128
inet6 fe80::1%lo0 prefixlen 64 scopeid 0x3
inet 127.0.0.1 netmask 0xff000000
nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>
groups: lo
tap0: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 15 00
description: Attached to docker
options=80000<LINKSTATE>
ether 00:bd:ee:8d:f8:00
hwaddr 00:bd:ee:8d:f8:00
nd6 options=1<PERFORMNUD>
media: Ethernet autoselect
status: active
groups: tap
Opened by PID 4485
bridge0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
ether 02:70:45:7a:40:00
nd6 options=1<PERFORMNUD>
groups: bridge
id 00:00:00:00:00:00 priority 32768 hellotime 2 fwddelay 15
maxage 20 holdcnt 6 proto rstp maxaddr 2000 timeout 1200
root id 00:00:00:00:00:00 priority 32768 ifcost 0 port 0
member: tap1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 9 priority 128 path cost 2000000
member: vnet0:3 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 8 priority 128 path cost 2000
member: vnet0:2 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 7 priority 128 path cost 2000
member: vnet0:1 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 6 priority 128 path cost 2000
member: em0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 1 priority 128 path cost 20000
member: tap0 flags=143<LEARNING,DISCOVER,AUTOEDGE,AUTOPTP>
ifmaxaddr 0 port 4 priority 128 path cost 2000000
vnet0:1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: associated with jail: mediadwnld as nic: epair0b
options=8<VLAN_MTU>
ether 00:25:90:1d:af:e6
hwaddr 02:2f:d0:00:06:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
groups: epair
vnet0:2: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: associated with jail: plex as nic: epair0b
options=8<VLAN_MTU>
ether 00:25:90:14:fa:09
hwaddr 02:2f:d0:00:07:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
groups: epair
vnet0:3: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 1500
description: associated with jail: rslsync as nic: epair0b
options=8<VLAN_MTU>
ether 00:25:90:51:f4:ac
hwaddr 02:2f:d0:00:08:0a
nd6 options=1<PERFORMNUD>
media: Ethernet 10Gbase-T (10Gbase-T <full-duplex>)
status: active
groups: epair
tap1: flags=8943<UP,BROADCAST,RUNNING,PROMISC,SIMPLEX,MULTICAST> metric 0 mtu 15 00
description: Attached to boinc
options=80000<LINKSTATE>
ether 00:bd:47:67:98:01
hwaddr 00:bd:47:67:98:01
nd6 options=1<PERFORMNUD>
media: Ethernet autoselect
status: active
groups: tap
Opened by PID 23809


In messages i also don't see anything suspicious
Sep 11 00:00:00 freenas syslog-ng[2695]: Configuration reload request received, reloading configuration;
Sep 11 00:00:00 freenas syslog-ng[2695]: Configuration reload finished;
Sep 11 00:30:02 freenas tap1: Ethernet address: 00:bd:47:67:98:01
Sep 11 00:30:02 freenas kernel: tap1: promiscuous mode enabled
Sep 11 00:30:12 freenas kernel: tap1: link state changed to UP
Sep 11 00:30:12 freenas kernel: tap1: link state changed to UP
Sep 11 00:39:23 freenas ahcich0: Timeout on slot 18 port 0
Sep 11 00:39:23 freenas ahcich0: is 00000000 cs 00040000 ss 00000000 rs 00040000 tfd d0 serr 00000000 cmd 0004d217
Sep 11 00:39:28 freenas ahcich2: Timeout on slot 0 port 0
Sep 11 00:39:28 freenas ahcich2: is 00000000 cs 00000001 ss 00000000 rs 00000001 tfd c0 serr 00000000 cmd 0004c017


I also updated system to SSD, and problem still exist however it become less painful, now i could upload for example 15Gb with 100Mb/s and then suddenly it completely stops, speed 0, then 3-4 seconds its run up to 10Mb then 70, then after 30-40 seconds could be again 100kb. Completely random, can't find any pattern, not from size not from time.
 

dlavigne

Storage Engineering
Administrator
Moderator
iXsystems
Joined
May 24, 2011
Messages
11,644
Thanks
1,017
#4
If you decide to report this at bugs.ixsystems.com, post the issue number here.
 
Top