Fast Copy from NAS but Slow Write to NAS

[Cytomax]

UPDATED 8-27-17
I finally had some free time and freshly reformatted and installed FreeNAS on my NAS and Ubuntu Mate on the client but still no change.

Hello all

MAIN QUESTION
_____________________________________
After getting rid of the onboard stuff and installing the new Intel Network cards on the NAS and the client and getting a new switch and placing it a few feet from the NAS and Client with new cables i am now transferring and writing at around 40 megaBYTES per second and it doesnt matter the size of the file which is much better than before but still kinda slow transfer speeds than i was hoping.
_______________________________________

EXTRA INFORMATION
--------------------------------------------------------
Iperf shows nearly 1 gigabit per second speeds both ways

I dont know where to start troubleshooting

Im using SMB protocol for the share.

SPECS

Network is all wired for 1 Gigabit with cables and switches and router
Desktop and FreeNAS are on the same SWITCH which is a Netgear GS108

Switch: Netgear GS108

FreeNAS
OS: FreeNAS-11.0-U2 (up to date)
Motherboard: MSI FM2-A55M-E33
https://www.msi.com/Motherboard/FM2-A55M-E33.html
CPU: Phenom II X6 1045T
RAM: 8 Gigs of DDR3 ECC
Hard Drive: 6 TB RED WD Drives X 2 in RAID 1 ..... 1.7 Terrabytes used with around 3.7 available.
Network Card: Intel PWLA8391GT Desktop Adapter PRO/1000 GT 10/100/1000Mbps PCI 1 x RJ45

DESKTOP (Client)
OS: Ubuntu Mate 16.04.3 (up to date)
Motherboard: M4A78T-E
https://www.asus.com/us/Motherboards/M4A78TE/
CPU: Phenom(tm) II X4 980 Processor
RAM: 12 Gigs of DDR3
Hard Drive: Crucial® 250 Gig MX200 SSD with 555 Sequential Read and 500 Sequential Write
http://www.crucial.com/wcsstore/Cru...crucial-mx200-ssd-product-flyer-letter-en.pdf
Network Card: Intel PWLA8391GT Desktop Adapter PRO/1000 GT 10/100/1000Mbps PCI 1 x RJ45


Here is the following from iperf

NAS 192.168.0.11
Desktop 192.168.0.101

DESKTOP connected to NAS

Code:

eddie@COMPUTER-101:~$ iperf -c 192.168.0.11
------------------------------------------------------------
Client connecting to 192.168.0.11, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.101 port 39592 connected with 192.168.0.11 port 5001
[ ID] Interval	   Transfer	 Bandwidth
[  3]  0.0-10.0 sec   974 MBytes   817 Mbits/sec

NAS connected to DESKTOP

Code:

[root@freenas] ~# iperf -c 192.168.0.101
------------------------------------------------------------
Client connecting to 192.168.0.101, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.11 port 27111 connected with 192.168.0.101 port 5001
[ ID] Interval	   Transfer	 Bandwidth
[  3]  0.0-10.0 sec  1.09 GBytes   932 Mbits/sec

--------------------------------------------------------------

Any suggestions?

Thanks in Advance

 

[Jailer]

Hmmm, 2 AMD systems. I'm betting on Relatek NIC's being the source of the problem. Of course we don't know because you didn't list what motherboard your running on either system.

 

[Cytomax]

Thank you for the response i hope this helps
i dont really know how to trouble shoot software issues im more of a hardware person
Since the iperf shows no issues going both ways ... maybe its a smb protocol issue?

FreeNAS
https://www.asus.com/Motherboards/M4A78LTM_LE/specifications/
ASUS M4A78LT-M LE
AMD® 760G/SB710
lspci shows
02:00.0 Ethernet controller: Qualcomm Atheros AR8131 Gigabit Ethernet (rev c0)

My Desktop
https://www.asus.com/Motherboards/M4A78TE/specifications/
ASUS M4A78T-E
AMD 790GX/SB750
lspci shows
03:00.0 Ethernet controller: Qualcomm Atheros AR8121/AR8113/AR8114 Gigabit or Fast Ethernet (rev b0)

 

[Spearfoot]

Hello all

Basic problem is i can copy from my NAS to my Desktop nearly 1 gigaBIT per second

When writing from Desktop to NAS my speed is around 2 MegaBYTES per second

Desktop to NAS write speeds used to be MUCH faster but tanked after some update during late 9.3 or early 9.10 i never felt like trouble shooting until now when i need to transfer large amounts of data.

Iperf shows nearly 1 gigabit per second speeds both ways

I dont know where to start troubleshooting

Im using SMB protocol for the share.

SPECS

Network is all wired for 1 Gigabit with cables and switches and router
Desktop and FreeNAS are on the same SWITCH

FreeNAS
Phenom II X6 1045T
8 Gigs of RAM ECC
FreeNAS-9.10.2-U1
6 TB RED WD Drives X 2 in RAID 1 ..... 1.7 Terrabytes used with around 3.7 available.
1 GBPS NIC

Desktop
Ubuntu Mate 16.04
Phenom(tm) II X4 980 Processor
SSD Drive 120 GB

Here is the following from iperf

NAS 192.168.0.11
Desktop 192.168.0.101

DESKTOP connected to NAS

Code:

eddie@COMPUTER-101:~$ iperf -c 192.168.0.11
------------------------------------------------------------
Client connecting to 192.168.0.11, TCP port 5001
TCP window size: 85.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.101 port 39592 connected with 192.168.0.11 port 5001
[ ID] Interval	   Transfer	 Bandwidth
[  3]  0.0-10.0 sec   974 MBytes   817 Mbits/sec

NAS connected to DESKTOP

Code:

[root@freenas] ~# iperf -c 192.168.0.101
------------------------------------------------------------
Client connecting to 192.168.0.101, TCP port 5001
TCP window size: 32.5 KByte (default)
------------------------------------------------------------
[  3] local 192.168.0.11 port 27111 connected with 192.168.0.101 port 5001
[ ID] Interval	   Transfer	 Bandwidth
[  3]  0.0-10.0 sec  1.09 GBytes   932 Mbits/sec

Any suggestions?

Thanks in Advance

Hmmm... your iperf results suggest your network setup is okay.

Did you try the SMB/CIFS tuning suggestions in this post? In particular, "#4 Disable DOS attributes"?

https://forums.freenas.org/index.php?threads/cifs-directory-browsing-slow-try-this.27751/

 

[Cytomax]

Thank you for the suggestion...
for some reason i already had these settings in there

store dos attributes = no
ea support = no
map archive = no
map hidden = no
map system = no
map readonly = no

i dont remember ever putting them in but then again this system is at least a year old.....

Any other test i should run to try and isolate the problem.. maybe use a different protocol ?

 

[Cytomax]

I am going to UPDATE my original post to reflect this information.

After some additional testing.

Using SMB Protocol and writing TO the FreeNAS Server

Files < 2 GigaBYTES work great

Files 4 GigaBYTES and greater i get 1 MegaBYTE per second


I created a NFS Share and BAM
i get write speeds of 137 MegaBYTES per second

apparently there is something wrong with my SMB protocol when writing to the FreeNAS box

 

[SweetAndLow]

137MB seems to high of a number especially after seeing your iperf results. How are you measuring this?

You should be using dd to test your performance. When copying files it's probably your client HDD that is slow.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

I didn't use any tools...
My client HDD is a SSD from corsair 120 gigs i forgot the model...
Using smb transferring under 2 gig files to FreeNAS is fast...
4 gigs and plus is VERY slow 1 megabyte per second....

I setup a NFS share and it was freaking blazing! 4 gig file transfer in around 30 seconds

 

[gpsguy]

IIRC, you never told us what CPU you are using, nor how much RAM you have in your FreeNAS server.

 

[Cytomax]

My original post is very lengthy but it's all in there client and server specs.... and I think with my basic testing it shows there is an issue with smb and writing large files because NFS is working great.... I don't know what else to do from this point though... would logs help?

 

[SweetAndLow]

My original post is very lengthy but it's all in there client and server specs.... and I think with my basic testing it shows there is an issue with smb and writing large files because NFS is working great.... I don't know what else to do from this point though... would logs help?

I told you what to do already and you didn't do it. Test with dd to get accurate results.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

I'll try that when I get home ty

 

[rs225]

This sounds like a problem in either the SMB/CIFS code on the server, or the SMB/CIFS code on the client.(Or a problem when the two get together). I also assume that you mean that the speed is consistently slow on the 4GB file? It doesn't suddenly slow down mid-way?

Given that this problem doesn't seem to be widely reported, I would first suspect the client has a problem.

 

[Cytomax]

The speed is consistently slow on the 4GB or larger file transfer when using smb only when writing to the FreeNAS ... copying from FreeNAS to client is fast for any file size.... writing to FreeNAS is fast for files 2 gigs or less and very slow consistently for 4GB and larger file sizes..

Using NFS seems to be fine.

 

[Cytomax]

I just totally nuked and paved my Ubuntu Mate 16.10 and went to Ubuntu Mate 16.04 and i still have the same problem

Here are my results from the dd test so it looks like my FreeNAS hardware is doing finen

Why do i have a pathetic write transfer of aroud 1 MB/s from my SSD on my Ubuntu Mate 16.04 to my FreeNAS with files 4 gigs and larger using SMB only.

[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/windowsset/ddfile bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 14.408027 secs (1455544173 bytes/sec)

[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/windowsset/ddfile bs=2048k count=20000
20000+0 records in
20000+0 records out
41943040000 bytes transferred in 29.627807 secs (1415664688 bytes/sec)

[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/windowsset/ddfile bs=4096k count=20000
20000+0 records in
20000+0 records out
83886080000 bytes transferred in 70.631428 secs (1187659408 bytes/sec)

Are there any log file i can pull that may be of help to someone?

My next step may be to try and use a fresh USB stick and setup FreeNAS again from scratch.
If i do this what exactly will i lose as far as configuration files go?


Thanks in Advance
Eddie

 

[SweetAndLow]

Your dd tests are invalid. You need to run them on a dataset without compression.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

Will do...thank you.
Are my parameters for running dd correct anything specific you want to see using bs and count
Using
6 TB RED WD Drives X 2 in RAID 1..
TIA

 

[Cytomax]

I created dataset nocompression without compression
[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/nocompression/ddfile bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 176.017005 secs (119144852 bytes/sec)
[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/nocompression/ddfile bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes transferred in 151.856502 secs (138100903 bytes/sec)
[root@freenas] ~# dd if=/dev/zero of=/mnt/volume/nocompression/ddfile bs=2048k count=20000
20000+0 records in
20000+0 records out
41943040000 bytes transferred in 316.552424 secs (132499507 bytes/sec)

 

[SweetAndLow]

Now on run the same test from your Ubuntu machine. Mount FreeNAS using mount -t cifs -o username=(user), password=(password),uid=(local uid),gid=(local gid) \\\\freenas\share /mnt/share

I think that command will work I did made it off the top of my head so who knows.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

This might be painful obvious to some but i am pretty new at using GNU/Linux and FreeNAS

I have already mounted my smb share by editing /etc/fstab

//192.168.0.11/windowsshare /media/windowsshare cifs username=XXXX,password=XXXXX,iocharset=utf8,sec=ntlm 0 0

is this the same thing as what you want me to do by using

mount -t cifs -o username=(user), password=(password),uid=(local uid),gid=(local gid) \\\\freenas\share /mnt/share


Thanks for taking the time to help