Fast Copy from NAS but Slow Write to NAS

[SweetAndLow]

This might be painful obvious to some but i am pretty new at using GNU/Linux and FreeNAS

I have already mounted my smb share by editing /etc/fstab

//192.168.0.11/windowsshare /media/windowsshare cifs username=XXXX,password=XXXXX,iocharset=utf8,sec=ntlm 0 0

is this the same thing as what you want me to do by using

mount -t cifs -o username=(user), password=(password),uid=(local uid),gid=(local gid) \\\\freenas\share /mnt/share


Thanks for taking the time to help

Yes they are the same. What results do you get with dd over the network?

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

Ill do it when i get home.... i still havent figured out how to keep WOL persistent after reboot in Linux.. thanks again

 

[Cytomax]

Well here are the results when run on my Desktop

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/home/eddie/Desktop/ddfile bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB, 20 GiB) copied, 73.511 s, 285 MB/s

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/home/eddie/Desktop/ddfile bs=2048k count=20000
20000+0 records in
20000+0 records out
41943040000 bytes (42 GB, 39 GiB) copied, 169.595 s, 247 MB/s

 

[SweetAndLow]

Well here are the results when run on my Desktop

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/home/eddie/Desktop/ddfile bs=1024k count=20000
20000+0 records in
20000+0 records out
20971520000 bytes (21 GB, 20 GiB) copied, 73.511 s, 285 MB/s

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/home/eddie/Desktop/ddfile bs=2048k count=20000
20000+0 records in
20000+0 records out
41943040000 bytes (42 GB, 39 GiB) copied, 169.595 s, 247 MB/s

We don't care about your SSD speed. We want to know how fast you can write and read over the network.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

Well apparently my computer is "special"
it wont write more than 2 Gigs to the FreeNAS Box using DD
My problem is writing around 4 Gigs + to the FreeNAS box... it was transferring 2 Gigs at a time flawlessly

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=512M count=1
1+0 records in
1+0 records out
536870912 bytes (537 MB, 512 MiB) copied, 4.85243 s, 111 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=1024M count=1
1+0 records in
1+0 records out
1073741824 bytes (1.1 GB, 1.0 GiB) copied, 9.79403 s, 110 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=2048M count=1
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 19.1258 s, 112 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=3072M count=1
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 19.2579 s, 112 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=4096M count=1
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 19.0835 s, 113 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=2G count=1
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 19.0768 s, 113 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=3G count=1
0+1 records in
0+1 records out
2147479552 bytes (2.1 GB, 2.0 GiB) copied, 19.1122 s, 112 MB/s

 

[SweetAndLow]

Make your bs=1M and count=5000

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

i was actually experimenting with that.. looks like i am the special one lol
thanks again

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=1024K count=4000
4000+0 records in
4000+0 records out
4194304000 bytes (4.2 GB, 3.9 GiB) copied, 36.4287 s, 115 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=1M count=5000
5000+0 records in
5000+0 records out
5242880000 bytes (5.2 GB, 4.9 GiB) copied, 45.4835 s, 115 MB/s

 

[SweetAndLow]

i was actually experimenting with that.. looks like i am the special one lol
thanks again

eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=1024K count=4000
4000+0 records in
4000+0 records out
4194304000 bytes (4.2 GB, 3.9 GiB) copied, 36.4287 s, 115 MB/s
eddie@Desktop-Eddie:~$ dd if=/dev/zero of=/media/windowsshare/ddfile bs=1M count=5000
5000+0 records in
5000+0 records out
5242880000 bytes (5.2 GB, 4.9 GiB) copied, 45.4835 s, 115 MB/s

Looks like your performance is great. I'm confused why you think there is a problem.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

When i get an ISO file around 4 Gigs and try to transfer the file from my SSD drive on my ubuntu 16.04 to my windowsshare the speed shows 1 MB/s its painful...... however when i write 2 Gig video files to the NAS it moves very quickly.. ill take a screenshot
http://imgur.com/a/Cak9e

Individually each System seems to perform well..
When using the terminal and dd they perform well..
Its only when using the gui to drag and drop a file greater than 3+ gigs that i get issues of writes speeds in the 1 MB... very wierd problem..
im thinking of nuking and paving... unless there is something else you would like to try...
I really do appreciate your help i have learned a lot from trouble shooting with you

 

[SweetAndLow]

Is it only happening when using the GUI? What happens if you use the cli to move the file?

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

havent tried... guess ill figure out the syntax to move stuff and get back to you

 

[Cytomax]

so i used

CP Command
cp 7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso /media/windowsshare/

i found the cp command doesnt show transfer rate

and the command appeared to finish within 30 seconds or so for a 3.2 gig file so its definitely not going 1MB/s its prob going around the standard 100MB/s which is what ive been transferring at....

Rsync Command
eddie@Desktop-Eddie:~/Desktop$ rsync --progress 7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso /media/windowsshare/
7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso
3,166,840,832 100% 231.12MB/s 0:00:13 (xfr#1, to-chk=0/1)
eddie@Desktop-Eddie:~/Desktop$ rsync --progress 9200.16384.WIN8_RTM.120725-1247_X64FRE_SERVER_EVAL_EN-US-HRM_SSS_X64FREE_EN-US_DV5.ISO /media/windowsshare/
9200.16384.WIN8_RTM.120725-1247_X64FRE_SERVER_EVAL_EN-US-HRM_SSS_X64FREE_EN-US_DV5.ISO
3,694,962,688 100% 175.67MB/s 0:00:20 (xfr#1, to-chk=0/1)


so apparently there is something happening at least at the gui level when i drag and drop files that are 3+ Gigs or larger into FreeNAS smb folder that cause my speed to drop to 1 MB/s for files larger than 3+ Gigs

WIERD

Any help appreciated

Thanks in Advance
Eddie

 

[SweetAndLow]

so i used

CP Command
cp 7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso /media/windowsshare/

i found the cp command doesnt show transfer rate

and the command appeared to finish within 30 seconds or so for a 3.2 gig file so its definitely not going 1MB/s its prob going around the standard 100MB/s which is what ive been transferring at....

Rsync Command
eddie@Desktop-Eddie:~/Desktop$ rsync --progress 7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso /media/windowsshare/
7601.17514.101119-1850_x64fre_server_eval_en-us-GRMSXEVAL_EN_DVD.iso
3,166,840,832 100% 231.12MB/s 0:00:13 (xfr#1, to-chk=0/1)
eddie@Desktop-Eddie:~/Desktop$ rsync --progress 9200.16384.WIN8_RTM.120725-1247_X64FRE_SERVER_EVAL_EN-US-HRM_SSS_X64FREE_EN-US_DV5.ISO /media/windowsshare/
9200.16384.WIN8_RTM.120725-1247_X64FRE_SERVER_EVAL_EN-US-HRM_SSS_X64FREE_EN-US_DV5.ISO
3,694,962,688 100% 175.67MB/s 0:00:20 (xfr#1, to-chk=0/1)


so apparently there is something happening at least at the gui level when i drag and drop files that are 3+ Gigs or larger into FreeNAS smb folder that cause my speed to drop to 1 MB/s for files larger than 3+ Gigs

WIERD

Any help appreciated

Thanks in Advance
Eddie

How are got doing it in the GUI? Are you opening the same folder you are using on the cli? Or are you using the network selection on the side bar. The side bar probably uses smbfs and the mount uses cifs. Sounds line a Ubuntu problem though.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

I click either the icon for the windowsshare mount on my desktop or go to places at the top on the menu bar and select windowsshare...

The share is mounted using fstab


I left click and hold file ibwant to transfer and drop it in the FreeNAS window
http://imgur.com/a/Cak9e

 

[SweetAndLow]

Looks like you might not be using the mount your made. Try navigating to /media/windowshare/ in the for browser then do the copy.

Sent from my Nexus 5X using Tapatalk

 

[Cytomax]

Sorry life got busy and i stopped playing with this thing for a while but now im back.

instead of using the mount i made in fstab and transferring using the smb protocol

//192.168.0.11/windowsshare /media/windowsshare cifs uid=1000,gid=1000,username=XXXX,password=XXXXX,iocharset=utf8,sec=ntlm 0 0

all i did was change
smb://freenas.local/mnt/volume/windowsset
to
sftp://freenas.local/mnt/volume/windowsset
in the address bar

and now it is flying.... for some reason the smb protocol is just not working well on my system.... i think im going to nuke and pave the freenas system when i get the chance but for now i will use the sftp protocol when transferring large files.

if you think of anything else let me know.... but after all the updates ive done on this system im sure a good nuke and pave is in order

 

[Cytomax]

Well i am back... i finally had time to completely nuke the FreeNAS server and start from scratch.

Im running FreeNAS-11.0-U2 on a totally new USB drive.

I detached the Volumes and deleted all the config stuff upon detaching

I have now imported my volumes in the freshly installed FreeNAS server and... drum roll......

When transferring from my Client to my FreeNAS server

Using SMB all my transfers are slow < 5 megaBYTES per second.
and
Using NFS transfer supposedly says its going 100+ megabytes per second but then it starts to get real slow and when i calculate it its more around 35 megaBYTES per second

----------------------------------------------------------------

I installed Intel PWLA8391GT Desktop Adapter PRO/1000 GT 10/100/1000Mbps PCI 1 x RJ45 into the CLIENT and the SERVER today
https://www.newegg.com/Product/Product.aspx?Item=N82E16833106121

Using SMB all my transfers are around 16 megaBYTES per second
and
Using NFS transfer supposedly says its going 100+ megabytes per second but then it starts to get real slow and when i calculate it its more around 35 megaBYTES per second

----------------------------------------------------------------

I just setup a NETGEAR GS105 10/100/1000 switch between the client and the server which are a few feet from each other
still using the Intel PWLA8391GT Desktop Adapter PRO/1000 GT 10/100/1000Mbps PCI 1 x RJ45 into the CLIENT and the SERVER
I am using prefabricated patch cables from mono price 3 foot in length

Using SMB all my transfers are around 47 megaBYTES per second using a 3.2 gig file
Using NFS my transfer to Client is around 30 megaBYTES per second using a 3.2 gig file
Using NFS my transfer to Server is aruond 47 megaBTYES per second using a 3.2 gig file

which is MUCH better but still not close to the Gigabit (125 megaBYTES per second) speed it should be

---------------------------------------------------------

I am also going to try and rerun the iperf test with the new NICs and see if anything changes.

--------------------------------------------

Any help is appreciated.