CIFS bad performance (12Mb/s), detailed info+test

[fede2222]

Hi

I have some FreeNas boxes in my home, but one have an issue that i couldn't identify. In the other FreeNas boxes i don't have this problem.

Is a fresh new bare metal Freenas 9.1 Installation. Network and Storage performance are "good" (see details below) but when i copy files from a Win machine to that particular Freenas Box i can't get more than 12Mbs/s. Other Freenas Boxes don't have this issue.

Hardware:

• Motherboard MSI 975x Platinum
• Core 2 Duo
• 8Gb Ram DDR2
• 2x2TB WD SATA Green Drives
• 2x2TB Seagate Barracuda
• Gigabit Ethernet, Intel Nic or Realtek Nic (First try, second try)

I analyzed three possibles problems:
1) The NIC, first suspect 12Mb/s is typical a 100Mbit connection throughput
2) Storage Performance
3) Client Machine

Test
1) The Nic

First using the Intel Onboard LAN then using the Realtek Nic.​

Checked that the connection was Gigabit, ok. -> 1000baseT <full-duplex>​

Code:

re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGIC,LINKSTATE>
        ether 00:08:54:a9:4c:03
        inet 192.168.1.209 netmask 0xffff0000 broadcast 192.168.255.255
        inet6 fe80::208:54ff:fea9:4c03%re0 prefixlen 64 scopeid 0x6
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>

Checked the connection bandwith from client to server with iperf, ok -> aprox 90Mb/s​

Client:​

Code:

------------------------------------------------------------
Client connecting to 192.168.1.209, TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  3] local 192.168.1.31 port 50045 connected with 192.168.1.209 port 5001
[ ID] Interval      Transfer    Bandwidth
[  3]  0.0-10.0 sec  111 MBytes  92.9 Mbits/sec

Server:​

Code:

------------------------------------------------------------
Server listening on TCP port 5001
TCP window size: 64.0 KByte (default)
------------------------------------------------------------
[  4] local 192.168.1.209 port 5001 connected with 192.168.1.31 port 50045
[ ID] Interval      Transfer    Bandwidth
[  4]  0.0-10.0 sec  111 MBytes  92.9 Mbits/sec

2) Storage Performance

DD test -> aprox 150Mb/s​

Code:

[root@server5-pc] /mnt/media7/Juegos# /usr/bin/time -h dd if=XenServer-6.0.0-install-cd.iso of=/dev/zero bs=1024 count=300000
300000+0 records in
300000+0 records out
307200000 bytes transferred in 1.929332 secs (159226093 bytes/sec)
        1.93s real              0.06s user              1.86s sys

Scrub Test -> aprox 117Mb/s​

Code:

[root@server5-pc] /mnt/media7/Juegos# zpool status media7
  pool: media7
state: ONLINE
  scan: scrub in progress since Thu Aug 22 10:50:24 2013
        4.13G scanned out of 234G at 117M/s, 0h33m to go
        0 repaired, 1.76% done
config:
 
        NAME                                            STATE    READ WRITE CKSUM
        media7                                          ONLINE      0    0    0
          raidz1-0                                      ONLINE      0    0    0
            gptid/797a2a3c-0358-11e3-a013-001617f1dadd  ONLINE      0    0    0
            gptid/7a049b01-0358-11e3-a013-001617f1dadd  ONLINE      0    0    0
            gptid/7a9a73f7-0358-11e3-a013-001617f1dadd  ONLINE      0    0    0
            gptid/7b39761e-0358-11e3-a013-001617f1dadd  ONLINE      0    0    0
 
errors: No known data errors

3) Client Machine

I use the VMWARE iso as test file, aprox 500Mb. I copied this file file to another Freenas Box and i got aprox 100Mb/s. When i copied the same file from the same client machine to the problematic Freenas Box i got aprox 12Mb/s​

​

Any help?, test? ideas?

Thanks

​

 

[fede2222]

Bump (sorry)... someone?.. :(

 

[cyberjock]

Well, your pool speeds are a bit low. Experience suggests that you will get only about 80% of peak zpool speeds in a best case. For you, that's about 110MB/sec, but that's far more than you are seeing now.

So you tried an Intel NIC and still got slow speeds?

And when you say 12Mb/sec is that Megabytes/sec or Megabits/sec. Because Mb is Megabits which is MUCH worse than MB(megabytes).

Your CPU is pretty old(7 years I believe) and you are at the limit for that CPU, but also only 8GB of RAM.

What version of FreeNAS are you using, and can you verify if you are using the 32 or 64 bit version?

You might just be asking too much from the hardware you have... we'll

 

[fede2222]

Thanks for reply...

Well, your pool speeds are a bit low. Experience suggests that you will get only about 80% of peak zpool speeds in a best case. For you, that's about 110MB/sec, but that's far more than you are seeing now.

Yep... the next step after correct this issue is check that

So you tried an Intel NIC and still got slow speeds?

Yes... that is the most wierd.

And when you say 12Mb/sec is that Megabytes/sec or Megabits/sec. Because Mb is Megabits which is MUCH worse than MB(megabytes).

Yes.. MegaBYTES. I copy an ISO from a Win7 Box to Freenas. The strange is 12MB/s for copy and for read. Anyone expect difference, but not here. If I write at 12MB/s and read at least at 50MB/s i'm even.

Your CPU is pretty old(7 years I believe) and you are at the limit for that CPU, but also only 8GB of RAM.

Yep.. is an old CPU, this box is for Home Use, not need much more. For the test i was the only connected. I made a TOP during the transfer and the processor was fine. But it makes my crazy the 12MB.
8GB is the limit of the motherboard.

What version of FreeNAS are you using, and can you verify if you are using the 32 or 64 bit version?

FreeNAS-9.1.0-RELEASE-x64 (dff7d13)

You might just be asking too much from the hardware you have... we'll

The storage and network do more (from the previous test), at least with a 50 MB (read) i will be ok. I have a similar NAS and can do 60MB/s for read.

 

[cyberjock]

I'm not familiar with your network topology. Any chance you have a 100Mb link somewhere between the server and your desktop you are copying data to/from? Your iperf tests are horrible though. They're clearly being limited to 100Mb somewhere, which just kind of validates that you are at the limit for your network as it stands right now.

I'm willing to bet something is at 100Mb. What though, is a totally different question.

 

[fede2222]

I'm not familiar with your network topology. Any chance you have a 100Mb link somewhere between the server and your desktop you are copying data to/from? Your iperf tests are horrible though. They're clearly being limited to 100Mb somewhere, which just kind of validates that you are at the limit for your network as it stands right now.

I'm willing to bet something is at 100Mb. What though, is a totally different question.

Ouu.. the iperf test show 92 Mbits/s... its obviously working like a 100Mbit/s card. I didn't note that on the rush, only view the 111MB on IPERF output and i confused. I missed that. You are right, this is not good speed.

The link between the Freenas and the Switch is Gigabit, and it confirmed the IFCONFIG with 1000baseT full duplex.
But is true that between the client and the Freenas box somewhere is taking a 100mbit connection, not a 1000mbit connection.

That very strange because the other FreeNas boxes are in the same switch that the problematic one. And all report 1000t full duplex, and works with reasonable speeds. It might be a config on the switch that is not ok. Is an administrable switch, i will look in the config of the switch.

Well.. better, at least the problem is more isolated.

Thanks... i will post next if i discover the problem.

 

[fede2222]

Well... the switch config was ok...but the connection still 100mbit.
Something strange on the switch on that ethernet port. The ethernet port is on AutoNegotiate don't know why showed 1000baseT when it obviously worked on 100.

I do the "all-common-fix-when-you-dont-know", known as reset . The switch initialize and now all magically working!!!...iperf show good values and reading the file from the win client is aprox 60Mb/s.

Thanks for the help.