Slow speed on X520-DA2 cards

xxx59712

Cadet
Joined
Jul 12, 2020
Messages
1
Hi,

Windows workstation and server are connected directly by a DAC Copper cable (I ruled out the cable issue by using 3 differents brands and cable length).

XA520-DA2 Cards and Driver 4.1.197.0 - 27/11/2019.

Windows 10 Pro / FreeNAS (latest version)

The problem is that Bandwith results are below expectations and not symmetrical and that they are well below what I get on Ubuntu. Using two Ubuntu live USB keys and doing a Iperf on both machines, I get a constant robust symmetrical 9.49 Gbits/sec between the two workstations.

I ruled out the PCIe ports restrictions by leaving just the NIC on the 16x port of each machine and by using a Remote Desktop to connect to Windows.

Here are the results on Windows. I tried every possible settings on the Device manager Driver tab. The only thing that seems to improve things a bit are Disabling Flow Control and setting the Interrupt Moderation Rate to Off. The other settings, jumbo frame and other Buffers have zero impact on the performance.

Anybody with experience with the Intel X520 cards would have an idea how to improve things?

Code:
>iperf3 -c 10.10.10.3 (Windows Machine)
Connecting to host 10.10.10.3, port 5201
[ 4] local 10.10.10.2 port 9356 connected to 10.10.10.3 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 604 MBytes 5.07 Gbits/sec
[ 4] 1.00-2.00 sec 678 MBytes 5.69 Gbits/sec
[ 4] 2.00-3.00 sec 731 MBytes 6.13 Gbits/sec
[ 4] 3.00-4.00 sec 745 MBytes 6.25 Gbits/sec
[ 4] 4.00-5.00 sec 747 MBytes 6.27 Gbits/sec
[ 4] 5.00-6.00 sec 742 MBytes 6.22 Gbits/sec
[ 4] 6.00-7.00 sec 769 MBytes 6.45 Gbits/sec
[ 4] 7.00-8.00 sec 764 MBytes 6.41 Gbits/sec
[ 4] 8.00-9.00 sec 758 MBytes 6.36 Gbits/sec
[ 4] 9.00-10.00 sec 788 MBytes 6.61 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 7.16 GBytes 6.15 Gbits/sec sender
[ 4] 0.00-10.00 sec 7.16 GBytes 6.15 Gbits/sec receiver

iperf Done.



Code:
iperf3 -c 10.10.10.2 (FreeNAS)
Connecting to host 10.10.10.2, port 5201
[ 4] local 10.10.10.3 port 49799 connected to 10.10.10.2 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 324 MBytes 2.72 Gbits/sec
[ 4] 1.00-2.00 sec 334 MBytes 2.80 Gbits/sec
[ 4] 2.00-3.00 sec 350 MBytes 2.93 Gbits/sec
[ 4] 3.00-4.00 sec 327 MBytes 2.74 Gbits/sec
[ 4] 4.00-5.00 sec 324 MBytes 2.72 Gbits/sec
[ 4] 5.00-6.00 sec 276 MBytes 2.31 Gbits/sec
[ 4] 6.00-7.00 sec 321 MBytes 2.69 Gbits/sec
[ 4] 7.00-8.00 sec 323 MBytes 2.71 Gbits/sec
[ 4] 8.00-9.00 sec 336 MBytes 2.82 Gbits/sec
[ 4] 9.00-10.00 sec 336 MBytes 2.82 Gbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-10.00 sec 3.17 GBytes 2.73 Gbits/sec sender
[ 4] 0.00-10.00 sec 3.17 GBytes 2.73 Gbits/sec receiver

iperf Done.


Thank you.
 
Top