4 NICS DirectAttach to hosts xcp-ng pool

[dror]

Hey,
I have 4 nics 10GB on FreeNAS and two each host.
I connect each to freeNas with one port on the hosts.
Only one can connect to FreeNAS and the other can't.

My address on FreeNAS:
nic 1: 172.16.10.10/30 -> Go to Host 1 nic 1 -> 172.16.10.9/30
nic 2: 172.16.10.20/29 -> Go to Host 2 nic 1 -> 172.16.10.19/29
nic 3: 172.16.10.30/30 -> Go to Host 3 nic 1 -> 172.16.10.29/30

Only in the master (Host 1) i can connect to FreeNAS and speed like 100Mbps
from host 1 i can see the lun from this -> iscsiadm -m discovery --type sendtargets --portal 172.16.10.10
from host 2 i can see the lun from this -> iscsiadm -m discovery --type sendtargets --portal 172.16.10.20
from host 3 i can see the lun from this -> iscsiadm -m discovery --type sendtargets --portal 172.16.10.30

But i get empty response from this -.> multipath -ll (In all hosts except the host 1 that can connect to FreeNAS).
I config also iSCSI Multipath in xcp-ng and ISCI MPIO in FreeNAS but not success.
Anyone know ?

Thanks.

 

[dror]

Someone know ?

 

[Mlovelace]

My address on FreeNAS:
nic 1: 172.16.10.10/30 -> Go to Host 1 nic 1 -> 172.16.10.9/30
nic 2: 172.16.10.20/29 -> Go to Host 2 nic 1 -> 172.16.10.19/29
nic 3: 172.16.10.30/30 -> Go to Host 3 nic 1 -> 172.16.10.29/30

I config also iSCSI Multipath in xcp-ng and ISCI MPIO in FreeNAS but not success.

You have one connection from each host to the storage, this is not how you configure MPIO. If you want iSCSI MPIO you need to configure MULTIPLE connections from each host (preferably on separate vLANs) to the storage.

 

[dror]

You have one connection from each host to the storage, this is not how you configure MPIO. If you want iSCSI MPIO you need to configure MULTIPLE connections from each host (preferably on separate vLANs) to the storage.

Thanks.
I fix this simply and put switch for 10GB.
But i can't get 10GB speed. All nics and switch support and work MTU 9000.
I get less the 1Gbps speed. You know why?
I test via iperf and i get around 4.5Gbps...

 

[Mlovelace]

I get less the 1Gbps speed. You know why?

The only information you've provided is that there are 4 10Gbe NICs and you're running some open-source fork of Xen (xcp-ng). Based on that information, how on earth would anyone be able to suggest why the performance is below your expectations?

Best of luck to you, I hope you figure it out...

 

[dror]

The only information you've provided is that there are 4 10Gbe NICs and you're running some open-source fork of Xen (xcp-ng). Based on that information, how on earth would anyone be able to suggest why the performance is below your expectations?

Best of luck to you, I hope you figure it out...

You right. What you need to help me ?
I have this FreeNAS server:

System: Supermicro 1028U-E1CR4+
CPU: 2 x Intel Xeon 8C E5-2620V4 2.1G 20M 8GT QPI
RAM: 4 x 16GB DDR4-2666 2RX8 ECC RDIMM (Total 64GB)
Disks: 6 x MZ7KM1T9HMJP-00005 Samsung SM863a,1.92TB,SATA 6Gb/s,VNAND,V48,2.5",7mm (3.6 DWPD)
HBA: AOC-S3008L-L8e HBA IT mode
LAN: AOC-STG-i4S 4-port10Gbe Standard LP with SFP+, Intel XL710-AM1
Freenas OS installed on DiskOnKey SanDisk Ultra Fit USB 3.1 up to 130MB/s in mirror (2 DiskOnKey).
Cache device: Corsair NX500 800GB PCI-E

one pool as stripe vdev mirrors.
On each xen host I have intel x540-DA2.

I connect the freenas and the hosts to switch 10GB.
I see in FreeNAS and the hosts nics speed at 10GB.
I see via iperf ~4Gbps.

The storage share is zvol ISCSI with sync=always.

But still getting less than 1 GB in fact :(