Link Aggregation

[Tong]

Doesn't work. I have Dlink DGS-1210-24 switch. I cannot get it to LACP on both freenas and my windows server. Attached is static LAGG setup for windows server and switch.

On freenas I cannot find settings to make LAGG work. What are requirements and any suggestions? Realtek chipset.

 

[dlavigne]

What are the settings on the FreeNAS side? What makes you think LACP is not working? I'm assuming you have read through http://doc.freenas.org/index.php/Link_Aggregations?

 

[vegaman]

It sounds like you're trying to increase bandwidth between FreeNAS and your Windows Server? Unfortunately LACP won't help there, it's only useful for multiple clients (and fault tolerance).
If you need more bandwidth I'd recommend looking first at Intel NICs instead of Realtek, then 10GbE or Infiniband if that's not enough.

Sent from my GT-I9300 using Tapatalk 4

 

[Tong]

No I just want link agg to work. I broke it again. :( Switch settings back to normal for ports and forced to set manual settings. Tried different ports. Still no go. I had it working for awhile. Rebooting switch broke it too. Also while on LACP only DHCP worked. Manually setting ip would break it.

I just want link agg so more people will get max gb speed. I understand it wont give me more to one link.

Here is something weird after playing around with LACP and other link agg settings, even after deleting lagg, setting switchports to normal, and rebooting both devices, all three of my nic shows same mac with ifconfig.

 

[Tong]

here is ifconfig. I have lagg in load balance. Switch ports in normal mode. Plugged only one wire in to the nics. I think my switch freaks if I plug others in since they have same mac?

Code:

[root@freenas ~]# ifconfig                                                     
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500     
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%re0 prefixlen 64 scopeid 0x3           
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (1000baseT <full-duplex>)                   
        status: active                                                         
re1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500     
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%re1 prefixlen 64 scopeid 0x4           
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (none)                                     
        status: no carrier                                                     
re2: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500     
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%re2 prefixlen 64 scopeid 0x5           
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (none)                                     
        status: no carrier                                                     
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536                     
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384             
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>                 
        inet6 ::1 prefixlen 128                                               
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8                             
        inet 127.0.0.1 netmask 0xff000000                                     
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>                             
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500   
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%lagg0 prefixlen 64 scopeid 0x9         
        inet 192.168.10.118 netmask 0xffffff00 broadcast 192.168.10.255       
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect                                             
        status: active                                                         
        laggproto loadbalance lagghash l2,l3,l4                               
        laggport: re2 flags=0<>                                               
        laggport: re1 flags=0<>                                               
        laggport: re0 flags=4<ACTIVE>                                         
[root@freenas ~]#                              

 

[Tong]

Please help guys. Finding two cards with same mac shouldn't happen. I have 3 that matches. Should I play the lotto? Any way to force my network cards to use different mac address? FreeBSD has options but doesn't work on FreeNAS

 

[cyberjock]

Uh, you have 3 cards with the same mac because you are using link aggregation....

 

[Tong]

I swore I deleted the link agg and rebooted. ifconfig still shows same mac.

 

[Tong]

Please check for bugs. I removed member from lagg and rebooted. See ifconfig.

Code:

[root@freenas ~]# ifconfig                                                     
re0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500     
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%re0 prefixlen 64 scopeid 0x3           
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (1000baseT <full-duplex>)                   
        status: active                                                         
re1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500     
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet6 fe80::6a1c:a2ff:fe12:a2f%re1 prefixlen 64 scopeid 0x4           
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (1000baseT <full-duplex>)                   
        status: active                                                         
re2: flags=8802<BROADCAST,SIMPLEX,MULTICAST> metric 0 mtu 1500                 
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect (none)                                     
        status: no carrier                                                     
ipfw0: flags=8801<UP,SIMPLEX,MULTICAST> metric 0 mtu 65536                     
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
lo0: flags=8049<UP,LOOPBACK,RUNNING,MULTICAST> metric 0 mtu 16384             
        options=600003<RXCSUM,TXCSUM,RXCSUM_IPV6,TXCSUM_IPV6>                 
        inet6 ::1 prefixlen 128                                               
        inet6 fe80::1%lo0 prefixlen 64 scopeid 0x8                             
        inet 127.0.0.1 netmask 0xff000000                                     
        nd6 options=21<PERFORMNUD,AUTO_LINKLOCAL>                             
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500   
        options=8209b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,WOL_MAGI
C,LINKSTATE>                                                                   
        ether 68:1c:a2:12:0a:2f                                               
        inet 192.168.10.118 netmask 0xffffff00 broadcast 192.168.10.255       
        inet6 fe80::6a1c:a2ff:fe12:a2f%lagg0 prefixlen 64 scopeid 0x9         
        nd6 options=29<PERFORMNUD,IFDISABLED,AUTO_LINKLOCAL>                   
        media: Ethernet autoselect                                             
        status: active                                                         
        laggproto loadbalance lagghash l2,l3,l4                               
        laggport: re1 flags=4<ACTIVE>                                         
        laggport: re0 flags=4<ACTIVE>                                         
[root@freenas ~]#                                                             
                                                        

 

[jgreco]

Uh, you have 3 cards with the same mac because you are using link aggregation....

Well the "bug" would appear to be that the ether address for re2 didn't change back; I don't know what the current state of affairs is, but years ago, this kind of thing wasn't that unusual, because hardware was crappy and drivers implemented change-of-MAC through a variety of nefarious strategies (in order to provide UNIX with a more-or-less consistent feature set).

You can manually set a MAC address with "ifconfig re2 ether 12:34:56:78:90:12". It would be interesting to have you do that, reboot, and see if it sticks.

 

[Tong]

Using the command changes mac. Reboot doesnt keep change.

 

[jgreco]

So are the MAC addresses all the same even after that?

 

[Tong]

After a reboot it comes back as the same as link agg mac. These macs use to be all different before I messed with the link agg stuff.

 

[jgreco]

Well, turn OFF link agg and then see what happens.

 

[Tong]

Deleting the LAGG resets the nic mac for the addin card. My onboard nic required setting manually a different mac. I got very close this weekend. I am able to LAGG the 2 nic ports on the addin card. I used load balance and set switch to use static LAGG for the ports. My computers can ping and access the web page. Everything except the SBS 2k11 for directory services. It is a VM on HyperV 2012 using a LAGG of 3 nics static team.
Other VMs on HypverV host can ping and access FreeNAS web page.