9.10 and a lagg0 device

[philhu]

Hi -

Put in a 2 port 1g nic card

Code:

em0: <Intel(R) PRO/1000 Network Connection 7.6.1-k> port 0xd880-0xd89f mem 0xfbd80000-0xfbd9ffff,0xfbd60000-0xfbd7ffff irq 24 at device 0.0 on pci10
em0: Using an MSI interrupt
em0: Ethernet address: 00:15:17:96:6f:c8
em1: <Intel(R) PRO/1000 Network Connection 7.6.1-k> port 0xdc00-0xdc1f mem 0xfbde0000-0xfbdfffff,0xfbdc0000-0xfbddffff irq 34 at device 0.1 on pci10
em1: Using an MSI interrupt
em1: Ethernet address: 00:15:17:96:6f:c9

Tried to link aggregate it using round robin...

Code:

em1: link state changed to UP
em1: link state changed to DOWN
em1: link state changed to UP
em0: link state changed to UP
arp: 00:15:17:96:6f:c8 is using my IP address 10.10.1.49 on em1!
arp: 00:15:17:96:6f:c9 is using my IP address 10.10.1.49 on em0!
lagg0: link state changed to UP
em1: link state changed to DOWN
em1: link state changed to UP

I can ping myself ok, but anything else gets 'network Down'

Code:

[root@freenas] ~# ping 10.10.1.49
PING 10.10.1.49 (10.10.1.49): 56 data bytes
64 bytes from 10.10.1.49: icmp_seq=0 ttl=64 time=0.023 ms
64 bytes from 10.10.1.49: icmp_seq=1 ttl=64 time=0.025 ms
^C
--- 10.10.1.49 ping statistics ---
2 packets transmitted, 2 packets received, 0.0% packet loss
round-trip min/avg/max/stddev = 0.023/0.024/0.025/0.001 ms
[root@freenas] ~# ping 10.10.1.180
PING 10.10.1.180 (10.10.1.180): 56 data bytes
ping: sendto: Network is down
ping: sendto: Network is down
^C
--- 10.10.1.180 ping statistics ---
2 packets transmitted, 0 packets received, 100.0% packet loss

I also tried the same without aggregation, just picking one of the ports, I get nothing, no pings in our out

ifconfig shows:

Code:

em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        ether 00:15:17:96:6f:c8
        inet 10.10.1.49 netmask 0xffffff00 broadcast 10.10.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
em1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        ether 00:15:17:96:6f:c8
        inet 10.10.1.49 netmask 0xffffff00 broadcast 10.10.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        ether 00:15:17:96:6f:c8
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect
        status: active
        laggproto roundrobin lagghash l2,l3,l4
        laggport: em0 flags=4<ACTIVE>
        laggport: em1 flags=4<ACTIVE>

Where can I start to debug this?

 

[Nick2253]

Are those two the only network ports in your system? Do you have an IP address assigned to any other NICs?

If you completely remove the lagg, and assign a static IP to one of the ports, does it work? Ditto the other port? If those aren't working, then you've got some kind of hardware/config issue. If they are both working, then it's a problem with the lagg config.

 

[philhu]

ok, I am willing to completely remove the lagg. You put that in italics, so I will ask, how do I completely remove the lagg device?

I will do what it needs, then configure a single port, so I guess I need to kill the em0, em1 and lagg0 configs completely. How exactly to be sure they are removed.

No, there are other ports igb0,1 (192 network), em0,1 (10 network) ix0,1 = 10gb network, but not used yet

FYI, here is the ifconfig -m on the devices:

Code:

[root@freenas] ~# ifconfig -m em0
em0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        capabilities=5019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWFILTER,VLAN_HWTSO>
        ether 00:15:17:96:6f:c8
        inet 10.10.1.49 netmask 0xffffff00 broadcast 10.10.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
        supported media:
                media autoselect
                media 1000baseT
                media 1000baseT mediaopt full-duplex
                media 100baseTX mediaopt full-duplex
                media 100baseTX
                media 10baseT/UTP mediaopt full-duplex
                media 10baseT/UTP
[root@freenas] ~# ifconfig -m em1
em1: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        capabilities=5019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWFILTER,VLAN_HWTSO>
        ether 00:15:17:96:6f:c8
        inet 10.10.1.49 netmask 0xffffff00 broadcast 10.10.1.255
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect (1000baseT <full-duplex>)
        status: active
        supported media:
                media autoselect
                media 1000baseT
                media 1000baseT mediaopt full-duplex
                media 100baseTX mediaopt full-duplex
                media 100baseTX
                media 10baseT/UTP mediaopt full-duplex
                media 10baseT/UTP
[root@freenas] ~# ifconfig -m lagg0
lagg0: flags=8843<UP,BROADCAST,RUNNING,SIMPLEX,MULTICAST> metric 0 mtu 1500
        options=4019b<RXCSUM,TXCSUM,VLAN_MTU,VLAN_HWTAGGING,VLAN_HWCSUM,TSO4,VLAN_HWTSO>
        capabilities=10000<VLAN_HWFILTER>
        ether 00:15:17:96:6f:c8
        nd6 options=9<PERFORMNUD,IFDISABLED>
        media: Ethernet autoselect
        status: active
        supported media:
                media autoselect
        laggproto roundrobin lagghash l2,l3,l4
        laggport: em0 flags=4<ACTIVE>
        laggport: em1 flags=4<ACTIVE>

 

[Nick2253]

You can remove the lagg through the web GUI. After removing it, I would reboot the server to be sure you don't have any weird things hanging on.

I put "completely" in italics to emphasize that the lagg0 interface should be removed, not just brought down.

Also, from the documentation, in case you hadn't seen it: "Do not configure the interfaces used in the lagg device before creating the lagg device."

 

[philhu]

Ok, fixed.....

The em0 had been configured previously, keeping its old address, deleting lagg0, forced the delete of em0. I knew it was ok, when it did not get the same addr when I rebuilt lagg0

Had to build it, then gave lagg0 an static ip from the gui.

Working fine!

 

[Jon K]

That's in the manual :)