TrueNAS choosing 1gbit network over 10gbit

[StrictlyJohan]

Hello, I work at a TV post production company and one of our servers is a TrueNAS at roughly 100TB (two pools), we're running TrueNAS-12.0-U8.1.
We have two interfaces plugged in, one 1gbit and one 1gbit. But most of the time it seems to choose the slower 1gbit one, making work for everyone quite slow when it maxes out its traffic.
The problem is that if we pull the cord, the drives stop being visible to windows(smb) and we can't access the web interface (which we have at 10.0.1.203, the 1gbit one is at 10.0.1.197). Any idea why this would be, and what we could do about it? There's no option in the interface that I can see that lets you disable a connection, only to reset configuration, which I don't know what it does unfortunately (and no I'm no expert, as you might be able to tell already).

Any help would be appreciated.

 

[sretalla]

You need to read this:

Resource - Multiple network interfaces on a single subnet

We've had a number of people over the years bring up the topic of multiple network interfaces on a single subnet. Often done by Windows administrators or storage admins, where it works to varying degrees, this is sadly not proper IP networking...

www.truenas.com

You really shouldn't be doing it how you're doing it.

I question the value of having the 1Gbit link at all. (I assume you meant to write 10Gbit at one point).

 

[StrictlyJohan]

You need to read this:

Resource - Multiple network interfaces on a single subnet

We've had a number of people over the years bring up the topic of multiple network interfaces on a single subnet. Often done by Windows administrators or storage admins, where it works to varying degrees, this is sadly not proper IP networking...

www.truenas.com

You really shouldn't be doing it how you're doing it.

I question the value of having the 1Gbit link at all. (I assume you meant to write 10Gbit at one point).

I agree that having two was a mistake, but now we seem to be stuck with it... that's why we need help.

 

[Patrick M. Hausen]

Unconfigure and unplug the 1G interface and only use the 10G one ... there is no other way to make it work over 10G all the time.

 

[StrictlyJohan]

Alright, and how to unconfigure an interface? By the way why do you suppose it disappears in windows and the web interface(even the address to the 10gbit) when I unplug the 1gbit?

 

[sretalla]

and how to unconfigure an interface?

Network | Interfaces. edit and remove the IP from the offending NIC. Test and save changes.

By the way why do you suppose it disappears in windows and the web interface(even the address to the 10gbit) when I unplug the 1gbit?

That's probably the interface chosen by the routing system to respond for that subnet.

Once you don't have an IP on it anymore, it shouldn't be part of routing.

 

[jgreco]

Unconfigure and unplug the 1G interface and only use the 10G one ... there is no other way to make it work over 10G all the time.

(to @Patrick M. Hausen ... intended as an aside between networking guys, not a viable solution for the OP) :

Well, you could do a failover LAGG with the 10G in the primary position, but that carries some downsides with it too...

 

[2twisty]

Once you remove the 1G connection, you can also add the .197 IP to the 10G interface if you have clients that are statically set to use that IP, although I would only do that as a temporary stopgap until you get those clients reconfigured to use the .203... or vice-versa.

Having multiple IPs in the same subnet on a NIC is not really a great situation in TN, but it can work temporarily. I have done this before because my main file server went down, but my backup server had all the same data on it, and some of my clients were set to connect via IP rather than DNS lookups.