Chelsio T520-CR

[Mlovelace]

I just installed a Chelsio T520-CR and the documentation from Chelsio said to add the following for Freebsd kernels:

sysctl:
kern.ipc.nmbjumbo9=262144
kern.ipc.nmbjumbo16=262144
kern.ipc.nmbclusters=262144
kern.ipc.nmbjumbop=262144

Tunables:
hw.cxgbe.config_file="uwire"
hw.cxgbe.linkcaps_allowed=0xf
hw.cxgbe.niccaps_allowed=0xf
hw.cxgbe.toecaps_allowed=0xf
hw.cxgbe.rdmacaps_allowed=0xf
hw.cxgbe.iscsicaps_allowed=0xf

Can anyone confirm that those are correct for Freenas.

Thanks!

 

[c32767a]

The sysctls should be OK for most workloads. If you run out of one of those mbufs, you could see weird hangs and network connectivity issues.
You can monitor the usage of those pools with the following command:

vmstat -z | head -n 1; vmstat -z | grep mbuf

If you see numbers other than 0 in the fail column, just increase the allocated size.

As to the tunables, they look like driver options for offload features on the card chipset. We don't use the t5 cards, so I can't comment on that.

 

[cyberjock]

I'm pretty sure at least one of those tunables hasn't existed in freebsd for years.