How to install the MXGE driver in FreeNAS?

glossjorge

Dabbler
Joined
Feb 24, 2020
Messages
12
Hey guys,

I just put a Myricom 10G NIC in my FreeNAS machine, but it's not showing, I read that the driver for it is called mxge and it's supposed to come with FreeBSD since version 6 and since FreeNAS 11.3 shows as FreeBSD 11.3, it should be included, so how can I install this driver to it?

Thanks.
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
you can try kldload mxge at the CLI...

Can then be loaded with a tunable at boot if it works.
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
So it's not there... or not called that.
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
kldload if_mxge
 

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
I have "Myricom-10G-PCIE2-8C2-T-2T - Dual port card ", I am just a strater adn would like to know step by step to get my card working. I see only Mobo dual ports in the dashboard. not sure how to load drivers i was suggested with installing MXGE driver .

Please advise if you did get to progress with your Myricom card ?
 

Samuel Tai

Never underestimate your own stupidity
Moderator
Joined
Apr 24, 2020
Messages
5,399

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
Hi i placed the code in /boot/loader.conf ... this works great ,,,now shall try the video card,,,
 
Last edited:

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
SAm I lost the setting on Freenas however , I started all fresh, I am unable to see the Ethernet interface even though the card is plugged and Loader.conf file has the code you detailed above.. no copy mistakes as it worked earlier .. however should the card be active/connected of something ..sorry for my silly queries just learning.

Also i got another 500gb NVME for Cache is it going to work better or just a an SSD ? should the Cache be configured only at creating the Pool ?
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
placed the code in /boot/loader.conf ... this works great
Until a reboot...

You need to set tunables rather than editing the loader file since FreeNAS dynamically rewrites loader.conf from its database whenever it sees fit:

Under System | Tunables | Add

Type: Loader
Value: YES
Variable: if_mxge_load

Set one each for the variables listed by @Samuel Tai
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
Also i got another 500gb NVME for Cache is it going to work better or just a an SSD ? should the Cache be configured only at creating the Pool ?
I doubt that you will benefit from L2ARC (if that's what you meant by Cache)... max out your board's RAM first, then look at your arcstat -a results

You can add and remove L2ARC to/from a pool at any time.
 

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
I meant Cache Disk - I happened to review somewhere that it improves performance for Copying large files.
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
I meant Cache Disk - I happened to review somewhere that it improves performance for Copying large files.
Then maybe you're talking about SLOG... although it doesn't exactly do that either.

Most non-industrial users won't see any benefits from L2ARC unless the use case is very specific and there's already enough RAM (at least 64GB) in the system or SLOG unless they are using NFS oe iSCSI to share out disks to Virtual Machines.
 

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
Until a reboot...

You need to set tunables rather than editing the loader file since FreeNAS dynamically rewrites loader.conf from its database whenever it sees fit:

Under System | Tunables | Add

Type: Loader
Value: YES
Variable: if_mxge_load

Set one each for the variables listed by @Samuel Tai
i created the tunable and rebooted still no luck ,,I see only two igb0 & igb1.

Should i add (
device firmware
device mxge
) the kernel configuration file as per your link sent earlier ..where can I find the (Kernel configuration file ) ??
 

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
Then maybe you're talking about SLOG... although it doesn't exactly do that either.

Most non-industrial users won't see any benefits from L2ARC unless the use case is very specific and there's already enough RAM (at least 64GB) in the system or SLOG unless they are using NFS oe iSCSI to share out disks to Virtual Machines.

Great Sam I suppose I shall have my NVME 500GB (freenas ) + 8 x 2TB Pool only. I shall not add Cache disk while re-building my Pool. Thanks
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
You cannot reconfigure the kernel without recompiling it. And for that you need to set up a build environment and check out the FreeNAS sources from github.
If the output of kldstat does show if_mxge but the output of dmesg does not show your card being detected, then your card is either broken or of a different kind.
 

kumarmvnk

Explorer
Joined
May 1, 2020
Messages
50
You cannot reconfigure the kernel without recompiling it. And for that you need to set up a build environment and check out the FreeNAS sources from github.
If the output of kldstat does show if_mxge but the output of dmesg does not show your card being detected, then your card is either broken or of a different kind.

Not even in kldstat ?? nor anything in "dmesg | grep -i mxge"

Id Refs Address Size Name
1 81 0xffffffff80200000 26b7608 kernel
2 1 0xffffffff828b9000 100ee8 ispfw.ko
3 1 0xffffffff829ba000 fee8 ipmi.ko
4 2 0xffffffff829ca000 2d70 smbus.ko
5 1 0xffffffff829cd000 32f20 if_bnxt.ko
6 1 0xffffffff82a00000 2248c8 if_qlxgbe.ko
7 1 0xffffffff82c25000 f8540 ocs_fc.ko
8 1 0xffffffff82d1e000 22150 smartpqi.ko
9 1 0xffffffff82d41000 8a40 freenas_sysctl.ko
10 1 0xffffffff82e19000 337048 vmm.ko
11 1 0xffffffff83151000 ae4 nmdm.ko
12 1 0xffffffff83152000 2ec dtraceall.ko
13 9 0xffffffff83153000 852478 dtrace.ko
14 1 0xffffffff839a6000 5c0 dtmalloc.ko
15 1 0xffffffff839a7000 1898 dtnfscl.ko
16 1 0xffffffff839a9000 1ef1 fbt.ko
17 1 0xffffffff839ab000 54c30 fasttrap.ko
18 1 0xffffffff83a00000 d5c sdt.ko
19 1 0xffffffff83a01000 6bc0 systrace.ko
20 1 0xffffffff83a08000 6b98 systrace_freebsd32.ko
21 1 0xffffffff83a0f000 121c profile.ko
22 1 0xffffffff83a11000 3cd4 geom_multipath.ko
23 1 0xffffffff83a15000 1a920 hwpmc.ko
24 1 0xffffffff83a30000 8260 t3_tom.ko
25 2 0xffffffff83a39000 1000 toecore.ko
26 1 0xffffffff83a3a000 15480 t4_tom.ko
27 1 0xffffffff83a50000 2440 ums.ko
28 1 0xffffffff83a53000 1780 uhid.ko
 

Patrick M. Hausen

Hall of Famer
Joined
Nov 25, 2013
Messages
7,740
Then please try kldload if_mxge and report what happens. dmesg again afterwards.
 
Top