- Joined
- Nov 25, 2013
- Messages
- 7,776
Hi all,
we have some problems with our shiny new NVMe only FreeNAS systems. Looks like FreeBSD 11 is missing completion interrupts and subsequently running into timeouts. This leaves the system "hanging" whenever the problem occurs.
Warner Losh (imp) has helped to track down the root cause - we are still not quite sure if it is really a general problem in the FreeBSD driver or rather erratically behaving firmware, problems with the mainboard ... could be anything to be honest.
But one workaround that seems to get the system into a stable working condition is to run FreeBSD 12-STABLE instead of 11. I have ben extensively testing a spare box with stock FreeBSD without FreeNAS and a simple swap of the kernel (thanks to boot environments) reliably switches the problem off or back on.
So: is there a version of FreeNAS based on 12-STABLE? I would not mind running a nightly build in production - we could test if the few features we need work, and then not upgrade until at least a beta is out. Internal systems, so no big security risk, either.
If not I would try to build a 12-STABLE kernel with the FreeNAS modifications, make sure COMPAT_11 is active, and manually patch that into a fresh boot environment with 11.2-U3.
Comments? If you are interested in the entire conversation, start here please:
https://lists.freebsd.org/pipermail/freebsd-stable/2019-April/090818.html
Thanks and kind regards,
Patrick
we have some problems with our shiny new NVMe only FreeNAS systems. Looks like FreeBSD 11 is missing completion interrupts and subsequently running into timeouts. This leaves the system "hanging" whenever the problem occurs.
Warner Losh (imp) has helped to track down the root cause - we are still not quite sure if it is really a general problem in the FreeBSD driver or rather erratically behaving firmware, problems with the mainboard ... could be anything to be honest.
But one workaround that seems to get the system into a stable working condition is to run FreeBSD 12-STABLE instead of 11. I have ben extensively testing a spare box with stock FreeBSD without FreeNAS and a simple swap of the kernel (thanks to boot environments) reliably switches the problem off or back on.
So: is there a version of FreeNAS based on 12-STABLE? I would not mind running a nightly build in production - we could test if the few features we need work, and then not upgrade until at least a beta is out. Internal systems, so no big security risk, either.
If not I would try to build a 12-STABLE kernel with the FreeNAS modifications, make sure COMPAT_11 is active, and manually patch that into a fresh boot environment with 11.2-U3.
Comments? If you are interested in the entire conversation, start here please:
https://lists.freebsd.org/pipermail/freebsd-stable/2019-April/090818.html
Thanks and kind regards,
Patrick
Last edited: