Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.
Supermicro X10 and X11 motherboard FAQ

Supermicro X10 and X11 motherboard FAQ

Despite being the default choice for most of us, Supermicro X10 and X11 motherboards have certain quirks. These range from poorly documented solutions to relatively common issues to deliberate choices by Supermicro that may raise questions.

This post is meant to answer some of the more common questions, including detailed instructions on how to fix recurring issues, where appropriate. It is also meant to guide prospective Supermicro X10 and X11 owners, as a proactive source of information.

Before we move on to the FAQ proper, a few warnings:

Some procedures mentioned here may carry the risk of bricking your motherboard, which may be irreversible. These will be marked by the following warning:
Do not attempt unless you are having the problem described above.

While I have personally executed all "risky" procedures I recommend and believe that the risk is minimal, be aware that there is a non-zero risk of something bad happening.
To reduce this risk, please ensure stable power (preferably with a UPS) is maintained to the system during the entire procedure.
Again, the risk is there, but it's small. If your problem does not match, you might want to ask in the forums before proceeding anyways.

I may group several questions that lead to the same issue. These will be marked by a lack of text immediately following the title.


I need help choosing the right Supermicro X10/X11 board
What are the differences between models?


There are several different models that I feel are appropriate for a server.
I have written a guide on this subject, for X10 motherboards, which explains the differences between these models.
Similarly, a guide to LGA1151 X11 motherboards is also available.

What's new in the X11 boards?

Besides the usual incremental improvements in the CPU, the Skylake platform brings the following to the table:
  • Support for up to 64GB of DDR4, in 16GB UDIMMs
  • Up to 8 SATA 6Gb/s ports (up from 6)
  • Extra PCI-e connectivity
  • PCH only supports XHCI for USB. This means that FreeNAS 9.3.1 and older versions DO NOT support booting from USB. They will probably not work with USB keyboards (or other USB HIDs) either - or anything USB, for that matter. FreeNAS 9.10 supports XHCI properly and all USB ports work normally.

What RAM should I buy?
What's with Kingston RAM and why shouldn't I use it?
[X10] I have 16GB Kingston RAM, can't I upgrade?


I have written a guide on this subject, which can be found here.
It includes a thorough discussion on RAM for the Supermicro X10 series.

Not much information is available for X11 boards yet and Supermicro's QVLs are still rather sparse.


[X10] What CPUs are compatible?

In principle, all LGA1150 CPUs should work with LGA1150 Supermicro X10 motherboards. Naturally, only models that support ECC are under serious consideration - this means Pentiums, i3s and Xeon E3s.

Please note that Haswell Refresh processors (released in 2014, compared to Haswell’s 2013 launch date) need the 2.0 BIOS or later to work.
Similarly, Broadwell processors (Xeon E3 v4) require the 3.0 or later BIOS.

I will be investigating details regarding CPU support and will update this entry accordingly. If you have any relevant information or tips, feel free to PM me.


[X11 with C23x PCH] What CPUs are compatible?

Due to changes Intel made to the Skylake platform, I am hesitant to say that non-ECC processors should work. In practice, there is no good reason to use a CPU that does not support ECC anyway, so this should not be a problem for most people.

Supermicro guarantees compatibility with Skylake Celerons, Pentiums, i3s and Xeon E3s.

Kaby Lake CPUs require the 2.x BIOS or later. Additionally, Kaby Lake i3s do not support ECC (Pentiums and Celerons still do).

Note that Coffee Lake and newer are not supported. Yes, this is an entirely artificial limitation imposed by Intel - some users have even managed to boot an X11SSM-F with a Coffee Lake CPU, but the resulting system is extremely unstable, probably due to an old version of the Coffee Lake microcode being present in system firmware. Coffee Lake parts, known as Xeon E (not E3) or i3-8xxx, along with the equivalent Pentiums and Celerons, require a C24x PCH.

[X11 with C24x PCH] What CPUs are compatible?

X11 motherboards with the C24x family of PCHs support only Coffee Lake and newer CPUs. These are known as Xeon E (not Xeon E3) and Core i3-8xxx. There are also equivalent Pentiums and Celerons.

How do I flash the BIOS?

Unlike most desktop motherboards, the simple BIOS flashing method requires a product key from Supermicro. This means we'll need to load an OS and do it from there.

Supermicro provides the latest BIOS version and a flashing tool. These are available for various OSes.

The safest option is probably to use some kind of DOS. I used a FreeDOS live USB drive - particularly the Odin (a more basic than standard) distro. The "regular" distro provided on the same image did not work, failing with an error.


All the sensors read N/A

First of all, make sure you're not in the BIOS setup menu. IPMI monitoring of sensors isn't available there.

If that is not the case, the procedures listed under "The CPU/PCH temperatures read N/A" may help.


The CPU/PCH temperatures read N/A

While the exact cause is unknown, the BMC may enter a faulty state, requiring a reset.

The following options were recommended to me by Supermicro:

  • Start by power cycling the IPMI. This can be done from the web interface.
  • If that doesn't work, reset it to factory defaults via the web interface and power cycle it (it will not work until it is properly power cycled).
Do not attempt unless you are having the problem described above.
  • If all else fails, reflashing the Management Engine firmware should do the trick. However, this is only possible in a certain ME recovery mode dictated by jumpers. Please contact Supermicro for details. Your specific motherboard model's manual may explain the procedure.

    For the X10SLM+-F (may not apply to other models!), the JPME1 and JPME2 must bridge pins 2 and 3.


    In this mode, flashing the BIOS will also flash the ME firmware. After flashing, turn everything off and unplug everything. Clear CMOS and reset the jumpers to their original positions.

Once the problem is solved, reconfigure everything via the IPMI web interface.


My server's fans keep spinning up and down
Fan thresholds are set to unrealistic values, how do I change them?
Setting IPMI sensor thresholds


Supermicro motherboards have their fans monitored by the BMC, which automatically attempts to recover stalling (of the motor, not in the aerodynamic sense) fans by spinning them up to maximum (PWM set to 100% speed). This behavior is determined by the sensor thresholds.

Supermicro motherboard fan profiles are controlled via IPMI. Unfortunately, only very basic functions are exposed via its web interface and Supermicro's own IPMI utility is superbly well hidden on Supermicro's website and uses Java. The pragmatists among us would complain about Java, use the application, and move on - however, for some reason (*cough* Java *cough*) Supermicro application and its nice GUI do not always work properly. Thus, third-party universal IPMI tools are needed.

I have written two guides dedicated to this issue, with step-by-step instructions:
Part 1, which uses ipmitool, can be used directly on FreeNAS.
Part 2, which uses ipmiutil, is meant for use on a remote client machine.


I would like to learn more about how the fans are managed

GrumpyBear explains many details in his Thermal and Accoustical Design Validation thread.


My long IPMI password doesn’t seem to work
What’s the limit on IPMI password length?


Empirical evidence suggests that the IPMI solution on the Supermicro X10 series only allows passwords up to 19 characters in length. This seems to be undocumented, however.


[X10SL7-F] - The LSI SAS2308 flashing tool won't work under DOS
[X11SSL-CF] - The LSI SAS3008 flashing tool won't work under DOS


Some UEFI motherboards have trouble flashing LSI SAS controllers outside of the EFI shell.

The easiest solution is to boot into the UEFI shell and use the sas2flash.efi (or sas3flash for SAS3 controllers) tool.

Specific instructions should be similar to the DOS version of the utility, but be sure to consult the official documentation.
Author
Ericloewe
Views
256
First release
Last update
Rating
5.00 star(s) 3 ratings

More resources from Ericloewe

Latest updates

  1. Coffee Lake Update

    I've added Coffee Lake support information to the FAQ, notably the fact that LGA1151 boards are...
  2. Kaby Lake information

    Added some minor details related to Kabe Lake CPUs.
  3. Changelog as of 2016-10-08

    Update 2014-09-06 - Minor clarifications and corrected typos. Update 2015-01-30 - Expanded FAQ...
  4. PSA: Future updates will happen in the resources section

    This is a quick and dirty migration of the thread available here. Future updates will be made...

Latest reviews

Nice summary of potential issues!
great summary.
Great info for folks new at FreeNAS and trying to get the how to fix info on SM X10SL7-F
Top