Hi Guys,
i recently notices on boot i get the following error
Researching i found its related to THE CPU does't support Intel VT-x with Extended Page Tables (EPT). i use Intel(R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (2000.00-MHz K8-class CPU)
checking the intel specs features my CPU supporting EPT, VT-x and VT-d https://ark.intel.com/products/81055/Intel-Xeon-Processor-E5-2683-v3-35M-Cache-2_00-GHz. in my X10SRi-F BIOS VM Support and VT-d are both enable. as i run FN on ESXi i booted bare metal to FN and can see that error as well so i don't think its related to ESXi.
POPCNT feature showing https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html
is there any setting in the BIOS i might missed and need to enables? or any other solution to fix this error?
Other informations
1 yo Bug report i found
https://redmine.ixsystems.com/issues/25674
dmesg output
i recently notices on boot i get the following error
Code:
vmx_init: processor does not support VMX operation module_register_init: MOD_LOAD (vmm, 0xffffffff82a1c470, 0) error 6
Researching i found its related to THE CPU does't support Intel VT-x with Extended Page Tables (EPT). i use Intel(R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (2000.00-MHz K8-class CPU)
checking the intel specs features my CPU supporting EPT, VT-x and VT-d https://ark.intel.com/products/81055/Intel-Xeon-Processor-E5-2683-v3-35M-Cache-2_00-GHz. in my X10SRi-F BIOS VM Support and VT-d are both enable. as i run FN on ESXi i booted bare metal to FN and can see that error as well so i don't think its related to ESXi.
POPCNT feature showing https://www.freebsd.org/doc/handbook/virtualization-host-bhyve.html
Code:
Features2=0xfffa3203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV>
is there any setting in the BIOS i might missed and need to enables? or any other solution to fix this error?
Other informations
1 yo Bug report i found
https://redmine.ixsystems.com/issues/25674
dmesg output
Code:
[root@freenas ~]# dmesg Copyright (c) 1992-2018 The FreeBSD Project. Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994 The Regents of the University of California. All rights reserved. FreeBSD is a registered trademark of The FreeBSD Foundation. FreeBSD 11.2-STABLE #0 r325575+dac72894653(freenas/11-stable): Sun Sep 9 19:34:18 EDT 2018 root@nemesis.tn.ixsystems.com:/freenas-11.2-releng/freenas/_BE/objs/freenas-11.2-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64 FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0) VT(vga): text 80x25 CPU: Intel(R) Xeon(R) CPU E5-2683 v3 @ 2.00GHz (2000.00-MHz K8-class CPU) Origin="GenuineIntel" Id=0x306f2 Family=0x6 Model=0x3f Stepping=2 Features=0xf83fbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,MMX,FXSR,SSE,SSE2,SS> Features2=0xfffa3203<SSE3,PCLMULQDQ,SSSE3,FMA,CX16,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND,HV> AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM> AMD Features2=0x21<LAHF,ABM> Structured Extended Features=0x27ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,NFPUSG> Structured Extended Features3=0x2c000000<IBPB,STIBP,ARCH_CAP> XSAVE Features=0x1<XSAVEOPT> IA32_ARCH_CAPS=0x4 TSC: P-state invariant Hypervisor: Origin = "VMwareVMware" real memory = 25769803776 (24576 MB) avail memory = 24937123840 (23781 MB) Event timer "LAPIC" quality 600 ACPI APIC Table: <PTLTD APIC > FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs FreeBSD/SMP: 8 package(s) WARNING: VIMAGE (virtualized network stack) is a highly experimental feature. MADT: Forcing active-low polarity and level trigger for SCI ioapic0 <Version 2.0> irqs 0-23 on motherboard SMP: AP CPU #3 Launched! SMP: AP CPU #7 Launched! SMP: AP CPU #6 Launched! SMP: AP CPU #1 Launched! SMP: AP CPU #2 Launched! SMP: AP CPU #5 Launched! SMP: AP CPU #4 Launched! random: entropy device external interface random: registering fast source Intel Secure Key RNG random: fast provider: "Intel Secure Key RNG" kbd1 at kbdmux0 nexus0 vtvga0: <VT VGA driver> on motherboard cryptosoft0: <software crypto> on motherboard aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard padlock0: No ACE support. acpi0: <INTEL 440BX> on motherboard acpi0: Power Button (fixed) hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0 Timecounter "HPET" frequency 14318180 Hz quality 950 cpu0: <ACPI CPU> numa-domain 0 on acpi0 cpu1: <ACPI CPU> numa-domain 0 on acpi0 cpu2: <ACPI CPU> numa-domain 0 on acpi0 cpu3: <ACPI CPU> numa-domain 0 on acpi0 cpu4: <ACPI CPU> numa-domain 0 on acpi0 cpu5: <ACPI CPU> numa-domain 0 on acpi0 cpu6: <ACPI CPU> numa-domain 0 on acpi0 cpu7: <ACPI CPU> numa-domain 0 on acpi0 attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0 Timecounter "i8254" frequency 1193182 Hz quality 0 Event timer "i8254" frequency 1193182 Hz quality 100 atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0 atrtc0: registered as a time-of-day clock, resolution 1.000000s Event timer "RTC" frequency 32768 Hz quality 0 Timecounter "ACPI-fast" frequency 3579545 Hz quality 900 acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1008-0x100b on acpi0 pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0 pci0: <ACPI PCI bus> on pcib0 pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0 pci1: <ACPI PCI bus> on pcib1 isab0: <PCI-ISA bridge> at device 7.0 on pci0 isa0: <ISA bus> on isab0 atapci0: <Intel PIIX4 UDMA33 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0x1060-0x106f at device 7.1 on pci0 ata0: <ATA channel> at channel 0 on atapci0 ata1: <ATA channel> at channel 1 on atapci0 pci0: <bridge> at device 7.3 (no driver attached) vgapci0: <VGA-compatible display> port 0x1070-0x107f mem 0xe8000000-0xefffffff,0xfe000000-0xfe7fffff irq 16 at device 15.0 on pci0 vgapci0: Boot video device pcib2: <ACPI PCI-PCI bridge> at device 17.0 on pci0 pci2: <ACPI PCI bus> on pcib2 pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0 pcib3: [GIANT-LOCKED] pci3: <ACPI PCI bus> on pcib3 mpt0: <LSILogic SAS/SATA Adapter> port 0x4000-0x40ff mem 0xfd5ec000-0xfd5effff,0xfd5f0000-0xfd5fffff irq 18 at device 0.0 on pci3 mpt0: MPI Version=1.5.0.0 pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0 pcib4: [GIANT-LOCKED] pci4: <ACPI PCI bus> on pcib4 xhci0: <XHCI (generic) USB 3.0 controller> mem 0xfd1e0000-0xfd1fffff irq 18 at device 0.0 on pci4 xhci0: 32 bytes context size, 64-bit DMA xhci0: Unable to map MSI-X table usbus0 on xhci0 usbus0: 5.0Gbps Super Speed USB v3.0 pcib5: <ACPI PCI-PCI bridge> at device 21.2 on pci0 pcib5: [GIANT-LOCKED] pcib6: <ACPI PCI-PCI bridge> at device 21.3 on pci0 pcib6: [GIANT-LOCKED] pcib7: <ACPI PCI-PCI bridge> at device 21.4 on pci0 pcib7: [GIANT-LOCKED] pcib8: <ACPI PCI-PCI bridge> at device 21.5 on pci0 pcib8: [GIANT-LOCKED] pcib9: <ACPI PCI-PCI bridge> at device 21.6 on pci0 pcib9: [GIANT-LOCKED] pcib10: <ACPI PCI-PCI bridge> at device 21.7 on pci0 pcib10: [GIANT-LOCKED] pcib11: <ACPI PCI-PCI bridge> at device 22.0 on pci0 pcib11: [GIANT-LOCKED] pci5: <ACPI PCI bus> on pcib11 mpr0: <Avago Technologies (LSI) SAS3008> port 0x5000-0x50ff mem 0xfd4f0000-0xfd4fffff,0xfd480000-0xfd4bffff irq 19 at device 0.0 on pci5 mpr0: Firmware: 16.00.01.00, Driver: 18.03.00.00-fbsd mpr0: IOCCapabilities: 7a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc,FastPath,RDPQArray> pcib12: <ACPI PCI-PCI bridge> at device 22.1 on pci0 pcib12: [GIANT-LOCKED] pcib13: <ACPI PCI-PCI bridge> at device 22.2 on pci0 pcib13: [GIANT-LOCKED] pcib14: <ACPI PCI-PCI bridge> at device 22.3 on pci0 pcib14: [GIANT-LOCKED] pcib15: <ACPI PCI-PCI bridge> at device 22.4 on pci0 pcib15: [GIANT-LOCKED] pcib16: <ACPI PCI-PCI bridge> at device 22.5 on pci0 pcib16: [GIANT-LOCKED] pcib17: <ACPI PCI-PCI bridge> at device 22.6 on pci0 pcib17: [GIANT-LOCKED] pcib18: <ACPI PCI-PCI bridge> at device 22.7 on pci0 pcib18: [GIANT-LOCKED] pcib19: <ACPI PCI-PCI bridge> at device 23.0 on pci0 pcib19: [GIANT-LOCKED] pci6: <ACPI PCI bus> on pcib19 vmx0: <VMware VMXNET3 Ethernet Adapter> port 0x6000-0x600f mem 0xfd3fc000-0xfd3fcfff,0xfd3fd000-0xfd3fdfff,0xfd3fe000-0xfd3fffff irq 16 at device 0.0 on pci6 vmx0: Ethernet address: 00:0c:29:ab:00:cc pcib20: <ACPI PCI-PCI bridge> at device 23.1 on pci0 pcib20: [GIANT-LOCKED] pcib21: <ACPI PCI-PCI bridge> at device 23.2 on pci0 pcib21: [GIANT-LOCKED] pcib22: <ACPI PCI-PCI bridge> at device 23.3 on pci0 pcib22: [GIANT-LOCKED] pcib23: <ACPI PCI-PCI bridge> at device 23.4 on pci0 pcib23: [GIANT-LOCKED] pcib24: <ACPI PCI-PCI bridge> at device 23.5 on pci0 pcib24: [GIANT-LOCKED] pcib25: <ACPI PCI-PCI bridge> at device 23.6 on pci0 pcib25: [GIANT-LOCKED] pcib26: <ACPI PCI-PCI bridge> at device 23.7 on pci0 pcib26: [GIANT-LOCKED] pcib27: <ACPI PCI-PCI bridge> at device 24.0 on pci0 pcib27: [GIANT-LOCKED] pci7: <ACPI PCI bus> on pcib27 vmx1: <VMware VMXNET3 Ethernet Adapter> port 0x7000-0x700f mem 0xfd2fc000-0xfd2fcfff,0xfd2fd000-0xfd2fdfff,0xfd2fe000-0xfd2fffff irq 17 at device 0.0 on pci7 vmx1: Ethernet address: 00:0c:29:ab:00:d6 pcib28: <ACPI PCI-PCI bridge> at device 24.1 on pci0 pcib28: [GIANT-LOCKED] pcib29: <ACPI PCI-PCI bridge> at device 24.2 on pci0 pcib29: [GIANT-LOCKED] pcib30: <ACPI PCI-PCI bridge> at device 24.3 on pci0 pcib30: [GIANT-LOCKED] pcib31: <ACPI PCI-PCI bridge> at device 24.4 on pci0 pcib31: [GIANT-LOCKED] pcib32: <ACPI PCI-PCI bridge> at device 24.5 on pci0 pcib32: [GIANT-LOCKED] pcib33: <ACPI PCI-PCI bridge> at device 24.6 on pci0 pcib33: [GIANT-LOCKED] pcib34: <ACPI PCI-PCI bridge> at device 24.7 on pci0 pcib34: [GIANT-LOCKED] acpi_acad0: <AC Adapter> on acpi0 atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0 atkbd0: <AT Keyboard> irq 1 on atkbdc0 kbd0 at atkbd0 atkbd0: [GIANT-LOCKED] psm0: <PS/2 Mouse> irq 12 on atkbdc0 psm0: [GIANT-LOCKED] psm0: model IntelliMouse, device ID 3 acpi_syscontainer0: <System Container> on acpi0 orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc9fff,0xca000-0xcafff,0xcb000-0xcbfff,0xdc000-0xdffff,0xe0000-0xe7fff on isa0 ZFS filesystem version: 5 ZFS storage pool version: features support (5000) Timecounters tick every 10.000 msec freenas_sysctl: adding account. freenas_sysctl: adding directoryservice. freenas_sysctl: adding middlewared. freenas_sysctl: adding network. freenas_sysctl: adding services. ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled ugen0.1: <0x15ad XHCI root HUB> at usbus0 uhub0: <0x15ad XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0 mpr0: SAS Address for SATA device = 243e8188a497889d mpr0: SAS Address for SATA device = 243e8188a49b939d mpr0: SAS Address for SATA device = 243e8188ad84889d mpr0: SAS Address for SATA device = 243e8188a497a79d mpr0: SAS Address for SATA device = 243e8188a69b849d mpr0: SAS Address for SATA device = 243e8188ad797f9d mpr0: SAS Address for SATA device = 243e8188a999859d mpr0: SAS Address for SATA device = 243e8188ad8e7f9d mpr0: SAS Address from SAS device page0 = 4433221100000000 mpr0: SAS Address from SATA device = 243e8188a497889d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0009> enclosureHandle<0x0001> slot 3 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221101000000 mpr0: SAS Address from SATA device = 243e8188a49b939d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000a> enclosureHandle<0x0001> slot 2 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221102000000 mpr0: SAS Address from SATA device = 243e8188ad84889d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000b> enclosureHandle<0x0001> slot 0 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221103000000 mpr0: SAS Address from SATA device = 243e8188a497a79d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000c> enclosureHandle<0x0001> slot 1 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221104000000 mpr0: SAS Address from SATA device = 243e8188a69b849d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000d> enclosureHandle<0x0001> slot 7 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221105000000 mpr0: SAS Address from SATA device = 243e8188ad797f9d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000e> enclosureHandle<0x0001> slot 6 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221106000000 mpr0: SAS Address from SATA device = 243e8188a999859d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x000f> enclosureHandle<0x0001> slot 4 mpr0: At enclosure level 0 and connector name ( ) mpr0: SAS Address from SAS device page0 = 4433221107000000 mpr0: SAS Address from SATA device = 243e8188ad8e7f9d mpr0: Found device <881<SataDev,Direct>,End Device> <6.0Gbps> handle<0x0010> enclosureHandle<0x0001> slot 5 mpr0: At enclosure level 0 and connector name ( ) uhub0: 8 ports with 8 removable, self powered ugen0.2: <VMware VMware Virtual USB Mouse> at usbus0 da0 at mpt0 bus 0 scbus2 target 0 lun 0 da0: <VMware Virtual disk 2.0> Fixed Direct Access SPC-4 SCSI device da0: 300.000MB/s transfers da0: Command Queueing enabled da0: 14336MB (29360128 512 byte sectors) da0: quirks=0x140<RETRY_BUSY,STRICT_UNMAP> random: unblocking device. Trying to mount root from zfs:freenas-boot/ROOT/default []... da5 at mpr0 bus 0 scbus3 target 4 lun 0 da5: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da5: Serial Number PK2334PEKBSV6T da5: 600.000MB/s transfers da5: Command Queueing enabled da5: 3815447MB (7814037168 512 byte sectors) da6 at mpr0 bus 0 scbus3 target 5 lun 0 da6: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da6: Serial Number PK2334PEKBWK0T da6: 600.000MB/s transfers da6: Command Queueing enabled da6: 3815447MB (7814037168 512 byte sectors) da4 at mpr0 bus 0 scbus3 target 3 lun 0 da4: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da4: Serial Number PK2334PEKBNT9T da4: 600.000MB/s transfers da4: Command Queueing enabled da4: 3815447MB (7814037168 512 byte sectors) da1 at mpr0 bus 0 scbus3 target 0 lun 0 da1: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da1: Serial Number PK2334PEKBWA9T da1: 600.000MB/s transfers da1: Command Queueing enabled da1: 3815447MB (7814037168 512 byte sectors) da2 at mpr0 bus 0 scbus3 target 1 lun 0 da2: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da2: Serial Number PK2334PEKBNTXT da2: 600.000MB/s transfers da2: Command Queueing enabled da2: 3815447MB (7814037168 512 byte sectors) da8 at mpr0 bus 0 scbus3 target 7 lun 0 da8: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da8: Serial Number PK2334PEKBPX5T da8: 600.000MB/s transfers da8: Command Queueing enabled da8: 3815447MB (7814037168 512 byte sectors) da7 at mpr0 bus 0 scbus3 target 6 lun 0 da7: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da7: Serial Number PK2334PEKBW60T da7: 600.000MB/s transfers da7: Command Queueing enabled da7: 3815447MB (7814037168 512 byte sectors) da3 at mpr0 bus 0 scbus3 target 2 lun 0 da3: <ATA HGST HDN724040AL A5E0> Fixed Direct Access SPC-4 SCSI device da3: Serial Number PK2334PEKBNXDT da3: 600.000MB/s transfers da3: Command Queueing enabled da3: 3815447MB (7814037168 512 byte sectors) vmx_init: processor does not support VMX operation module_register_init: MOD_LOAD (vmm, 0xffffffff82a1c470, 0) error 6 GEOM_MIRROR: Device mirror/swap0 launched (2/2). GEOM_MIRROR: Device mirror/swap1 launched (2/2). GEOM_MIRROR: Device mirror/swap2 launched (2/2). GEOM_MIRROR: Device mirror/swap3 launched (2/2). GEOM_ELI: Device mirror/swap0.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: hardware GEOM_ELI: Device mirror/swap1.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: hardware GEOM_ELI: Device mirror/swap2.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: hardware GEOM_ELI: Device mirror/swap3.eli created. GEOM_ELI: Encryption: AES-XTS 128 GEOM_ELI: Crypto: hardware hwpc_core: unknown PMC architecture: 1 hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> VMware memory control driver initialized vmx0: link state changed to UP vmx1: link state changed to UP uhid0 on uhub0 uhid0: <VMware> on usbus0 uhid1 on uhub0 uhid1: <VMware> on usbus0
