Upgrade from 11.2U7 -> 11.3: virtual machine doesn't start any more

[darthvader42]

I recently upgraded to 11.3. The only issue I'm seeing is that a virtual machine that used to start without any issue in 11.2U7 doesn't start any more.
The VM hosts a docker/rancheros installation.

After a fresh boot of FreeNAS the VM shows up as non running.

A manual attempt to start it in the UI using the "Start" button and opening a serial console directly afterwards shows a root shell of Freenas:

After the manual startup attempt I see in /var/log/vm/rancheros_0_2 this being appended:

Code:

[2020-02-17 17:52:03,863] (DEBUG) VMService.vm_2.run():179 - ====> NIC_ATTACH: igb0
[2020-02-17 17:52:03,870] (DEBUG) VMService.vm_2.run():274 - Starting grub-bhyve: grub-bhyve -m /tmp/tmp8dxl__ii -r host -M 4096 -d /mnt/pool1/.bhyve_containers/configs/2_rancheros0/grub 2_rancheros0
[2020-02-17 17:52:05,132] (DEBUG) VMService.vm_2.run():291 - Starting bhyve: bhyve -A -H -w -c 2 -m 4096 -s 0:0,hostbridge -s 31,lpc -l com1,/dev/nmdm2A -s 4,e1000,tap0,mac=00:a0:98:73:71:30 -s 3:0,ahci,hd:/mnt/pool1/vms/rancheros_0_rancheros0 2_rancheros0
[2020-02-17 17:52:06,999] (DEBUG) VMService.vm_2.run():313 - rancheros0: rdmsr to register 0x140 on vcpu 0
[2020-02-17 17:52:07,000] (DEBUG) VMService.vm_2.run():313 - rancheros0: wrmsr to register 0x140(0) on vcpu 0
[2020-02-17 17:52:07,182] (DEBUG) VMService.vm_2.run():313 - rancheros0: rdmsr to register 0x140 on vcpu 1
[2020-02-17 17:52:07,183] (DEBUG) VMService.vm_2.run():313 - rancheros0: wrmsr to register 0x140(0) on vcpu 1
[2020-02-17 17:52:25,415] (DEBUG) VMService.vm_2.run():313 - rancheros0: rdmsr to register 0x34 on vcpu 0
[2020-02-17 17:52:42,312] (DEBUG) VMService.vm_2.run():313 - rancheros0: Unhandled ps2 mouse command 0xe1
[2020-02-17 17:52:42,827] (DEBUG) VMService.vm_2.run():313 - rancheros0: Unhandled ps2 mouse command 0x0a
[2020-02-17 17:52:42,828] (DEBUG) VMService.vm_2.run():313 - rancheros0: Unhandled ps2 mouse command 0x01
[2020-02-17 17:52:42,829] (DEBUG) VMService.vm_2.run():313 - rancheros0: Unhandled ps2 mouse command 0x41
[2020-02-17 17:52:43,343] (DEBUG) VMService.vm_2.run():313 - rancheros0: Unhandled ps2 mouse command 0x88

I'm confident it's not lack of RAM. Freenas has 16GB RAM, the VM has 4GB configured. This setup worked without any issues prior to the upgrade.

Any hints on these questions are appreciated:
1) why doesn't the VM do autostart even it's configured to do so?
2) why does the manual startup produce some output in the log, but the serial console shows a root shell and the machine doesn't come up?

 

[drinking12many]

Same thing happened to my rancherOS its not really supported anymore I dont know if that is due to something in bhyve, I built a new VM with a CentOS install and then installed docker and rancher after spending a couple days trying to figure it out. Its something to do with how grub is done in previous releases vs now, but i got tired of trying to figure it out and just moved to a Linux VM.

 

[KrisBee]

See https://www.ixsystems.com/blog/library/freenas-11-3-release/ -

The built-in Docker template has been removed, though Docker can still be deployed in a Linux Virtual Machine.

But, I though any existing rancher should still boot. Some ideas in this thread might help: https://www.ixsystems.com/community/threads/rancher-migration-in-11-3.81792/#post-569280

 

[darthvader42]

Thanks. Even if it's stated in the release notes it's kind of annoying that a minor upgrade has breanking changes. I would have expected that the upgrade at least interactively warns you beforehand.
I'll dig through the rancheros migration thread - thanks for pointing me there.

 

[KrisBee]

Good luck with that. I don't think ixsystems would regard 11.2 -> 11.3 as a minor upgrade.

 

[darthvader42]

Which sounds weird. Most software applies https://semver.org/ to some extend.