Note sure where I should post this; I guess I will start in this forum.
Using bhyve to run a Linux virtual machine. I want to do a hardware pass-through on one of the SAS controllers; it has an LTO tape drive attached to it. I followed the standard process to identify the controller and mask it via the boot time environmental variables vmm_load and pptdevs. This worked, and the controller was now masked from FreeNAS. The next step was to pass "-S -s 7,passthru,2/0/0" to the byhvye command line, and "-S" to the grub-bhyve command. This is where it gets unpleasant since there is no way in the GUI to do this. Since I only needed to run this one vm, I ended up directly editing the changes into the /usr/local/lib/python3.6/site-packages/middlewared/plugins/vm. py code. Definitely not elegant, but it worked for my short-term needs. The changes I made:
root@maragor[...3.6/site-packages/middlewared/plugins]# diff vm.py-esh vm.py
113a114
> '-S',
117a119
> '-s', '7,passthru,2/0/0',
245c247
< 'grub-bhyve', '-m', device_map_file,
---
> 'grub-bhyve', '-S', '-m', device_map_file,
The feature request is for the GUI to include two string values per-vm; one is appended to the bhyve command, and the other to the grub-bhyve command. This will allow one to append any options that you haven't thought of.
BTW,
The end result works just fine:
[root@belkira ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)
[root@belkira ~]# uname -a
Linux belkira.cedar-republic.com 3.10.0-957.27.2.el7.x86_64 #1 SMP Mon Jul 29 17:46:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
[root@belkira ~]# lsscsi -v
[0:0:0:0] tape IBM ULTRIUM-HH3 93G7 /dev/st0
dir: /sys/bus/scsi/devices/0:0:0:0 [/sys/devices/pci0000:00/0000:00:07.0/host0/port-0:0/end_device-0:0/target0:0:0/0:0:0:0]
[root@belkira ~]# lspci -v
(unrelated stuff removed)
00:07.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
Subsystem: LSI Logic / Symbios Logic Device 3060
Flags: bus master, fast devsel, latency 0, IRQ 20
I/O ports at 2100
Memory at c0010000 (64-bit, prefetchable) [size=64K]
Memory at c0040000 (64-bit, prefetchable) [size=256K]
[virtual] Expansion ROM at c0100000 [disabled] [size=1M]
Capabilities: [50] Power Management version 3
Capabilities: [68] Express Endpoint, MSI 00
Capabilities: [d0] Vital Product Data
Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [c0] MSI-X: Enable+ Count=16 Masked-
Kernel driver in use: mpt2sas
Kernel modules: mpt2sas
Using bhyve to run a Linux virtual machine. I want to do a hardware pass-through on one of the SAS controllers; it has an LTO tape drive attached to it. I followed the standard process to identify the controller and mask it via the boot time environmental variables vmm_load and pptdevs. This worked, and the controller was now masked from FreeNAS. The next step was to pass "-S -s 7,passthru,2/0/0" to the byhvye command line, and "-S" to the grub-bhyve command. This is where it gets unpleasant since there is no way in the GUI to do this. Since I only needed to run this one vm, I ended up directly editing the changes into the /usr/local/lib/python3.6/site-packages/middlewared/plugins/vm. py code. Definitely not elegant, but it worked for my short-term needs. The changes I made:
root@maragor[...3.6/site-packages/middlewared/plugins]# diff vm.py-esh vm.py
113a114
> '-S',
117a119
> '-s', '7,passthru,2/0/0',
245c247
< 'grub-bhyve', '-m', device_map_file,
---
> 'grub-bhyve', '-S', '-m', device_map_file,
The feature request is for the GUI to include two string values per-vm; one is appended to the bhyve command, and the other to the grub-bhyve command. This will allow one to append any options that you haven't thought of.
BTW,
The end result works just fine:
[root@belkira ~]# cat /etc/redhat-release
CentOS Linux release 7.6.1810 (Core)
[root@belkira ~]# uname -a
Linux belkira.cedar-republic.com 3.10.0-957.27.2.el7.x86_64 #1 SMP Mon Jul 29 17:46:05 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux
[root@belkira ~]# lsscsi -v
[0:0:0:0] tape IBM ULTRIUM-HH3 93G7 /dev/st0
dir: /sys/bus/scsi/devices/0:0:0:0 [/sys/devices/pci0000:00/0000:00:07.0/host0/port-0:0/end_device-0:0/target0:0:0/0:0:0:0]
[root@belkira ~]# lspci -v
(unrelated stuff removed)
00:07.0 Serial Attached SCSI controller: LSI Logic / Symbios Logic SAS2308 PCI-Express Fusion-MPT SAS-2 (rev 05)
Subsystem: LSI Logic / Symbios Logic Device 3060
Flags: bus master, fast devsel, latency 0, IRQ 20
I/O ports at 2100
Memory at c0010000 (64-bit, prefetchable) [size=64K]
Memory at c0040000 (64-bit, prefetchable) [size=256K]
[virtual] Expansion ROM at c0100000 [disabled] [size=1M]
Capabilities: [50] Power Management version 3
Capabilities: [68] Express Endpoint, MSI 00
Capabilities: [d0] Vital Product Data
Capabilities: [a8] MSI: Enable- Count=1/1 Maskable- 64bit+
Capabilities: [c0] MSI-X: Enable+ Count=16 Masked-
Kernel driver in use: mpt2sas
Kernel modules: mpt2sas
