Hello,
What I am trying to do is to pass through the controller so FreeNAS could easily work over the disk. I am going to try FreeNAS on VM for a while. If it works fine, I will be using it as file sever . I am using it on VM so to not have second server.
HDDs pass through the proxmox, so the controller firmware is OK. Proxmox is installed on ZFS mirror made over proxmox on cheap SSDs (cheap intel SSDs, I am not happy with them so far).
VMs are installed to 1 TB ZFS mirror on SSDs again. Those are expensive and work really well.
VM for the FreeNAS has those settings:
Grub config is like that:
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Proxmox Virtual Environment"
GRUB_CMDLINE_LINUX_DEFAULT="rootdelay=4 quiet intel_iommu=on"
GRUB_CMDLINE_LINUX="root=ZFS=rpool/ROOT/pve-1 boot=zfs"
As soon as I start VM, the whole Proxmox crashes. If I remove PCI Device 03:00 which is the LSI controller, FreeNAS stats but I cannot see the HDDs.
So far I could add single HDD and I could add all the HDDs I want to use as storage: 2x8TB, 2x6TB, 2x3TB. If I cant pass-through the controller, I will not be able to hotswap.
I am missing something and don't know what it is.
"#lspci -nn|grep SAS" returns: 03:00.0 RAID bus controller [0104]: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
03:00 means all functions. I have tried 03:00.0 too. no luck so far.
I am thinking if I can pass-through HDDs one by one, there should not be an hardware issue. Nevertheless I consider trying H710 mini mono IT mode (yes, it is possible).
CPUs I have is 2 x Intel(R) Xeon(R) CPU E5-2690 0 @ 2.90GHz and RAM is 128 GB.
I believe I did everything as it should be. Probably missing something and cant figure it out. May be something with the vfio driver.
Anybody with suggestions what else to do?
P.S.
Please don't start with "FreeNAS is not for VM". I have read a lot and I am just about to but another machine just for the FreeNAS, but I would really prefer to have single server only. I don't want to manage multiple servers.
What I am trying to do is to pass through the controller so FreeNAS could easily work over the disk. I am going to try FreeNAS on VM for a while. If it works fine, I will be using it as file sever . I am using it on VM so to not have second server.
HDDs pass through the proxmox, so the controller firmware is OK. Proxmox is installed on ZFS mirror made over proxmox on cheap SSDs (cheap intel SSDs, I am not happy with them so far).
VMs are installed to 1 TB ZFS mirror on SSDs again. Those are expensive and work really well.
VM for the FreeNAS has those settings:
Grub config is like that:
GRUB_DEFAULT=0
GRUB_TIMEOUT=5
GRUB_DISTRIBUTOR="Proxmox Virtual Environment"
GRUB_CMDLINE_LINUX_DEFAULT="rootdelay=4 quiet intel_iommu=on"
GRUB_CMDLINE_LINUX="root=ZFS=rpool/ROOT/pve-1 boot=zfs"
As soon as I start VM, the whole Proxmox crashes. If I remove PCI Device 03:00 which is the LSI controller, FreeNAS stats but I cannot see the HDDs.
So far I could add single HDD and I could add all the HDDs I want to use as storage: 2x8TB, 2x6TB, 2x3TB. If I cant pass-through the controller, I will not be able to hotswap.
I am missing something and don't know what it is.
"#lspci -nn|grep SAS" returns: 03:00.0 RAID bus controller [0104]: LSI Logic / Symbios Logic SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] [1000:0072] (rev 03)
03:00 means all functions. I have tried 03:00.0 too. no luck so far.
I am thinking if I can pass-through HDDs one by one, there should not be an hardware issue. Nevertheless I consider trying H710 mini mono IT mode (yes, it is possible).
CPUs I have is 2 x Intel(R) Xeon(R) CPU E5-2690 0 @ 2.90GHz and RAM is 128 GB.
I believe I did everything as it should be. Probably missing something and cant figure it out. May be something with the vfio driver.
Anybody with suggestions what else to do?
P.S.
Please don't start with "FreeNAS is not for VM". I have read a lot and I am just about to but another machine just for the FreeNAS, but I would really prefer to have single server only. I don't want to manage multiple servers.