Use TrueNAS SCALE as the storage layer for K8s running on separate hosts

dlsniper

Cadet
Joined
Nov 16, 2022
Messages
3
Hi. I'm using TrueNAS SCALE 22.12 and I'd like to expose a dataset as storage for Kubernetes running on a separate host.
This host could be either a VM running on TrueNAS SCALE itself or a Raspberry PI running in my network.
I'm currently using NFS. However, I'm looking for something more robust as I had problems with this in the past (to the point I had to restart the whole K8s deployment to get it working again.
I've heard people mentioning solutions like Rook, but I don't have enough experience with these.
The deployment is on a "homelab" type of scenario, not a mission-critical production workload.
Any advice on what I could use for this scenario?

Thank you!
 

morganL

Captain Morgan
Administrator
Moderator
iXsystems
Joined
Mar 10, 2018
Messages
2,694
You would probably do this using the Democratic CSI driver.

 

dlsniper

Cadet
Joined
Nov 16, 2022
Messages
3
Thanks. I'm currently using NFS with K8s. However, the performance is not great (or maybe I'm doing something wrong).
E.g. To launch a fresh copy of NextCloud from the VM takes about 40 minutes due to the files being copied very slowly.
I haven't had success with the Democratic CSI driver, so I'm using the K8s built-in NFS driver. Maybe that's the reason?
I haven't tried iSCSI as I don't have experience with it.
I guess what I'm looking for is something a bit more robust than this.
 
Top