Cannot push large files to Azure

[kkr]

Hi, I'm trying to use a Cloud Sync Task to back up my data to Azure Blob Storage, but it seems like TrueNAS doesn't know how to handle large files in such situations. When uploading something big, I run into the BlockCountExceedsLimit error, which results from uploading too much data without committing it to storage. The task should do periodic commits otherwise the data will not be saved. I can't find any configuration option for something like this. Is there a way to work around the issue?

 

[sretalla]

Seems you have similar issues to this thread

Cloud Sync - Azure block list limit with files larger than 200GB

I'm running into a problem syncing files larger than ~200GB (50,000 blocks) to Azure blob storage. I've determined this is due to the default rclone block size being 4MB. I don't see any GUI settings for adjusting this value. According to rclone documentation, the chunk_size or...

www.truenas.com

Microsoft Azure Blob Storage

Rclone docs for Microsoft Azure Blob Storage

rclone.org

Looks like you need to be able to set the chunk size (which is possible with rclone, just not in the TrueNAS GUI settings).

So your options are:

Live with it and upload smaller things

Abandon cloud sync tasks and use cron instead to launch rclone yourself with the chunk size set as you need.

Raise a bug/feature request and ask for it to be modified in the cloud sync tasks UI.