Monitoring progress of a Cloud Sync task

Martin Aspeli

Dabbler
Joined
Jan 13, 2016
Messages
29
Hi,

I have a backup job that syncs 377Gb in ca 257k files (which change relatively slowly, maybe a few dozen changes per day) to Backblaze B2. Most of them are photos.

More recently, I've created an rsync job that copies a bunch of configuration from various jails (their /etc folders and a few other bits) to the backup root folder so that these are backed up to (this accounts for ca 2Gb, 120k files).

Since adding the config files, the backup job takes a very long time. Sometimes more than 24 hours. Sometimes I wonder if it's stalled. It's possible that the root cause is slow network (everyone here is home working...) or remote (maybe Backblaze is experiencing a surge in demand?) but I don't think so. I have had it complete, though, and if I kick it off manually it'll generally be done in a small number of hours.

I would like to diagnose this further, maybe by monitoring progress and log output in a more verbose way, but I can't figure out a way to do so. Any tips?

Looking at top, `rclone` is using ca 1.1Gb of memory right now ("size").
 
Last edited:
Top