Sync solution

[vvines]

Hello,

We are reviewing the way we are doing the backups. For now is working fine, we are syncing to an s3 bucket, but we would want to reduce the monthly cost in s3, as it is very expensive at the moment. The problem we have is, more than the space, is the number of transactions the sync is doing to S3. Not sure if anyone else have come with this issue.
The number of objects we have in storage is around a million.
Backup is executing every:

It is configured as a SYNC and to PUSH the objects.

Not sure what could be a good aproach, because from AWS we are paying for PUT, COPY, POST, or LIST requests, and for doing the sync I am assuming that it sends a LIST request to S3 for every file.

Any advise will be appreciated.

Thanks :)

Vanessa

 

[NugentS]

I had exactly the same issue. but using storj
I ended up using Duplicati to do the backup instead which with the right settings solved the issue