Backup to iDrive possible?

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
An ACL wouldn't be any real security for non-encrypted files anyway.
 

ryandasilva

Dabbler
Joined
Jun 12, 2021
Messages
27
sorry to bring up an almost year old thread but im trying to get iDrive working with my TrueNAS Core system and having a bit of trouble on the initial upload. I've installed the IDrive scripts to the base freebsd OS and start the upload.. but at some point it stops. do I have to keep an SSH connection open? or should this be run on the server console so that it doesn't close and the script stays running?

Is there a way to run these scripts as a service?
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,466
do I have to keep an SSH connection open?
If you launched the script from a SSH session, that session probably needs to stay open. Or use tmux, which is designed for things like this.

The context of that link is drive testing, but tmux would work in any such situation.
 

ryandasilva

Dabbler
Joined
Jun 12, 2021
Messages
27
If you launched the script from a SSH session, that session probably needs to stay open. Or use tmux, which is designed for things like this.

The context of that link is drive testing, but tmux would work in any such situation.

after posting this I noticed that they use a cron job and it appears there is some sort of service running Their scripts. I had to update my idrive scripts though.. i was running a very old version of them and then the new one seemed to have a whole bunch of new features including a self installing cron job service of sorts.

never heard of txmux. Thanks for suggestion i dont know if i’ll need it but I always like to learn new Linux commands and tools.
 

niccoc1603

Cadet
Joined
Jun 7, 2022
Messages
1
Hi, I am considering building a TrueNAS station, can anyone confirm the iDrive backup works with the latest scripts? Thanks
 

Samuel Tai

Never underestimate your own stupidity
Moderator
Joined
Apr 24, 2020
Messages
5,399

DavidYLau

Dabbler
Joined
Jul 30, 2022
Messages
28
Hi, I'm another new SCALE user that would like to use iDrive for cloud back-up.

I found this container:

Has anybody used this on SCALE?
 

TN68

Dabbler
Joined
Sep 24, 2022
Messages
31
From idrive chat... and future reference to myself...

Linux scripts download URL:
https://www.idrive.com/online-backup-linux-download
Readme:
https://www.idrive.com/readme

I'm trying to boot QNAP from the house and have some limited programming/linux experience, but I'm starting the process to get TrueNAS up and going on a cheap old PC... getting iDrive up and going is a must before I actually turn the QNAP off.
Oops- I submitted post before I was done.

Should I create a Jail for my household data AND idrive application? As opposed to just creating shares at the OS level? Is everything you do at all supposed to be in a jail? This seems to be a main difference between windows/linux/qnap OS environments.

Any advice on folder structure / place to unzip the idrive files to?
https://www.idrive.com/faq_linux#linuxWeb4
 

TN68

Dabbler
Joined
Sep 24, 2022
Messages
31
Found this excellent guide!
=
https://andrewschneer.com/how-to-back-up-truenas-to-idrive/
=
One minor change / update is the my fresh jail didn't have pkg and curl installed, so you might change this line:
pkg install vim perl5 wget python -> to -> pkg install vim perl5 wget python curl

(if you don't have pkg it prompts you y/n to install it before using it to install the rest of the programs).

Also - your jail name shows up in the cloud/web interface as the "computer name", so if you want something more identifiable than "iDrive" in the list of computers in the web interface, you might name the jail something along the lines of: iDrive_{desired_computer_name}

NEW ISSUE though... I shared the pool instead of dataset I think, and the test backups are not working. I'm not sure if it's an ACL issue or otherwise, I still need to fix that. -Update- ↓

When I made my SMB share I didn't leave the root/wheel owners alone...and made a user and user group the owner. I'm changing that back to default to see if it solves things - it seems the iDrive jail has root as the user as far as I can tell. I suppose the other way to learn/implement is create a non-root user assigned to the iDrive jail and add them to the ACL, but the default root/wheel seems easier to test for now.
 
Last edited:

TN68

Dabbler
Joined
Sep 24, 2022
Messages
31
Follow-up... when I made my SMB's I changed root/wheels as the owner to a specified user/group thinking I only wanted a PC user to have access; but the iDrive jail uses root/wheels - so the error was my SMB share setup, disallowing the jail to read the files. It looks like it can compile/prepare a file list now instead of failed after listing a couple directories and terminating. I like the idea of having a specific jail user instead borrowing root... it seems more secure but maybe it's not.
-
Side note - on QNAP/iDrive you could schedule multiple jobs... w/ TrueNAS/iDrive scripts it appears you can have only 1 default backup set via the web dashboard/computer console. I like having a seperate backup job which handles large PC backup files (10's to 100's of GBs) - that way small files can run in parallel instead of being held hostage by the large file in queue/process. One solution I'm mulling for TrueNAS is you just create two idrive jails.... one for small files nightly backup, an another for large files, each with their repective mounts for scheduled backups.
 

RenoFischa

Cadet
Joined
Nov 6, 2022
Messages
1
Hi, I'm another new SCALE user that would like to use iDrive for cloud back-up.

I found this container:

Has anybody used this on SCALE?
I made my own docker container for using IDrive on SCALE.
It's based on this container: https://hub.docker.com/r/baroka/idrive
But with improvements so you don't have to manually login again after each restart of the container.
Available on Docker Hub: https://hub.docker.com/r/renofischa/idrive
Configuration example is on Github: https://github.com/RenoFischa/idrive
 

jrp

Dabbler
Joined
Jan 2, 2023
Messages
39
I am also interested using IDrive to back up my TrueNAS


As discussed above these are just PERL scripts for the most part.

Has anyone successfully backed up TrueNAS Scale to IDrive using the PERL Scripts from IDrive?
 

jrp

Dabbler
Joined
Jan 2, 2023
Messages
39
its next on my list; i got rsync straightened out for one backup, working on replication now for a pool copy (having lots of issues with that). then ill get this up, probably this next week. i'll post here
@markgca how'd you make out?
 

ziggy90127

Cadet
Joined
Jun 22, 2023
Messages
1
According to https://forum.rclone.org/t/setting-rclone-for-idrive/20822?page=2, someone got it to work with iDrive using the S3 driver.
The URL https://cloud.idrive.com/ now says:

IDrive® Cloud Service Is Unavailable Now​


The IDrive® Cloud (S3 compatible object storage) service is discontinued from 31-March-2023. We recommend you switch to IDrive® e2, a faster, S3-compatible hot object storage.

Seems thatiDrive e2 is more expensive than iDrive, not sure what cloud.idrive.com was.
 

wgb920

Dabbler
Joined
Mar 18, 2023
Messages
10
If you use iDrive e2, you can backup TrueNAS SCALE using a Cloud Sync task under Data Protection.

In iDrive e2 (a different iDrive service than the original iDrive), create a bucket and then add an access key. That will give you a region, url, key, and secret.

In TrueNAS SCALE go to Credentials->Backup Credentials and click to add a cloud credential. Choose Amazon S3 for the provider, then add the region, url, key and secret.
1688673635353.png


Save the credential and go to Data Protection to add a Cloud Sync Task. Select your credential you just created, fill out your other settings. I was getting an error until I clicked 'Follow Symlinks." That is the only advanced option I changed.
1688673842380.png
 

fastzombies

Explorer
Joined
Aug 11, 2022
Messages
57
Thanks for this tip, I was digging around for an iDrive docker image.

How did you setup your cloud sync task? I keep getting an error on dry run:

[EFAULT] Errors: 2 (retrying may help) Transferred: 23220 / 23220, 100% Elapsed time: 2.7s Failed to sync with 2 errors: last error was: not deleting files as there were IO errors
 

wgb920

Dabbler
Joined
Mar 18, 2023
Messages
10
I glad I could help. I provided a screenshot of my cloud sync task. Let me know if something is unclear about that. The exact screenshot provided actually failed. It worked when I chose a subdirectory (dataset1) to the primary dataset, which is selected in the screenshot.
 
Top