rclone feature request

[hendry]

I need rclone to be able to

* exclude files https://redmine.ixsystems.com/issues/66792
* support --fast-list https://twitter.com/njcw/status/1162640328006017024 https://redmine.ixsystems.com/issues/27364

So wrt #66792 it says it's closed. Does that mean it's implemented? How do I help test this?

#27364 is ready for testing. How do I test?

I'm also keen for https://redmine.ixsystems.com/issues/18875 to hit so I can save on transition costs. https://twitter.com/njcw/status/1162413538104762368

 

[dlavigne]

Both of those features are coming in 11.3: https://jira.ixsystems.com/browse/NAS-100317 and https://jira.ixsystems.com/browse/NAS-100394.

You can test on a nightly. One way to test would be to install a nightly to a different USB stick and boot into it. Once your test is complete, you could boot into your usual boot device.

 

[hendry]

Thanks dlavigne! Is 11.3 scheduled for release anytime soon? I noticed https://www.freebsd.org/releases/11.3R/schedule.html but I guess they aren't aligned. ;)

 

[dlavigne]

Given the painful BETA/RC process for the 11.2 series, we're doing all of the QE upfront, before the release of BETA1, for the 11.3 series. We're about half-way through the QE now and should know the release date by late September. The goal is to have a very stable BETA1, a quick RC, and a quick (and stable) release shortly thereafter.

 

[hendry]

I wouldn't mind the "install a nightly to a different USB stick and boot into it".

Is there good documentation about that? I run a Voidlinux mirror and I need it to boot to its current configuration for the most part. I don't understand where FreeNAS's configuration is stored or migrated.

 

[dlavigne]

If you just want to test, use a throwaway USB stick running nightlies to test on (that way when your test is done, you can just boot into your normal boot device and carry on). That is the safest way to not impact your current config and to easily boot back into your current version of the OS.

 

[hendry]

So basically I boot and import my existing volume and re-setup samba mounts on the beta disk?

 

[dlavigne]

Yes.

 

[hendry]

I just copied FreeNAS-12.0-MASTER-201909051913-8268467.iso to a USB "extreme" stick in order to desperately get a more recent rclone.

The way my current system works is that it boots from an internally mounted USB "ultra fit" stick on da0:
freenas-boot/ROOT/11.2-U5 on / (zfs, local, noatime, nfsv4acls)

So I am quite forgetful how I initially set this up. My FreeNAS is headless which makes it extra painful to work with. Though I could attach a monitor, if only I can find a VGA cable.

What is the procedure?

Do I replace the "ultra fit" with a "new" USB key and install from the "extreme", to the "new"?

Or can I just boot straight into the "extreme" by replacing the "ultra fit" with it?

Or perhaps there is an easier way. I shutdown my freenas. Copy my "ultra fit" to the "extreme" so I have good backup. And then boot the "extreme" and upgrade to nightlies?

 

[dlavigne]

Did you manage a working solution for this?

 

[hendry]

I made a backup of my FreeNAS disk `29G freenas-11-backup.img` and then proceeded to update to nightliies.

I did resolve my cloud syncing issue with the new version.

So I guess when 12 gets released, can I go back to stable?

Or would I need to restore my backup and then upgrade to 12?

 

[dlavigne]

Sooner than that as the fixes are in 11.3 which will be out by end of year.

When it is out, you'll need to be careful with your config, if there have been any changes since switching to nightlies. However, this should allow you to safely sort that once 11.3 is released:

1. Save your config while in the nightly version.
2. Reboot into your latest 11.2 boot environment.
3. While in 11.2, switch to the 11.3 train and update to 11.3.
4. Once the 11.3 update is complete, you should be able to restore the config you saved in step 1.

 

[hendry]

Ok, so there is no migrating from unstable to stable path? That's a shame.

Downtime will be longer when I have turn off my server, and whip out the USB stick.

 

[dlavigne]

Correct, as the config needs to be migrated forward to account for new settings, etc.

 

[Dempf]

Did exclude across filesystem boundaries ever make it into 11.3? (https://redmine.ixsystems.com/issues/66792)

I'm on 11.3 U2 and don't see that option.

 

[Dempf]

Nevermind, I found the issue migrated into the new Jira. Looks like it's still on the backlog: https://jira.ixsystems.com/browse/NAS-100692