11.2-U2 broke cloud sync tasks

[pixel8383]

The latest release broke rclone support. I had to roolback to 11.2-U1 to make the cloud sync tasks work again (with no changes to the task configuration).

The error on an SFTP task was:

Code:

2019/02/26 23:00:04 INFO : Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA - Errors: 0 Checks: 0 / 0, - Transferred: 0 / 0, - [16 more lines]
2019/02/26 23:00:04 INFO : Local file system at /Backup: Waiting for transfers to finish
2019/02/26 23:00:04 ERROR : Local file system at /Backup: not deleting files as there were IO errors
2019/02/26 23:00:04 ERROR : Local file system at /Backup: not deleting directories as there were IO errors
2019/02/26 23:00:04 ERROR : Attempt 3/3 failed with 1 errors and: not deleting files as there were IO errors
2019/02/26 23:00:04 Failed to sync: not deleting files as there were IO errors

 

[dlavigne]

This has been reported as https://redmine.ixsystems.com/issues/77412, though you won't be able to see that ticket until the dev has diagnosed the cause and removed the reporter's debug.

 

[pixel8383]

Thanks for your prompt reply. Any suggestion on how to fix nextcloud? The certificate error is still there, even if running on FreeNas 11.2-U1.

 

[Vladimir Vinogradenko]

pixel8383, that redmine issue probably has no connection with your error. SFTP behavior was changed in 11.2U2. Previously, if you've specified remote path like /var/db it was syncing to /home/username/var/db making it impossible to use absolute remote paths. We've fixed that, but if you were using path like /Storage/Music meaning /home/username/Storage/Music, it'll stop working when you upgrade to 11.2U2. Please, check if this is your case.

If it is not, please provide complete log of failed task. You can download it by clicking corresponding button in the New UI. In the old UI you'll see full log path at the bottom, like "See full log file at /tmp/middlewared/jobs/4088.log". Also please provide a screenshot of your cloud sync task configuration. If you don't want to post it here, you can create a private redmine issue.

Thank you for your feedback!

 

[pixel8383]

No, I am not using relative paths instead of absolute paths. I have just checked my remote location opening an sftp connection via SSH: I want to backup public_html/ which is located on root when logging in. The destination folder is another location with absolute path.
I just updated to 11.2-U2.1 to check if it was fixed but didn't work.

Code:

2019/03/05 12:53:57 ERROR : : error reading source directory: directory not found
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for checks to finish
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for transfers to finish
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting files as there were IO errors
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting directories as there were IO errors
2019/03/05 12:53:57 ERROR : Attempt 1/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/05 12:53:57 INFO  :
Transferred:                0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:                 0 / 0, -
Transferred:            0 / 0, -
Elapsed time:        2.8s

2019/03/05 12:53:57 ERROR : : error reading source directory: directory not found
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for checks to finish
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for transfers to finish
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting files as there were IO errors
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting directories as there were IO errors
2019/03/05 12:53:57 ERROR : Attempt 2/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/05 12:53:57 ERROR : : error reading source directory: directory not found
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for checks to finish
2019/03/05 12:53:57 INFO  : Local file system at /mnt/NAS/Backup/Web: Waiting for transfers to finish
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting files as there were IO errors
2019/03/05 12:53:57 ERROR : Local file system at /mnt/NAS/Backup/Web: not deleting directories as there were IO errors
2019/03/05 12:53:57 ERROR : Attempt 3/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/05 12:53:57 Failed to sync: not deleting files as there were IO errors

 

[Vladimir Vinogradenko]

pixel8383, do you mean that you copy remote public_html (relative path) to local FS?

If so please try chainging it to /var/www/public_html (absolute path)

This as well will be fixed in 11.1-U3

 

[pixel8383]

Ok, I had to identify the absolute path of my provider (it wasn't /var/www/public_html but /home/myusername/public_html) and it worked now.

 

[pixel8383]

Code:

2019/03/06 00:04:58 INFO  : remote: Converting token to new format
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 1/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 2/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 3/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 Failed to sync: not deleting files as there were IO errors

This is the error log for a PUSH task from FreeNAS to Dropbox. What about this one?
Thanks for your help,
Emanuele

 

[pixel8383]

I just discovered the task works if I disable the encryption. It stops working when I enable the remote encryption.

 

[pixel8383]

Code:

2019/03/06 00:04:58 INFO  : remote: Converting token to new format
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 1/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 2/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : : error reading destination directory: Error in call to API function "files/list_folder": Path root is not supported for sandbox app.
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for checks to finish
2019/03/06 00:05:00 INFO  : Encrypted drive 'encrypted:/': Waiting for transfers to finish
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting files as there were IO errors
2019/03/06 00:05:00 ERROR : Encrypted drive 'encrypted:/': not deleting directories as there were IO errors
2019/03/06 00:05:00 ERROR : Attempt 3/3 failed with 1 errors and: not deleting files as there were IO errors
2019/03/06 00:05:00 Failed to sync: not deleting files as there were IO errors

This is the error log for a PUSH task from FreeNAS to Dropbox. What about this one?
Thanks for your help,
Emanuele

UP!