[11.3] ZFS not freeing space from moved/deleted files until jail stopped.

JimRaynor56

Cadet
Joined
Jan 8, 2018
Messages
3
I'm having an issue with both sabnzbd and nzbget where files that are moved away by sonarr/radarr are not having their space freed until the jail is stopped.

First, some info about my setup. I have 3 pools. Cyprus is my spinning disk storage array, Fiji is my downloads pool, and Jamaica is where my jails live.
I have separate jails for Plex, SABnzbd, NZBGet, Sonarr, and Radarr. Only one of either sab or nzbget is running at any given time, i'm testing out moving to nzbget right now, that's the only reason I have both setup. The issue occurs with both, however.

So in this situation files are downloaded onto Fiji/Downloads and then moved away to Cyprus/Media for long-term storage, but when this happens the space is not freed until I stop the jail for NZBGet (or SAB).
Has anyone else experienced this, or have any idea what is going on? Basic troubleshooting info below.

As far as I can see the files that are taking up space are definitely gone.
Output of ls -laRh /mnt/Fiji
Code:
total 9
drwxr-xr-x  3 root   wheel     3B Feb 13 12:19 .
drwxr-xr-x  5 root   wheel   256B Feb 22 04:22 ..
drwxr-xr-x  7 media  media     7B Feb 23 22:26 Downloads

/mnt/Fiji/Downloads:
total 68
drwxr-xr-x  7 media  media     7B Feb 23 22:26 .
drwxr-xr-x  3 root   wheel     3B Feb 13 12:19 ..
drwxr-xr-x  6 media  media     6B Feb 15 23:49 Complete
drwxrwxrwx  2 media  media     2B Feb 25 05:08 Incomplete
drwxr-xr-x  2 media  media     2B Feb 25 05:09 nzb
drwxr-xr-x  2 media  media     3B Feb 25 05:09 queue
drwxr-xr-x  2 media  media     2B Feb 25 05:07 tmp

/mnt/Fiji/Downloads/Complete:
total 59
drwxr-xr-x  6 media  media     6B Feb 15 23:49 .
drwxr-xr-x  7 media  media     7B Feb 23 22:26 ..
drwxr-xr-x  2 media  media     2B Feb 13 12:20 Books
drwxr-xr-x  2 media  media     2B Feb 22 22:35 Movies
drwxr-xr-x  2 media  media     2B Feb 13 12:21 Music
drwxr-xr-x  2 media  media     2B Feb 25 05:09 TV

/mnt/Fiji/Downloads/Complete/Books:
total 1
drwxr-xr-x  2 media  media     2B Feb 13 12:20 .
drwxr-xr-x  6 media  media     6B Feb 15 23:49 ..

/mnt/Fiji/Downloads/Complete/Movies:
total 25
drwxr-xr-x  2 media  media     2B Feb 22 22:35 .
drwxr-xr-x  6 media  media     6B Feb 15 23:49 ..

/mnt/Fiji/Downloads/Complete/Music:
total 1
drwxr-xr-x  2 media  media     2B Feb 13 12:21 .
drwxr-xr-x  6 media  media     6B Feb 15 23:49 ..

/mnt/Fiji/Downloads/Complete/TV:
total 25
drwxr-xr-x  2 media  media     2B Feb 25 05:09 .
drwxr-xr-x  6 media  media     6B Feb 15 23:49 ..

/mnt/Fiji/Downloads/Incomplete:
total 33
drwxrwxrwx  2 media  media     2B Feb 25 05:08 .
drwxr-xr-x  7 media  media     7B Feb 23 22:26 ..

/mnt/Fiji/Downloads/nzb:
total 33
drwxr-xr-x  2 media  media     2B Feb 25 05:09 .
drwxr-xr-x  7 media  media     7B Feb 23 22:26 ..

/mnt/Fiji/Downloads/queue:
total 22
drwxr-xr-x  2 media  media     3B Feb 25 05:09 .
drwxr-xr-x  7 media  media     7B Feb 23 22:26 ..
-rw-r--r--  1 media  media   2.4K Feb 25 05:08 stats

/mnt/Fiji/Downloads/tmp:
total 9
drwxr-xr-x  2 media  media     2B Feb 25 05:07 .
drwxr-xr-x  7 media  media     7B Feb 23 22:26 ..


But they still take up space.
Output of zfs get used,available Fiji/Downloads
Code:
NAME            PROPERTY   VALUE  SOURCE
Fiji/Downloads  used       5.09G  -
Fiji/Downloads  available  218G   -


I don't have any relevant snapshots
Output of zfs list -t snapshot
Code:
NAME                                                USED  AVAIL  REFER  MOUNTPOINT
Jamaica/iocage/releases/11.3-RELEASE/root@Plex      112K      -   382M  -
Jamaica/iocage/releases/11.3-RELEASE/root@Sonarr    112K      -   382M  -
Jamaica/iocage/releases/11.3-RELEASE/root@Radarr    112K      -   382M  -
Jamaica/iocage/releases/11.3-RELEASE/root@SABnzbd   112K      -   382M  -
Jamaica/iocage/releases/11.3-RELEASE/root@NZBget    104K      -   382M  -
freenas-boot/ROOT/default@2020-02-01-11:52:48      10.1M      -  1017M  -


And as far as I can tell nothing is running that is holding onto any files on the whole pool
Output of lsof -w | grep Fiji
Code:
NO OUTPUT


But if I stop the jail for sab or nzbget (I have this problem with both, although only one is ever running at a time), then the space is immediately freed.
 

JimRaynor56

Cadet
Joined
Jan 8, 2018
Messages
3
Can confirm this is still an issue with 11.3-U1. I didn't expect the update to change anything, but I thought I would try anyway.
 

JimRaynor56

Cadet
Joined
Jan 8, 2018
Messages
3
For now I set up a cron job to restart my NZBget jail every morning, but this isn't really a permanent solution. I'm hoping someone will have some insight into what is causing this, or could at least point me in the right direction. I've exhausted all of the usual causes of this issue (as far as I know).
 

sretalla

Powered by Neutrality
Moderator
Joined
Jan 1, 2016
Messages
9,702
You can forget having it solved in 11.3, but it also isn't solved in 12, so the workaround is it. I originally saw a ticket for it when Redmine was still a thing, but I can't find any reference to it in Jira, so I guess either somebody raises it or it won't be solved in future versions either.
 
Top