FreeNAS hangs when I send find command over ssh or when it runs them with cron

Status
Not open for further replies.

vryeksksk

Dabbler
Joined
Apr 20, 2018
Messages
10
Hey, I'm a freenas newbie but I'm not an IT newbie and would appreciate some help.

I set up a Freenas box at home with these specs:
Code:
WD Red 4TB x 6
ASRock AB350 Pro4
AMD Ryzen 3 2200G
Crucial UDIMM DDR4, 16GB 2400MHz, CL17 ECC 
SanDisk Ultra Flair Drive 16GB
be quiet! STRAIGHT POWER 10 400W


I chose to install FreeNAS 11.2-BETA1 because I noticed it uses new boot environment and I didnt want to deal with upgrading from old boot environment to new one.
I configured everything that I wanted, set up nextcloud jail with SSL and fluff, everything was working fine™
Then I installed FreeNAS 11.2-BETA2 and problems started. To be clear i understand that this is BETA and I'm not expecting it FIXED NOW, I just want some help resolving those issues and maybe opening an issue ticket.

I had two jails, one with nextcloud and another with clamav, i also had a cron that removed old files from recycle bin.
find /mnt/tank/*/.recycle/* -atime +30 -delete; find /mnt/*/.recycle/ -type d -empty -delete
sending this command over ssh or letting it run via cron hangs the server, meaning it cannot be accessed by SSH, nextcloud stops being accessible and samba shares stop working. The most annoying fact that there is nothing in the logs, nothing! I have to restart the server to make it recover from this. Cron runs at 2:00 and I think once i didn't restart the server and see if it recovers and it did, sometime around 12:00, again with nothing in the logs signifying what could be the problem.
If it was a large folder maybe i would understand, but in ./recycle/ folder there is like 5gb of data and like ~3k files.

Another thing is running a clamav scan, same thing. running a scan command on a 3tb data set hangs everything until it finishes.

https://pastebin.com/Bp8i30nN here is today's log after today's hang. I tried manually running the empty recycle bin command above at 13:30 and almost immediately disconnected me from ssh, nextcloud stopped responding over internet and the webgui also wasn't accessible.

How can I troubleshoot this or provide some relevant logs ?
Any help appreciated.
 
Joined
Dec 29, 2014
Messages
1,135
I suspect you are overload the shell with too many values being replaced by the wildcards. You can try it a different way that should work better without the expansions issues:

find /mnt/tank -type d -name .recycle -print |
while read DELDIR
do
find ${DELDIR} -type f -exec rm -f {} \;
done
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I chose to install FreeNAS 11.2-BETA1 because I noticed it uses new boot environment and I didnt want to deal with upgrading from old boot environment to new one.
That is handled by the installation utility and is totally transparent to the user, both upgrading and rolling back. I upgraded a 11.1-U5 system to 11.2-BETA1 just to test it and then rolled back to U5 because I didn't like the interface. Still too rough around the edges.
WD Red 4TB x 6
What kind of pool configuration? Mirrors, RAIDz2, etc. Connected to what, the system board ports?
Then I installed FreeNAS 11.2-BETA2 and problems started.
There have been problems reported with deleting files in 11.2-BETA2 and a ticket was open. If I recall correctly, it is dealt with in 11.2-BETA3. I would suggest rolling back to 11.2-BETA1 for now.
Another thing is running a clamav scan, same thing. running a scan command on a 3tb data set hangs everything until it finishes.
You can open a ticket by creating an account here: https://redmine.ixsystems.com/projects/freenas
Then use the FreeNAS GUI to create the bug report. Here is the relevant section of the manual:
http://doc.freenas.org/11.2/system.html#support
 

vryeksksk

Dabbler
Joined
Apr 20, 2018
Messages
10
That is handled by the installation utility and is totally transparent to the user, both upgrading and rolling back.
Didn't know that, thanks.

What kind of pool configuration? Mirrors, RAIDz2, etc. Connected to what, the system board ports?
RAIDz2, board ports.

There have been problems reported with deleting files in 11.2-BETA2 and a ticket was open. If I recall correctly, it is dealt with in 11.2-BETA3. I would suggest rolling back to 11.2-BETA1 for now.
How can i do that? Just grab the iso, put it on a pendrive and install it over the old one ?

You can open a ticket by creating an account here: https://redmine.ixsystems.com/projects/freenas
Then use the FreeNAS GUI to create the bug report. Here is the relevant section of the manual:
http://doc.freenas.org/11.2/system.html#support

I will wait with that for a bit, I'll see if the next scan will work and then decide what to do. I might also just wait for 11.2-BETA3 to come out, 12 days is not that much.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
How can i do that? Just grab the iso, put it on a pendrive and install it over the old one ?
This is the section of the manual on "Boot Environments": http://doc.freenas.org/11.2/system.html#boot-environments
You simply select the boot environment to be "Active" on next boot and reboot the system. When you upgraded from BETA1 to BETA2, it should have kept your previous boot environment. When you roll back, all the settings will revert to the condition when you last used that boot environment. You can use this to keep test setting changes by cloning (my terminology) the boot environment, booting into that alternate space that has the same settings as your 'working' configuration, then make changes to test things in the 'disposable copy' and see how it goes. If it doesn't work the way you want, just select the original boot environment and reboot to clear your settings back to the way they were and you can delete the 'test' environment if you want and create a new clone for next time. It gives you a lot of flexibility. I have all my old boot environments going back to sometime in 2016 if I recall correctly.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
PS. You should also look at the "General Tab" and use the "Save Config" option to backup the configuration database. That will allow you to restore your system configuration to a fresh install if the boot device should fail and need to be replaced.
http://doc.freenas.org/11.2/system.html#general
 
Status
Not open for further replies.
Top