Freenas hung on Mounting local file system for days

[frozn00]

Removed a jail from the GUI, restarted, and now I am getting Mounting local file systems:. and that is far as it goes. I see a way to escape to loader prompt before that. I have been messing with this for a week. It has stayed on this screen for days and never goes any further. Restarted the other day and still wont' go any further. I am scared I have lost all of my data. Any help is appreciated! If i could somehow repair from the loader prompt or another way that would be great.

FreeNAS-9.2.1.8-RELEASE-x64 (e625626)

 

[dlavigne]

Is this UFS or ZFS? Single disk or some type of redundant configuration?

 

[frozn00]

Is this UFS or ZFS? Single disk or some type of redundant configuration?

Thanks for the reply. It is ZFS, 4 3TB disks software raid

 

[dlavigne]

Can you post a picture of the hung screen? It may be that the USB stick died (if so, these will be UFS messages) and an easy fix is to burn another stick to boot from.

 

[frozn00]

Can you post a picture of the hung screen? It may be that the USB stick died (if so, these will be UFS messages) and an easy fix is to burn another stick to boot from.

Absolutely! Here are some screenshots of bootup. Thanks again!

 

[frozn00]

Can you post a picture of the hung screen? It may be that the USB stick died (if so, these will be UFS messages) and an easy fix is to burn another stick to boot from.

Any ideas?

 

[dlavigne]

Try burning another stick and let us know if that fixes it.

 

[frozn00]

Try burning another stick and let us know if that fixes it.

I used ImageUSB in windows and made a copy of the freenas boot flash drive. Burned that image to a new flash drive and it still hangs on Mounting local file system. I also tried starting from scratch with a completely new flash drive and installed FreeNAS to that and it boots, of course with non of my shares, files, ip, etc. Any ideas what else I can try? Thanks for your help!

 

[sfcredfox]

if there's corruption on the current imagine, you might want to use a fresh copy of the os to rule that out

 

[frozn00]

if there's corruption on the current imagine, you might want to use a fresh copy of the os to rule that out

I am all for using a fresh copy of the os. How can I do that and get back my data that us currently on the raid?

 

[sfcredfox]

well, your os is separate from the data. You should have a backup of your config so you don't have to setup all your users, network, etc. The data in the pool should still be there and be fine. You might need to import it. I had to do this a few times when I was trying to use a USB drive that sucked.

someone correct me if I'm wrong on anything here.

 

[SweetAndLow]

You're correct, they just need to click the auto import button under the storage section. Or they can just upload their backup configuration file and reboot, that will import you pool for you.

 

[frozn00]

You're correct, they just need to click the auto import button under the storage section. Or they can just upload their backup configuration file and reboot, that will import you pool for you.

well, your os is separate from the data. You should have a backup of your config so you don't have to setup all your users, network, etc. The data in the pool should still be there and be fine. You might need to import it. I had to do this a few times when I was trying to use a USB drive that sucked.

someone correct me if I'm wrong on anything here.

After reading what you posted above...I was able to fresh install Freenas 9.3 to a different usb stick and boot into the new gui. I went to volumes and attempted to import the volume and the message below is what I got. This resulted in the freenas becoming unresponsive and I had to do a cold restart. When the freenas came back up, I am presented with the very same message I got the first time...Mounting local file systems. See attached please.

My last backup config I have is a config from Freenas 8.3. I just upgraded to 9.* a few months ago.

 

[frozn00]

You're correct, they just need to click the auto import button under the storage section. Or they can just upload their backup configuration file and reboot, that will import you pool for you.

Still can't import my zpool. I get the message above when I try "out of swap space". I have been trying a 8gb usb flash but space on the flash drive is probably not the problem. Here are some outputs that might can help someone help me. Thanks!

[root@freenas] ~# camcontrol devlist
<ST3000DM001-9YN166 CC4H> at scbus0 target 0 lun 0 (pass0,ada0)
<ST3000DM001-1CH166 CC24> at scbus1 target 0 lun 0 (pass1,ada1)
<ST3000DM001-9YN166 CC4H> at scbus2 target 0 lun 0 (pass2,ada2)
<WDC WD30EFRX-68EUZN0 80.00A80> at scbus3 target 0 lun 0 (pass3,ada3)
<General USB Flash Disk 1100> at scbus7 target 0 lun 0 (pass4,da0)
<HL-DT-ST DVDRRW GSA-2166D 1.02> at scbus8 target 0 lun 0 (cd0,pass5)
[root@freenas] ~# gpart show
=> 34 15728573 da0 GPT (7.5G)
34 1024 1 bios-boot (512k)
1058 6 - free - (3.0k)
1064 15727536 2 freebsd-zfs (7.5G)
15728600 7 - free - (3.5k)

=> 34 5860533101 ada0 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

=> 34 5860533101 ada1 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

=> 34 5860533101 ada2 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

=> 34 5860533101 ada3 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

[root@freenas] ~# zpool status
pool: freenas-boot
state: ONLINE
scan: none requested
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
da0p2 ONLINE 0 0 0

errors: No known data errors
[root@freenas] ~# zpool import
pool: RAID
id: 18446743531164819941
state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
the '-f' flag.
see: http://illumos.org/msg/ZFS-8000-EY
config:

RAID ONLINE
raidz1-0 ONLINE
gptid/e14ca56b-563b-11e2-81b7-009c02a04434 ONLINE
gptid/e1d16360-563b-11e2-81b7-009c02a04434 ONLINE
gptid/e26a198b-563b-11e2-81b7-009c02a04434 ONLINE
gptid/f01a2fbb-0956-11e4-a04c-009c02a04434 ONLINE
[root@freenas] ~#

 

[dlavigne]

Something weird is going on. Please create a bug report at bugs.freenas.org and post the issue number here. The only other time I've seen the swap error was https://bugs.freenas.org/issues/5088, but that seems to be unrelated.

 

[danb35]

@frozn00, your system is complaining that it's out of swap space, which usually means not enough memory. What are your hardware specs? Motherboard, CPU, amount and type of RAM?

 

[frozn00]

@frozn00, your system is complaining that it's out of swap space, which usually means not enough memory. What are your hardware specs? Motherboard, CPU, amount and type of RAM?

Something weird is going on. Please create a bug report at bugs.freenas.org and post the issue number here. The only other time I've seen the swap error was https://bugs.freenas.org/issues/5088, but that seems to be unrelated.

Thanks guys a lot. Here are my system specs. I am trying "zpool import -f RAID" right now to see if that will work. When using the GUI to import, it produces the "out of swap space" message and renders the system useless. It is not until i start from scratch with my usb am I able to get back into the system at all. Loses all network connectivity when it is at the "out of swap space" screen. Here is the screenshot.. Thanks again!

 

[frozn00]

The zpool import -f RAID command finished. Normally when I try and import I lose all network connectivity. I can't ssh anymore but it is allowing me to use the gui. When clicking on View Disks, View Storage or View Volume Manger all I get is Sorry, an error has occurred. I am working with it through RDP from a computer on my home network so I can't tell you what the monitor says at home...but most likely the Out of swap space message.

 

[frozn00]

Nevermind, gui is down too. Tried refreshing the page and it can't find it. I get ping replys from the freenas but gui or ssh doesn't work.

 

[SweetAndLow]

you are only using 6GB of memory and the min in 8GB. I'm not saying this is your issues but it is almost impossible to rule anything out until you get your system up to the minimum spec.