LOST ZPOOL, PLEASE HELP

[delphij]

Please do the following, from a shell to your FreeNAS, as 'root', do the following:

Code:

mount -u -w /
cd /boot
mv kernel kernel.old
 
fetch -o - http://people.freebsd.org/~delphij/misc/kernel.tar.xz | tar xf - -C /boot
 
mount -a

Suggestion: copy these commands one by one. The fetch | tar is one line and please make sure the command is typed right.

You should see something like this:

Code:

-            100% of 8105 kB  162 kBps 00m49s

The speed may vary, of course. If you see any error message during the course, do NOT proceed with the rest and let us know.

If you get no errors, you can reboot the system and then 'zpool import -D -R /mnt stor' should bring your pool back.

 

[papageorgi]

seems like it's really close

Code:

[smurfy@t61 ~]$ ssh smurfy@192.168.0.10
buffer_get_ret: trying to get more bytes 4 than in buffer 0
buffer_get_string_ret: cannot extract length
key_from_blob: can't read key type
key_read: key_from_blob
failed
buffer_get_ret: trying to get more bytes 4 than in buffer 0
buffer_get_string_ret: cannot extract length
key_from_blob: can't read key type
key_read: key_from_blob
failed
smurfy@192.168.0.10's password:
FreeBSD 9.1-STABLE (FREENAS.amd64) #0 r+7f710c8: Fri Jul 12 15:24:36 PDT 2013
 
FreeNAS (c) 2009-2013, The FreeNAS Development Team
All rights reserved.
FreeNAS is released under the modified BSD license.
 
For more information, documentation, help or support, go here:
http://freenas.org
FreeNAS
Could not chdir to home directory /mnt/stor/temp: No such file or directory
[smurfy@nas] /> su root
Password:
[smurfy@nas] /# mount -u -w /
[smurfy@nas] /# cd /boot
[smurfy@nas] /boot# mv kernel kernel.old
[smurfy@nas] /boot# fetch -o - http://people.freebsd.org/~delphij/misc/kernel.tar.xz | tar xf - -C /boot
-                                            100% of 8105 kB  120 kBps 00m00s
[smurfy@nas] /boot# mount -a
load: 0.00  cmd: mount 3956 [biowr] 280.73r 0.01u 0.19s 0% 1628k
mount: /dev/ufs/FreeNASs1a: Device busy
[smurfy@nas] /boot# mount -a
mount: /dev/ufs/FreeNASs1a: Device busy
[smurfy@nas] /boot#

should i reboot? i left the server running just in case.

 

[delphij]

Yes, just go ahead and reboot.

 

[papageorgi]

rebooted the server...........and hazah!!!! yes! thank you!

Code:

[smurfy@nas] /# zpool import -D -R /mnt stor
[smurfy@nas] /# zpool status
  pool: stor
state: ONLINE
  scan: scrub repaired 0 in 6h26m with 0 errors on Tue Jul 16 04:05:44 2013
config:
 
NAME                                            STATE    READ WRITE CKSUM
stor                                            ONLINE      0    0    0
raidz1-0                                      ONLINE      0    0    0
  gptid/8193e730-6aab-11e2-9f2f-00248c450018  ONLINE      0    0    0
  gptid/81f6b150-6aab-11e2-9f2f-00248c450018  ONLINE      0    0    0
  gptid/8255a13f-6aab-11e2-9f2f-00248c450018  ONLINE      0    0    0
  gptid/8402337d-6aab-11e2-9f2f-00248c450018  ONLINE      0    0    0
  gptid/8470dafe-6aab-11e2-9f2f-00248c450018  ONLINE      0    0    0
raidz1-1                                      ONLINE      0    0    0
  gptid/7ff753f5-edb7-11e2-b265-00248c450018  ONLINE      0    0    0
  gptid/805c1416-edb7-11e2-b265-00248c450018  ONLINE      0    0    0
  gptid/80c4b729-edb7-11e2-b265-00248c450018  ONLINE      0    0    0
  gptid/812e5515-edb7-11e2-b265-00248c450018  ONLINE      0    0    0
  gptid/8197afa9-edb7-11e2-b265-00248c450018  ONLINE      0    0    0
 
errors: No known data errors
[smurfy@nas] /#

the only thing left is to get it to auto import, right? or should/could i do a zfs send to a hand full of external drives?

 

[papageorgi]

hazah! i got it to work with so much of your help delphij! thanks so much!

i swapped one of the drives with a similar but it had a different sector setup. the pool showed up as degraded. i did try to have it resilver onto the other drive but i couldn't seem to do so....oh well, i'm backing up data and may be done by the time this is read. at that point i will have a full backup and will erase and recreate the pool with identical drives to re-upload the data from the full backup.

again, thank you so much for all your efforts.

 

[delphij]

the only thing left is to get it to auto import, right? or should/could i do a zfs send to a hand full of external drives?

Yes. You can do 'zpool export' than use automatic import.

It's recommended to backup and recreate your pool because performance reasons.

 

[cyberjock]

And switch to RAIDZ2.. :P

 

[Ricardo Cardoso]

Please do the following, from a shell to your FreeNAS, as 'root', do the following:

Code:

mount -u -w /
cd /boot
mv kernel kernel.old
 
fetch -o - http://people.freebsd.org/~delphij/misc/kernel.tar.xz | tar xf - -C /boot
 
mount -a

Suggestion: copy these commands one by one. The fetch | tar is one line and please make sure the command is typed right.

You should see something like this:

Code:

-            100% of 8105 kB  162 kBps 00m49s

The speed may vary, of course. If you see any error message during the course, do NOT proceed with the rest and let us know.

If you get no errors, you can reboot the system and then 'zpool import -D -R /mnt stor' should bring your pool back.

This image can help to solve my ZPOOL problem?
from: http://forums.freenas.org/threads/expert-help-required-to-rebuild-zfs-pool.13975/

Almost the same here.

• Freenas Server ZFS raid-1 "RAIDZ" online and Healthy.
• Using the GUI set one disk offline for upgrade disk size
• shutdown
• changed the physical disk
• boot
• unable to import pool
• zpool status: no pool available
• zpool import:

Code:

  pool: RAIDZ
 
    id: 3634811780714734649
  state: UNAVAIL
status: One or more devices are missing from the system.
action: The pool cannot be imported. Attach the missing
    devices and try again.
  see: http://www.sun.com/msg/ZFS-8000-3C
config:
 
    RAIDZ                                          UNAVAIL  insufficient replicas
      raidz1-0                                      UNAVAIL  insufficient replicas
        gptid/618319ef-915b-11e1-8fc4-386077d5d4c9  ONLINE
        13020385326369302278                        OFFLINE
        gptid/6287ea8f-915b-11e1-8fc4-386077d5d4c9  ONLINE
        9895012226997409189                        UNAVAIL  cannot open

• shutdown
• put back the off lined disk
• still unable to import, same error, same replies to zpool status and zpool import
• zpool online RAIDZ ada0: cannot open 'RAIDZ': no such pool

So, put a disk off line, replaced, other disk get UNAVAIL, put the offlined disk back but how to get it online if the pool cannot be imported?


Thanks for you all for any help!

Some extra info and commands in attached file.
Thanks in advance!

 

[cyberjock]

Sigh.... I can only /facepalm...

 

[Ricardo Cardoso]

I doubt it will help... :)

 

[cyberjock]

No, it won't. Your issue isn't caused by the same problem. Honestly, I'm not sure how to help you. It could be a coincidence that one disk failed at the same time as you offlined another. I'm not really sure. Start your own thread and provide all info you currently have and I'll see if I can help...

 

[Ricardo Cardoso]

New thread started as suggested: http://forums.freenas.org/threads/cannot-import-a-zpool-one-disk-offline-cannot-be-put-online.14104/

 

[Leandro Soares]

Please do the following, from a shell to your FreeNAS, as 'root', do the following:

Code:

mount -u -w /
cd /boot
mv kernel kernel.old

fetch -o - http://people.freebsd.org/~delphij/misc/kernel.tar.xz | tar xf - -C /boot

mount -a

Suggestion: copy these commands one by one. The fetch | tar is one line and please make sure the command is typed right.

You should see something like this:

Code:

-			100% of 8105 kB  162 kBps 00m49s

The speed may vary, of course. If you see any error message during the course, do NOT proceed with the rest and let us know.

If you get no errors, you can reboot the system and then 'zpool import -D -R /mnt stor' should bring your pool back.

Please do the following, from a shell to your FreeNAS, as 'root', do the following:

Code:

mount -u -w /
cd /boot
mv kernel kernel.old

fetch -o - http://people.freebsd.org/~delphij/misc/kernel.tar.xz | tar xf - -C /boot

mount -a

Suggestion: copy these commands one by one. The fetch | tar is one line and please make sure the command is typed right.

You should see something like this:

Code:

-			100% of 8105 kB  162 kBps 00m49s

The speed may vary, of course. If you see any error message during the course, do NOT proceed with the rest and let us know.

If you get no errors, you can reboot the system and then 'zpool import -D -R /mnt stor' should bring your pool back.

Hello, these commands and kernel is for freenas 9.10?

 

[Stux]

Hello, these commands and kernel is for freenas 9.10?

No. they're for a specific bug someone had with 9.1 (9.ONE not 9.TEN) and the bug fix was probably rolled into 9.x years ago.