Hello, everyone. I've done a lot of searching of forums and other research, and I've found a lot of good information; but I just can't get to the bottom of this. Thanks in advance for any help you can provide!
Randomly, yesterday, my pool disappeared. I can't promise there wasn't a power blip, but I see no other signs of that with other appliances.
Disks are healthy: they show up in the system and show healthy smart status. Here is all the info I know to provide. Glad to provide more if needed:
System info:
Pool status. Boot pool shows up. Storage pool does not:
Import shows my storage pool, but…
Check DB for pool:
Disks are all there:
I don't know much about ZFS labels, but this certainly isn't right:
That being said, even my boot pool disk looks the same:
I'll spare you the smart info details, but all disks passed.
For what it's worth, in the web interface, ada1 is associated with "storage-pool" but ada2 says "unused".
Any ideas on how to recover the pool?
THANKS!
Randomly, yesterday, my pool disappeared. I can't promise there wasn't a power blip, but I see no other signs of that with other appliances.
Disks are healthy: they show up in the system and show healthy smart status. Here is all the info I know to provide. Glad to provide more if needed:
System info:
Code:
[root@freenas /]# uname -a FreeBSD freenas.local 11.2-STABLE FreeBSD 11.2-STABLE #0 r325575+95cc58ca2a0(HEAD): Fri May 10 15:57:35 EDT 2019 root@mp20.tn.ixsystems.com:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
Pool status. Boot pool shows up. Storage pool does not:
Code:
[root@freenas /]# zfs list NAME USED AVAIL REFER MOUNTPOINT freenas-boot 2.03G 897G 176K none freenas-boot/ROOT 2.02G 897G 136K none freenas-boot/ROOT/11.2-U4.1 2.02G 897G 1.01G / freenas-boot/ROOT/Initial-Install 8K 897G 1.01G legacy freenas-boot/ROOT/default 468K 897G 1.01G legacy
Code:
[root@freenas /]# zpool status pool: freenas-boot state: ONLINE scan: scrub repaired 0 in 0 days 00:00:12 with 0 errors on Fri Jul 19 03:45:32 2019 config: NAME STATE READ WRITE CKSUM freenas-boot ONLINE 0 0 0 ada0p2 ONLINE 0 0 0 errors: No known data errors
Import shows my storage pool, but…
Code:
[root@freenas /]# zpool import pool: storage-pool id: 17899316521172327458 state: UNAVAIL status: One or more devices are missing from the system. action: The pool cannot be imported. Attach the missing devices and try again. see: http://illumos.org/msg/ZFS-8000-3C config: storage-pool UNAVAIL insufficient replicas gptid/7851d72e-348e-11e9-9882-60a44ccd2fee.eli ONLINE 8531039083316170755 UNAVAIL cannot open
Check DB for pool:
Code:
[root@freenas /]# sqlite3 /data/freenas-v1.db "select * from storage_volume" 1|storage-pool|17899316521172327458|1|a46abcba-d24d-4bc6-9c81-b1537224770e
Disks are all there:
Code:
[root@freenas /]# gpart show => 40 1953525088 ada0 GPT (932G) 40 532480 1 efi (260M) 532520 1952972800 2 freebsd-zfs (931G) 1953505320 19808 - free - (9.7M) => 40 7814037088 ada1 GPT (3.6T) 40 88 - free - (44K) 128 4194304 1 freebsd-swap (2.0G) 4194432 7809842696 2 freebsd-zfs (3.6T) => 40 7814037088 ada2 GPT (3.6T) 40 88 - free - (44K) 128 4194304 1 freebsd-swap (2.0G) 4194432 7809842696 2 freebsd-zfs (3.6T)
Code:
[root@freenas /]# camcontrol devlist <ST1000DX001-1CM162 CC43> at scbus2 target 0 lun 0 (pass0,ada0) <ASUS DRW-24B3ST i 1.00> at scbus3 target 0 lun 0 (pass1,cd0) <ST4000DM004-2CV104 0001> at scbus4 target 0 lun 0 (pass2,ada1) <ST4000DM004-2CV104 0001> at scbus5 target 0 lun 0 (pass3,ada2)
I don't know much about ZFS labels, but this certainly isn't right:
Code:
[root@freenas /]# zdb -l /dev/ada1 ------------------------------------ LABEL 0 ------------------------------------ failed to unpack label 0 ------------------------------------ LABEL 1 ------------------------------------ failed to unpack label 1 ------------------------------------ LABEL 2 ------------------------------------ failed to unpack label 2 ------------------------------------ LABEL 3 ------------------------------------ failed to unpack label 3 [root@freenas /]# zdb -l /dev/ada2 ------------------------------------ LABEL 0 ------------------------------------ failed to unpack label 0 ------------------------------------ LABEL 1 ------------------------------------ failed to unpack label 1 ------------------------------------ LABEL 2 ------------------------------------ failed to unpack label 2 ------------------------------------ LABEL 3 ------------------------------------ failed to unpack label 3
That being said, even my boot pool disk looks the same:
Code:
[root@freenas /]# zdb -l /dev/ada0 ------------------------------------ LABEL 0 ------------------------------------ failed to unpack label 0 ------------------------------------ LABEL 1 ------------------------------------ failed to unpack label 1 ------------------------------------ LABEL 2 ------------------------------------ failed to unpack label 2 ------------------------------------ LABEL 3 ------------------------------------ failed to unpack label 3
I'll spare you the smart info details, but all disks passed.
For what it's worth, in the web interface, ada1 is associated with "storage-pool" but ada2 says "unused".
Any ideas on how to recover the pool?
THANKS!