zpool import "UNAVAIL cannot open"

Status
Not open for further replies.

FreeNAS Noob

Cadet
Joined
Mar 9, 2015
Messages
1
Hi. I am by no means an expert on FreeNAS or FreeBSD at all as the name suggests.

The long and short of it is, all was working fine for a long time until today where the share was no longer accessible. Logging in to the shell and issuing some commands I could see the pool when doing a zpool import, but weren't able to import it with the above error message (see logs below). All hardware seems to be in working order and hard drives seem to be picked up (as can be seen in the logs below) and in the BIOS.

In the past couple of hours I've been reading through some threads and it seems there might be some hope of fixing this. In particular I found a thread where one of the iXsystems developers was able to help the person in need to resolve his issue: https://forums.freenas.org/index.php?threads/lost-zpool-please-help.13878/

Hopefully with your help, cyberjock, and if we can get delpij onboard. :)

FreeNAS setup:
  • FreeNAS-9.1.1-RELEASE-x64
  • 4x3TB in RAIDZ1 pool
The hardware: (not proper server hardware, I know, but it's for home use and built with what I had lying around and some new parts)
  • Intel Xeon E3-1230 V2 CPU
  • Intel DZ77BH-55K motherboard
  • 16GB Corsair Dominator DDR3 RAM
  • 4x3TB ST3000DM001-1C HDDs (using onboard SATA controller, not ideal, I know)
Hardware tested:
  • RAM passed numerous tests with Memtest
  • All hard drives passed tests wit SeaTools
Some commonly request logs:
Code:
[root@freenas] ~# zpool import
  pool: pool
  id: 2283072769369744819
  state: UNAVAIL
 status: One or more devices are missing from the system.
 action: The pool cannot be imported. Attach the missing
  devices and try again.
  see: http://illumos.org/msg/ZFS-8000-3C
 config:
  pool  UNAVAIL  insufficient replicas
  raidz1-0  UNAVAIL  insufficient replicas
  gptid/2b942649-4ba4-11e2-8e13-00224d866b19  ONLINE
  11161017239308404396  UNAVAIL  cannot open
  1683046126281320563  UNAVAIL  cannot open
  gptid/2d1b08ce-4ba4-11e2-8e13-00224d866b19  ONLINE

Code:
[root@freenas] ~# gpart status
  Name  Status  Components
ada1p1  OK  ada1
ada1p2  OK  ada1
ada2p1  OK  ada2
ada2p2  OK  ada2
 da0s1  OK  da0
 da0s2  OK  da0
 da0s3  OK  da0
 da0s4  OK  da0
da0s1a  OK  da0s1

Code:
[root@freenas] ~# gpart list
Geom name: ada1
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada1p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: 2d001185-4ba4-11e2-8e13-00224d866b19
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada1p2
  Mediasize: 2998445412352 (2.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 2d1b08ce-4ba4-11e2-8e13-00224d866b19
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2998445412352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 5860533127
  start: 4194432
Consumers:
1. Name: ada1
  Mediasize: 3000592982016 (2.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
Geom name: ada2
modified: false
state: OK
fwheads: 16
fwsectors: 63
last: 5860533134
first: 34
entries: 128
scheme: GPT
Providers:
1. Name: ada2p1
  Mediasize: 2147483648 (2.0G)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e1
  rawuuid: 2b78ea59-4ba4-11e2-8e13-00224d866b19
  rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2147483648
  offset: 65536
  type: freebsd-swap
  index: 1
  end: 4194431
  start: 128
2. Name: ada2p2
  Mediasize: 2998445412352 (2.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r0w0e0
  rawuuid: 2b942649-4ba4-11e2-8e13-00224d866b19
  rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
  label: (null)
  length: 2998445412352
  offset: 2147549184
  type: freebsd-zfs
  index: 2
  end: 5860533127
  start: 4194432
Consumers:
1. Name: ada2
  Mediasize: 3000592982016 (2.7T)
  Sectorsize: 512
  Stripesize: 4096
  Stripeoffset: 0
  Mode: r1w1e2
Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 15814655
first: 63
entries: 4
scheme: MBR
Providers:
1. Name: da0s1
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 32256
  Mode: r1w0e1
  attrib: active
  rawtype: 165
  length: 988291584
  offset: 32256
  type: freebsd
  index: 1
  end: 1930319
  start: 63
2. Name: da0s2
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 988356096
  Mode: r0w0e0
  rawtype: 165
  length: 988291584
  offset: 988356096
  type: freebsd
  index: 2
  end: 3860639
  start: 1930383
3. Name: da0s3
  Mediasize: 1548288 (1.5M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 1976647680
  Mode: r0w0e0
  rawtype: 165
  length: 1548288
  offset: 1976647680
  type: freebsd
  index: 3
  end: 3863663
  start: 3860640
4. Name: da0s4
  Mediasize: 21159936 (20M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 1978195968
  Mode: r1w1e2
  rawtype: 165
  length: 21159936
  offset: 1978195968
  type: freebsd
  index: 4
  end: 3904991
  start: 3863664
Consumers:
1. Name: da0
  Mediasize: 8097103872 (7.6G)
  Sectorsize: 512
  Mode: r2w1e4
Geom name: da0s1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 1930256
first: 0
entries: 8
scheme: BSD
Providers:
1. Name: da0s1a
  Mediasize: 988283392 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 40448
  Mode: r1w0e1
  rawtype: 0
  length: 988283392
  offset: 8192
  type: !0
  index: 1
  end: 1930256
  start: 16
Consumers:
1. Name: da0s1
  Mediasize: 988291584 (942M)
  Sectorsize: 512
  Stripesize: 0
  Stripeoffset: 32256
  Mode: r1w0e1

Code:
[root@freenas] ~# gpart show
=>  34  5860533101  ada1  GPT  (2.7T)
  34  94  - free -  (47k)
  128  4194304  1  freebsd-swap  (2.0G)
  4194432  5856338696  2  freebsd-zfs  (2.7T)
  5860533128  7  - free -  (3.5k)
=>  34  5860533101  ada2  GPT  (2.7T)
  34  94  - free -  (47k)
  128  4194304  1  freebsd-swap  (2.0G)
  4194432  5856338696  2  freebsd-zfs  (2.7T)
  5860533128  7  - free -  (3.5k)
=>  63  15814593  da0  MBR  (7.6G)
  63  1930257  1  freebsd  [active]  (942M)
  1930320  63  - free -  (31k)
  1930383  1930257  2  freebsd  (942M)
  3860640  3024  3  freebsd  (1.5M)
  3863664  41328  4  freebsd  (20M)
  3904992  11909664  - free -  (5.7G)
=>  0  1930257  da0s1  BSD  (942M)
  0  16  - free -  (8.0k)
  16  1930241  1  !0  (942M)

Code:
[root@freenas] ~# camcontrol devlist
<ATAPI iHAS324  Y BL1W>  at scbus0 target 0 lun 0 (pass0,cd0)
<ST3000DM001-1CH166 CC43>  at scbus2 target 0 lun 0 (ada0,pass1)
<ST3000DM001-1CH166 CC43>  at scbus2 target 1 lun 0 (ada1,pass2)
<ST3000DM001-1CH166 CC43>  at scbus3 target 0 lun 0 (ada2,pass3)
<ST3000DM001-1CH166 CC43>  at scbus3 target 1 lun 0 (ada3,pass4)
<JetFlash Transcend 8GB 1100>  at scbus6 target 0 lun 0 (pass5,da0)

Code:
[root@freenas] ~# dmesg
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
  The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.1-STABLE #0 r+16f6355: Tue Aug 27 00:38:40 PDT 2013
  root@build.ixsystems.com:/tank/home/jkh/src/freenas/os-base/amd64/tank/home/jkh/src/freenas/FreeBSD/src/sys/FREENAS.amd64 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz (3292.59-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x306a9  Family = 0x6  Model = 0x3a  Stepping = 9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Standard Extended Features=0x281<GSFSBASE,SMEP,ENHMOVSB>
  TSC: P-state invariant, performance statistics
real memory  = 17179869184 (16384 MB)
avail memory = 16497790976 (15733 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <INTEL DZ77BH>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
 cpu4 (AP): APIC ID:  4
 cpu5 (AP): APIC ID:  5
 cpu6 (AP): APIC ID:  6
 cpu7 (AP): APIC ID:  7
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ACPI Warning: FADT (revision 5) is longer than ACPI 2.0 version, truncating length 268 to 244 (20110527/tbfadt-320)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
aesni0: <AES-CBC,AES-XTS> on motherboard
cryptosoft0: <software crypto> on motherboard
acpi0: <INTEL> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 67, 1 (4) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xe000-0xe07f mem 0xf6000000-0xf6ffffff,0xe0000000-0xefffffff,0xf4000000-0xf5ffffff irq 16 at device 0.0 on pci1
xhci0: <Intel Panther Point USB 3.0 controller> mem 0xf7320000-0xf732ffff irq 16 at device 20.0 on pci0
xhci0: 32 byte context size.
usbus0 on xhci0
pci0: <simple comms> at device 22.0 (no driver attached)
em0: <Intel(R) PRO/1000 Network Connection 7.3.7> port 0xf020-0xf03f mem 0xf7300000-0xf731ffff,0xf7338000-0xf7338fff irq 20 at device 25.0 on pci0
em0: Using an MSI interrupt
em0: Ethernet address: 00:22:4d:86:6b:19
ehci0: <Intel Panther Point USB 2.0 controller> mem 0xf7337000-0xf73373ff irq 16 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> irq 18 at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci5: <ACPI PCI bus> on pcib5
xhci1: <NEC uPD720200 USB 3.0 controller> mem 0xf7200000-0xf7201fff irq 16 at device 0.0 on pci5
xhci1: 32 byte context size.
usbus2 on xhci1
pcib6: <ACPI PCI-PCI bridge> irq 19 at device 28.7 on pci0
pci6: <ACPI PCI bus> on pcib6
ahci0: <Marvell 88SE9172 AHCI SATA controller> port 0xd040-0xd047,0xd030-0xd033,0xd020-0xd027,0xd010-0xd013,0xd000-0xd00f mem 0xf7120000-0xf71201ff irq 19 at device 0.0 on pci6
ahci0: AHCI v1.00 with 2 6Gbps ports, Port Multiplier supported with FBS
ahci0: quirks=0x100<NOBSYRES>
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ehci1: <Intel Panther Point USB 2.0 controller> mem 0xf7336000-0xf73363ff irq 23 at device 29.0 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci0: <Intel Panther Point SATA300 controller> port 0xf0f0-0xf0f7,0xf0e0-0xf0e3,0xf0d0-0xf0d7,0xf0c0-0xf0c3,0xf0b0-0xf0bf,0xf0a0-0xf0af irq 19 at device 31.2 on pci0
ata2: <ATA channel> at channel 0 on atapci0
ata3: <ATA channel> at channel 1 on atapci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atapci1: <Intel Panther Point SATA300 controller> port 0xf090-0xf097,0xf080-0xf083,0xf070-0xf077,0xf060-0xf063,0xf050-0xf05f,0xf040-0xf04f irq 19 at device 31.5 on pci0
ata4: <ATA channel> at channel 0 on atapci1
ata5: <ATA channel> at channel 1 on atapci1
acpi_button0: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xccfff,0xcd000-0xcffff,0xd0000-0xd0fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ppc0: cannot reserve I/O port range
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
DUMMYNET 0xfffffe0003f1b380 with IPv6 initialized (100409)
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched QFQ loaded
load_dn_sched dn_sched RR loaded
usbus0: 5.0Gbps Super Speed USB v3.0
usbus1: 480Mbps High Speed USB v2.0
usbus2: 5.0Gbps Super Speed USB v3.0
usbus3: 480Mbps High Speed USB v2.0
ugen0.1: <0x8086> at usbus0
uhub0: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen2.1: <0x1033> at usbus2
uhub2: <0x1033 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
uhub1: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
ada0 at ata2 bus 0 scbus2 target 0 lun 0
ada0: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada0: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada0: quirks=0x1<4K>
ada0: Previously was known as ad8
cd0 at ahcich0 bus 0 scbus0 target 0 lun 0
cd0: <ATAPI iHAS324  Y BL1W> Removable CD-ROM SCSI-0 device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
ada1 at ata2 bus 0 scbus2 target 1 lun 0
ada1: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada1: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada1: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad9
ada2 at ata3 bus 0 scbus3 target 0 lun 0
ada2: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada2: 600.000MB/s transfers (SATA 3.x, UDMA5, PIO 8192bytes)
ada2: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada2: quirks=0x1<4K>
ada2: Previously was known as ad10
ada3 at ata3 bus 0 scbus3 target 1 lun 0
ada3: <ST3000DM001-1CH166 CC43> ATA-8 SATA 3.x device
ada3: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada3: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada3: quirks=0x1<4K>
ada3: Previously was known as ad11
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #5 Launched!
Timecounter "TSC-low" frequency 1646293612 Hz quality 1000
uhub2: 4 ports with 4 removable, self powered
GEOM: ada0: the secondary GPT table is corrupt or invalid.
GEOM: ada0: using the primary only -- recovery suggested.
uhub0: 8 ports with 8 removable, self powered
GEOM: ada3: the secondary GPT table is corrupt or invalid.
GEOM: ada3: using the primary only -- recovery suggested.
Root mount waiting for: usbus3 usbus1 usbus0
ugen1.2: <vendor 0x8087> at usbus1
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen3.2: <vendor 0x8087> at usbus3
uhub5: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus3
Root mount waiting for: usbus3 usbus1 usbus0
uhub4: 6 ports with 6 removable, self powered
uhub5: 8 ports with 8 removable, self powered
ugen0.2: <JetFlash> at usbus0
umass0: <JetFlash Mass Storage Device, class 0/0, rev 2.00/11.00, addr 1> on usbus0
da0 at umass-sim0 bus 0 scbus6 target 0 lun 0
da0: <JetFlash Transcend 8GB 1100> Removable Direct Access SCSI-4 device
da0: 40.000MB/s transfers
da0: 7722MB (15814656 512 byte sectors: 255H 63S/T 984C)
da0: quirks=0x2<NO_6_BYTE>
ugen1.3: <Microsoft> at usbus1
ums0: <Microsoft Microsoft Basic Optical Mouse, class 0/0, rev 1.10/1.04, addr 3> on usbus1
ums0: 3 buttons and [XYZ] coordinates ID=0
Root mount waiting for: usbus1
ugen1.4: <LITEON Technology> at usbus1
ukbd0: <EP1 Interrupt> on usbus1
kbd2 at ukbd0
Trying to mount root from ufs:/dev/ufs/FreeNASs1a [ro]...
GEOM_RAID5: Module loaded, version 1.1.20110927.40 (rev 00ce00e5abb4)
GEOM_MULTIPATH: disk2 created
GEOM_MULTIPATH: ada3 added to disk2
GEOM_MULTIPATH: ada3 is now active path in disk2
GEOM_MULTIPATH: disk1 created
GEOM_MULTIPATH: ada0 added to disk1
GEOM_MULTIPATH: ada0 is now active path in disk1
GEOM: multipath/disk2: corrupt or invalid GPT detected.
GEOM: multipath/disk2: GPT rejected -- may not be recoverable.
GEOM: multipath/disk1: corrupt or invalid GPT detected.
GEOM: multipath/disk1: GPT rejected -- may not be recoverable.
GEOM_ELI: Device ada1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:  Crypto: hardware
GEOM_ELI: Device ada2p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:  Crypto: hardware
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)


Any help would be greatly appreciated. Thanks.
 

Bidule0hm

Server Electronics Sorcerer
Joined
Aug 5, 2013
Messages
3,710
"4x3TB in RAIDZ1 pool" this is a (very) bad idea. And non-ECC RAM is also a bad idea. Maybe your problem isn't related but you should think about solving these issue after having solved your pool problem (sorry, I can't help on that one because I'm not sure, I'll let a more knowledgeable member answer about that) ;)
 

cyberjock

Inactive Account
Joined
Mar 25, 2012
Messages
19,526
I just have to shake my head at this. You got a Xeon CPU, but then a desktop board, desktop RAM, and went with RAIDZ1. That other thread got a devs attention because there was an actual ZFS bug that was the problem and several people had similar problems recently at that time. Devs don't generally look at pools unless the issue seems particular suspicious of a software bug.

What do I see when I look at that thread:

1. Wrong type of motherboard (desktop board).
2. Wrong type of RAM (non-ECC).
3. The partition tables on some of the data disks are destroyed.
4. Even the disks that don't have partition tables that aren't destroyed are UNAVAIL (which means you've got major problems).
5. RAIDZ1 was used when we all know better and there's a crapload of "examples" of how simple it is to lose data with RAIDZ1.
6. That version of FreeNAS isn't supported anymore. 9.1.1 was released in August 2013.
7. Your bootup shows multipath is involved. That's just so many shades of "how the f*ck did you even get there?" that it's beyond scary to me.

I'm sorry, but I really don't think you have much of a chance. You've made quite a few mistakes and I doubt anyone is going to try to find a ZFS bug with hardware that we wouldn't have even recommended for a test platform.

The kind of recovery you are going to need is going to require many many hours. Much more than I'm willing to put into this, especially considering that this is very likely a self-inflicted wound that is the result of bad choice of hardware.

If you have backups, now is the time to use them.

I seriously doubt delphij is going to get involved in this either. Devs generally get involved in things that they feel has a chance of being an real software bug. Things like poor hardware choices immediately shun them away because they don't want to spend time trying to fix what can't be fixed because the hardware screwed up. This isn't a code problem. That much is blatantly obvious in about 10 different ways just based on the information you've posted thus far.

If you don't have backups, and you have $20k+ to spend on recovery, give Ontrack a call. Even when I did data recovery, my cost was not cheap. It wasn't like Ontrack's cost, but I definitely priced it so I wasn't losing my time for nothing. I can tell you that, based on the hardware you chose, you would likely be very unwilling to pay for recovery with me anyway because the proper hardware would have been cheaper. People even said that to me when I told them my price. My response was that "it's almost always cheaper to do it right than to do it wrong with FreeNAS". Some didn't like that answer, but that's the harsh truth no matter how you look at it.

If I can be so blunt, if you hadn't called me out by name, I wouldn't have even responded. I really have a hard time trying to devote what used to be an entire weekend of my own time just trying to do recovery for someone that couldn't pay for proper hardware to start with. I do like my time off of work. One could also argue that if your data wasn't worth your time to do proper research and buy proper hardware, why should it be my problem to solve?

Other than that, all I can say is "good luck". I wish you the best. You definitely have your work cut out for you.
 
Status
Not open for further replies.
Top