3 pool on single drives, let me fall on my sword now....

[Allen Pedrolie]

I know that redundancy is the best plan for everything. When I built this file server it was just a storage medium for junk downloads and whatnot. FreeNAS 8.0.4 , The box had 3 drives total 1 x 1tb, 1 x2tb, and 1x 3tb. Here is where I fall on the sword... each drive was its own zpool, at least I think they were. It would seem that the 1tb drive is not operating normally. I cant seem to get any data from the 1tb when i run zpool status. the 2 and 3 tb ones are fine and work normally. I know this is a long shot but might there be a way to just pull the data off of the 1tb if the drive still spins?

dmesg code bleow:

Code:

Copyright (c) 1992-2011 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 8.2-RELEASE-p9 #0: Tue Jun 12 08:57:14 PDT 2012
    jpaetzel@commander.ixsystems.com:/home/jpaetzel/8.0.4/obj.amd64/usr/home/jpaetzel/8.0.4/FreeBSD/src/sys/FREENAS.amd64 amd64
Timecounter "i8254" frequency 1193182 Hz quality 0
CPU: Intel(R) Pentium(R) 4 CPU 3.00GHz (2992.52-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0xf43  Family = f  Model = 4  Stepping = 3
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x649d<SSE3,DTES64,MON,DS_CPL,EST,CNXT-ID,CX16,xTPR>
  AMD Features=0x20100800<SYSCALL,NX,LM>
  TSC: P-state invariant
real memory  = 1073741824 (1024 MB)
avail memory = 1016074240 (969 MB)
ACPI APIC Table: <DELL   DM051  >
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 1 core(s) x 2 HTT threads
cpu0 (BSP): APIC ID:  0
cpu1 (AP/HT): APIC ID:  1
ioapic0: Changing APIC ID to 8
ioapic0 <Version 2.0> irqs 0-23 on motherboard
lapic0: Forcing LINT1 to edge trigger
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
acpi0: <DELL DM051  > on motherboard
acpi0: [ITHREAD]
acpi0: Power Button (fixed)
acpi0: reservation of 0, a0000 (3) failed
acpi0: reservation of 100000, f00000 (3) failed
acpi0: reservation of 1000000, 3ee88c00 (3) failed
Timecounter "ACPI-fast" frequency 3579545 Hz quality 1000
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
acpi_hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 900
acpi_button0: <Power Button> on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xdc00-0xdcff mem 0xec000000-0xedffffff,0xefde0000-0xefdeffff irq 16 at device 0.0 on pci1
vgapci1: <VGA-compatible display> mem 0xefdf0000-0xefdfffff at device 0.1 on pci1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
uhci0: <Intel 82801G (ICH7) USB controller USB-A> port 0xff80-0xff9f irq 21 at device 29.0 on pci0
uhci0: [ITHREAD]
usbus0: <Intel 82801G (ICH7) USB controller USB-A> on uhci0
uhci1: <Intel 82801G (ICH7) USB controller USB-B> port 0xff60-0xff7f irq 22 at device 29.1 on pci0
uhci1: [ITHREAD]
usbus1: <Intel 82801G (ICH7) USB controller USB-B> on uhci1
uhci2: <Intel 82801G (ICH7) USB controller USB-C> port 0xff40-0xff5f irq 18 at device 29.2 on pci0
uhci2: [ITHREAD]
usbus2: <Intel 82801G (ICH7) USB controller USB-C> on uhci2
uhci3: <Intel 82801G (ICH7) USB controller USB-D> port 0xff20-0xff3f irq 23 at device 29.3 on pci0
uhci3: [ITHREAD]
usbus3: <Intel 82801G (ICH7) USB controller USB-D> on uhci3
ehci0: <Intel 82801GB/R (ICH7) USB 2.0 controller> mem 0xffa80800-0xffa80bff irq 21 at device 29.7 on pci0
ehci0: [ITHREAD]
usbus4: EHCI version 1.0
usbus4: <Intel 82801GB/R (ICH7) USB 2.0 controller> on ehci0
pcib3: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci3: <ACPI PCI bus> on pcib3
re0: <RealTek 8169/8169S/8169SB(L)/8110S/8110SB(L) Gigabit Ethernet> port 0xcc00-0xccff mem 0xefafed00-0xefafedff irq 18 at device 2.0 on pci3
re0: Chip rev. 0x04000000
re0: MAC rev. 0x00000000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211B media interface> PHY 1 on miibus0
rgephy0:  10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Ethernet address: 00:26:f2:ac:cb:33
re0: [FILTER]
atapci0: <SiI 3512 SATA150 controller> port 0xc8a0-0xc8a7,0xc898-0xc89b,0xc8a8-0xc8af,0xc89c-0xc89f,0xc8b0-0xc8bf mem 0xefafee00-0xefafefff irq 19 at device 3.0 on pci3
atapci0: [ITHREAD]
ata2: <ATA channel 0> on atapci0
ata2: [ITHREAD]
ata3: <ATA channel 1> on atapci0
ata3: [ITHREAD]
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
atapci1: <Intel ICH7 UDMA100 controller> port 0x1f0-0x1f7,0x3f6,0x170-0x177,0x376,0xffa0-0xffaf irq 16 at device 31.1 on pci0
ata0: <ATA channel 0> on atapci1
ata0: [ITHREAD]
atapci2: <Intel ICH7 SATA300 controller> port 0xfe00-0xfe07,0xfe10-0xfe13,0xfe20-0xfe27,0xfe30-0xfe33,0xfea0-0xfeaf irq 20 at device 31.2 on pci0
atapci2: [ITHREAD]
ata4: <ATA channel 0> on atapci2
ata4: [ITHREAD]
ata5: <ATA channel 1> on atapci2
ata5: [ITHREAD]
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
atrtc0: <AT realtime clock> port 0x70-0x7f irq 8 on acpi0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xccfff,0xcd000-0xd17ff,0xd1800-0xd37ff,0xd3800-0xd3fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
atkbd0: [ITHREAD]
ppc0: cannot reserve I/O port range
acpi_perf0: <ACPI CPU Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr f2d00000f2d
device_attach: est1 attach returned 6
p4tcc1: <CPU Frequency Thermal Control> on cpu1
fuse4bsd: version 0.3.9-pre1, FUSE ABI 7.8
Timecounters tick every 1.000 msec
usbus0: 12Mbps Full Speed USB v1.0
usbus1: 12Mbps Full Speed USB v1.0
usbus2: 12Mbps Full Speed USB v1.0
usbus3: 12Mbps Full Speed USB v1.0
usbus4: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus1
ugen2.1: <Intel> at usbus2
uhub2: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
ugen3.1: <Intel> at usbus3
uhub3: <Intel UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus3
ugen4.1: <Intel> at usbus4
uhub4: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus4
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub2: 2 ports with 2 removable, self powered
uhub3: 2 ports with 2 removable, self powered
(noperiph:ata3:0:-1:-1): rescan already queued
uhub4: 8 ports with 8 removable, self powered
ugen4.2: <USB 2.0> at usbus4
umass0: <USB 2.0 USB Flash Drive, class 0/0, rev 2.00/1.00, addr 2> on usbus4
ada0 at ata3 bus 0 scbus1 target 0 lun 0
ada0: <WDC WD30EZRX-00MMMB0 80.00A80> ATA-8 SATA 3.x device
ada0: 150.000MB/s transfers (SATA 1.x, UDMA5, PIO 8192bytes)
ada0: 2861588MB (5860533168 512 byte sectors: 16H 63S/T 16383C)
ada1 at ata4 bus 0 scbus3 target 0 lun 0
ada1: <ST32000542AS CC34> ATA-8 SATA 2.x deviceda0 at umass-sim0 bus 0 scbus5 target 0 lun 0
da0: <USB 2.0 USB Flash Drive 0.00> Removable Direct Access SCSI-2 device
da0: 40.000MB/s transfers
da0: 1927MB (3947079 512 byte sectors: 255H 63S/T 245C)

ada1: 150.000MB/s transfers (SATA, UDMA5, PIO 8192bytes)
ada1: 1907729MB (3907029168 512 byte sectors: 16H 63S/T 16383C)
ada2 at ata4 bus 0 scbus3 target 1 lun 0
ada2: <ST31000340AS SD15> ATA-8 SATA 2.x device
ada2: 150.000MB/s transfers (SATA, UDMA5, PIO 8192bytes)
ada2: 953869MB (1953525168 512 byte sectors: 16H 63S/T 16383C)
lapic1: Forcing LINT1 to edge trigger
SMP: AP CPU #1 Launched!
ugen3.2: <Lite-On Technology Corp.> at usbus3
ukbd0: <Lite-On Technology Corp. USB Multimedia Keyboard, class 0/0, rev 1.10/1.18, addr 2> on usbus3
kbd2 at ukbd0
uhid0: <Lite-On Technology Corp. USB Multimedia Keyboard, class 0/0, rev 1.10/1.18, addr 2> on usbus3
GEOM: da0s1: geometry does not match label (16h,63s != 255h,63s).
Trying to mount root from ufs:/dev/ufs/FreeNASs1a
ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
            to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
ZFS filesystem version 4
ZFS storage pool version 15
re0: link state changed to UP

I know that it is alot to ask and I am not the most talented linux user, but I would like to try to recover my data if possible...
Thanks for any help you all can provide.

 

[cyberjock]

Short answer: Not really. If the pool won't mount you're kind of f*cked. That's why I have a mention in my noobie guide that there are no recovery tools for ZFS. I'm not kidding when I make that claim.

Long answer: If you are willing to pay $10k+ you can call a company like Ontrack and they can write a software program to, hopefully, get your data back. I'm not exaggerating the $10k price tag either. The one time I saw someone do data recovery through a company like Ontrack it cost $17k to recover 450GB of data. :)

 

[mjws00]

You could try and clone the drive, and see if you have any luck. Might give you a stable platform to try and force a mount or recovery from. At least with a single disk pool you are in the simplest of configs. Frankly with low ram and old version... you are out of my realm. But I'd give it a shot. I'd also hit a livecd and attempt recovery from illumos, bsd, solaris.

Unfortunately cyber's short answer is reality. Not even decent odds as a long shot. Someone put it pretty well when they said "With zfs, if recovery is possible it is painless. If it is difficult you're already screwed." But if you can get the flaky hardware out of the way... you never know.

 

[Allen Pedrolie]

Cyberjock, Thanks for the reply. Kinda the response I was expecting but thought I would try anyway....

 

[rs225]

I wouldn't give up yet. You haven't shown the way in which it is failing.

FYI, that Seagate 1TB with firmware SD15? I think you've got a big problem there. SD15 was the version that just spontaneously stops working. You can contact Seagate about it or any data recovery company if that has happened. The data is fully recoverable, and it won't cost $17K if it is due to the SD15 firmware.

If the drive is still working, get the firmware update immediately!

 

[Allen Pedrolie]

rs225, I tried running the Firmware update but it would not complete successfully. It still shows the sd15 firmware. I am now trying to clone it to another 2tb drive to see if I will be able to import the pool and recover the data but I'm not totally hopeful... at this point it could be hit or miss. I am using a standalone cloner. I tried EASEUS drive copy and it ran for about 10-12 minutes before the drive could no longer be read.... Funny enough when I plug it into my windows box I can see it in the disk management... but that doesn't really help, other then to know that it can be detected. I will reply with the result of the clone so cross your fingers. Again thanks for the push in the right direction.

 

[mjws00]

10 minutes, and then puke... is not a terribly hopeful sign. :) I have seen them churn and churn and churn and make incremental progress and end up with reasonable results. The prayer in play is that the zfs metadata somehow survived and it was just a few files that got crushed. It would be interesting to see what a good forensics guy could do with the raw data. Transactional + Copy on Write on a single disk, you'd think it might be heaven for the right geek. Not to mention source code so we know exactly how things are written. Unfortunately those are very expensive folks doing a very time consuming task and writing tools from scratch.

Wish you the best.

 

[cyberjock]

You might have better lucking using ddrescue. But I can tell you from experience that if the pool won't mount on its own the crucial data that is necessary to mount the pool is almost certainly gone too. :(

 

[rs225]

Yep, ddrescue.

It is designed for barely working drives where multiple attempts have to be made over time. ZFS does store critical pool data multiple times, and ddrescue might recover enough to make it work. Make sure you set it up on a system that is ready to run for a week. When it gets down to the real hard stuff, it starts to take forever.

 

[rs225]

I am going to tip you ahead of time: If ZFS still can't seem to mount that 2TB drive, I would suggest it could be that it is supposed to be a 1TB drive. In other words, a functioning ZFS pool can handle a drive expansion. A dead ZFS pool that is being resurrected with missing sectors, that just might not work. Unless it was partitioned, and the partition table survives-- then you'll be OK.