Update to 9.10-STABLE-201604018 failed and datasets are all empty

Status
Not open for further replies.

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
I've been using Freenas for over a year with no major issues. Slowly learning the ins and outs. I'm currently in a state of fear.
On Tuesday morning kicked off the update for the latest stable release. Upon my return in the evening the WebGui and SSH port weren't accessible. Jails were non-responsive as well. Connected a monitor to my server and saw that the new boot partition was failing to load. Reverted back to the previous 4.14 version and was able to get to a shell and the boot partition repaired an error that occured. At this point no jails were running. More distressingly all the datasets have 0 data in them as well. df reports the capacity at 0% as well.

Thanks in advance for any help or support.

Richard


Code:
 
df /mnt/main
Filesystem  1K-blocks Used      Avail Capacity  Mounted on
main       1882401316  112 1882401204     0%    /mnt/main


zpool status shows the pools are all online.

Code:
 ~# zpool status main
  pool: main
 state: ONLINE
  scan: scrub repaired 0 in 6h26m with 0 errors on Fri Apr 15 08:26:33 2016
config:

        NAME                                            STATE     READ WRITE CKSUM
        main                                            ONLINE       0     0     0
          mirror-0                                      ONLINE       0     0     0
            gptid/d78e99e1-80ce-11e4-86c0-bc5ff4653672  ONLINE       0     0     0
            gptid/d7e0fe28-80ce-11e4-86c0-bc5ff4653672  ONLINE       0     0     0

errors: No known data errors


Here are the boot messages:

Code:
 ~# dmesg
Copyright (c) 1992-2016 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 10.3-RELEASE #0 1b72f49(HEAD): Wed Apr 13 23:35:10 PDT 2016
    root@build.ixsystems.com:/tank/home/nightlies/CVE910/_BE/objs/tank/home/nightlies/CVE910/_BE/trueos/sys/FreeNAS.amd64 amd64
FreeBSD clang version 3.4.1 (tags/RELEASE_34/dot1-final 208032) 20140512
CPU: Intel(R) Core(TM) i3-3220 CPU @ 3.30GHz (3292.60-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x306a9  Family=0x6  Model=0x3a  Stepping=9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x3d9ae3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,TSCDLT,XSAVE,OSXSAVE,AVX,F16C>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
  XSAVE Features=0x1<XSAVEOPT>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
real memory  = 9384755200 (8950 MB)
avail memory = 8157331456 (7779 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <ALASKA A M I>
FreeBSD/SMP: Multiprocessor System Detected: 4 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s) x 2 SMT threads
 cpu0 (BSP): APIC ID:  0
 cpu1 (AP): APIC ID:  1
 cpu2 (AP): APIC ID:  2
 cpu3 (AP): APIC ID:  3
random: <Software, Yarrow> initialized
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
padlock0: No ACE support.
acpi0: <ALASKA A M I> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Event timer "HPET4" frequency 14318180 Hz quality 440
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
vgapci0: <VGA-compatible display> port 0xe000-0xe0ff mem 0xe0000000-0xefffffff,0xf7c00000-0xf7c3ffff irq 16 at device 0.0 on pci1
vgapci0: Boot video device
pci1: <multimedia, HDA> at device 0.1 (no driver attached)
vgapci1: <VGA-compatible display> port 0xf000-0xf03f mem 0xf7800000-0xf7bfffff,0xd0000000-0xdfffffff irq 16 at device 2.0 on pci0
agp0: <IvyBridge desktop GT1 IG> on vgapci1
agp0: aperture size is 256M, detected 65532k stolen memory
xhci0: <Intel Panther Point USB 3.0 controller> mem 0xf7d00000-0xf7d0ffff irq 16 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
pci0: <simple comms> at device 22.0 (no driver attached)
ehci0: <Intel Panther Point USB 2.0 controller> mem 0xf7d18000-0xf7d183ff irq 16 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
pci0: <multimedia, HDA> at device 27.0 (no driver attached)
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci2: <ACPI PCI bus> on pcib2
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci3: <ACPI PCI bus> on pcib3
re0: <RealTek 8168/8111 B/C/CP/D/DP/E/F/G PCIe Gigabit Ethernet> port 0xd000-0xd0ff mem 0xf0004000-0xf0004fff,0xf0000000-0xf0003fff irq 16 at device 0.0 on pci3
re0: Using 1 MSI-X message
re0: Chip rev. 0x2c800000
re0: MAC rev. 0x00100000
miibus0: <MII bus> on re0
rgephy0: <RTL8169S/8110S/8211 1000BASE-T media interface> PHY 1 on miibus0
rgephy0:  none, 10baseT, 10baseT-FDX, 10baseT-FDX-flow, 100baseTX, 100baseTX-FDX, 100baseTX-FDX-flow, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, 1000baseT-FDX-flow, 1000baseT-FDX-flow-master, auto, auto-flow
re0: Using defaults for TSO: 65518/35/2048
re0: Ethernet address: bc:5f:f4:65:36:72
pcib4: <ACPI PCI-PCI bridge> irq 17 at device 28.5 on pci0
pci4: <ACPI PCI bus> on pcib4
pcib5: <ACPI PCI-PCI bridge> irq 17 at device 0.0 on pci4
pci5: <ACPI PCI bus> on pcib5
ehci1: <Intel Panther Point USB 2.0 controller> mem 0xf7d17000-0xf7d173ff irq 23 at device 29.0 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci1
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Panther Point AHCI SATA controller> port 0xf0b0-0xf0b7,0xf0a0-0xf0a3,0xf090-0xf097,0xf080-0xf083,0xf060-0xf07f mem 0xf7d16000-0xf7d167ff irq 19 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
acpi_button0: <Power Button> on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
ichwd0: <Intel Panther Point watchdog timer> on isa0
wbwd0: <Nuvoton NCT6776 (0xc3/0x33) Watchdog Timer> at port 0x2e-0x2f on isa0
orm0: <ISA Option ROM> at iomem 0xc0000-0xcffff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
random: unblocking device.
usbus0: 5.0Gbps Super Speed USB v3.0
usbus1: 480Mbps High Speed USB v2.0
usbus2: 480Mbps High Speed USB v2.0
ugen2.1: <Intel> at usbus2
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
ugen0.1: <0x8086> at usbus0
uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
uhub2: 8 ports with 8 removable, self powered
uhub1: 2 ports with 2 removable, self powered
uhub0: 2 ports with 2 removable, self powered
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus1
ugen2.2: <vendor 0x8087> at usbus2
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus2
uhub3: 6 ports with 6 removable, self powered
uhub4: 8 ports with 8 removable, self powered
ugen2.3: <Lexar> at usbus2
umass0: <Lexar USB Flash Drive, class 0/0, rev 2.00/11.00, addr 3> on usbus2
umass0:  SCSI over Bulk-Only; quirks = 0x8100
umass0:7:0:-1: Attached to scbus7
ugen1.3: <Kingston> at usbus1
umass1: <Kingston DataTraveler 3.0, class 0/0, rev 2.10/1.00, addr 3> on usbus1
umass1:  SCSI over Bulk-Only; quirks = 0xc100
umass1:8:1:-1: Attached to scbus8
ugen2.4: <Lexar> at usbus2
umass2: <Lexar USB Flash Drive, class 0/0, rev 2.00/11.00, addr 4> on usbus2
umass2:  SCSI over Bulk-Only; quirks = 0x8100
umass2:9:2:-1: Attached to scbus9
ugen1.4: <StarTech.com> at usbus1
umass3: <StarTech.com S2510SM12U33, class 0/0, rev 2.10/1.00, addr 4> on usbus1
umass3:  SCSI over Bulk-Only; quirks = 0x0100
umass3:10:3:-1: Attached to scbus10
ugen1.5: <Lexar> at usbus1
umass4: <Lexar USB Flash Drive, class 0/0, rev 2.00/11.00, addr 5> on usbus1
umass4:  SCSI over Bulk-Only; quirks = 0x8100
umass4:11:4:-1: Attached to scbus11
ugen1.6: <Lexar> at usbus1
umass5: <Lexar USB Flash Drive, class 0/0, rev 2.00/11.00, addr 6> on usbus1
umass5:  SCSI over Bulk-Only; quirks = 0x8100
umass5:12:5:-1: Attached to scbus12
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <ST2000NM0011 SN03> ATA8-ACS SATA 3.x device
ada0: Serial Number Z1P68F9S
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 1907729MB (3907029168 512 byte sectors)
ada0: Previously was known as ad4
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD20EURS-73TLHY0 80.00A80> ACS-2 ATA SATA 2.x device
ada1: Serial Number WD-WCC4M2003580
ada1: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 1907729MB (3907029168 512 byte sectors)
ada1: quirks=0x1<4K>
ada1: Previously was known as ad6
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <WDC WD10EZEX-60ZF5A0 80.00A80> ACS-2 ATA SATA 3.x device
ada2: Serial Number WD-WCC1S8141130
ada2: 300.000MB/s transfers (SATA 2.x, UDMA5, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 953869MB (1953525168 512 byte sectors)
ada2: Previously was known as ad8
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <WDC WD10EZEX-22BN5A0 01.01A01> ACS-2 ATA SATA 3.x device
ada3: Serial Number WD-WCC3F7VNRNSK
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 953869MB (1953525168 512 byte sectors)
ada3: Previously was known as ad10
ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
ada4: <WDC WD40EZRX-00SPEB0 80.00A80> ACS-2 ATA SATA 3.x device
ada4: Serial Number WD-WCC4EPPLUDT9
ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 3815447MB (7814037168 512 byte sectors)
ada4: quirks=0x1<4K>
ada4: Previously was known as ad12
ada5 at ahcich5 bus 0 scbus5 target 0 lun 0
ada5: <WDC WD40EZRX-00SPEB0 80.00A80> ACS-2 ATA SATA 3.x device
ada5: Serial Number WD-WCC4E5ESC9P7
ada5: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada5: Command Queueing enabled
ada5: 3815447MB (7814037168 512 byte sectors)
ada5: quirks=0x1<4K>
ada5: Previously was known as ad14
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <Lexar USB Flash Drive 1100> Removable Direct Access SPC-2 SCSI device
da0: Serial Number AA042T3SUJM90N2V
da0: 40.000MB/s transfers
da0: 15276MB (31285248 512 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
da2 at umass-sim2 bus 2 scbus9 target 0 lun 0
da2: <Lexar USB Flash Drive 1100> Removable Direct Access SPC-2 SCSI device
da2: Serial Number AA0FBNHGRGW06A74
da2: 40.000MB/s transfers
da2: 15276MB (31285248 512 byte sectors)
da2: quirks=0x2<NO_6_BYTE>
da1 at umass-sim1 bus 1 scbus8 target 0 lun 0
da1: <Kingston DataTraveler 3.0 PMAP> Removable Direct Access SPC-4 SCSI device
da1: Serial Number 08606E6D4080BF11470D229A
da1: 40.000MB/s transfers
da1: 15004MB (30728832 512 byte sectors)
da1: quirks=0x2<NO_6_BYTE>
da3 at umass-sim3 bus 3 scbus10 target 0 lun 0
da3: <ASMT 2105 0> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number 1401146307F5
da3: 40.000MB/s transfers
da3: 152627MB (312581808 512 byte sectors)
da3: quirks=0x2<NO_6_BYTE>
da4 at umass-sim4 bus 4 scbus11 target 0 lun 0
da4: <Lexar USB Flash Drive 1100> Removable Direct Access SPC-2 SCSI device
da4: Serial Number AA48RE5REYZ60WXX
da4: 40.000MB/s transfers
da4: 15276MB (31285248 512 byte sectors)
da4: quirks=0x2<NO_6_BYTE>
da5 at umass-sim5 bus 5 scbus12 target 0 lun 0
da5: <Lexar USB Flash Drive 1100> Removable Direct Access SPC-2 SCSI device
da5: Serial Number AA04KYDUINF7VYRS
da5: 40.000MB/s transfers
da5: 15276MB (31285248 512 byte sectors)
da5: quirks=0x2<NO_6_BYTE>
SMP: AP CPU #1 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #3 Launched!
Timecounter "TSC-low" frequency 1646298336 Hz quality 1000
Trying to mount root from zfs:freenas-boot/ROOT/9.10-STABLE-201604140622 []...
GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
re0: link state changed to UP
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/4/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
re0: link state changed to DOWN
re0: link state changed to UP
vboxdrv: fAsync=0 offMin=0x244 offMax=0xe34
GEOM_ELI: Device ada0p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
GEOM_ELI: Device ada1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
GEOM_ELI: Device ada2p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
GEOM_ELI: Device ada3p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
GEOM_ELI: Device ada4p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
GEOM_ELI: Device da3p1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: software
 

jgreco

Resident Grinch
Joined
May 29, 2011
Messages
18,680
What happens if you just type "df"? If you have datasets, I would expect /mnt/main to show 0%.
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
I'll give that a go this evening and post the output. Under /mnt/main I have several datasets and a df/ls in those reports empty and lists no files.
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
Hi jgreco,

Here's the result of df. main (2TB), main01(1TB) and main2(4TB) are my zpools which have their data missing.

Thanks,
lomilomi

Code:
~# df
Filesystem                                                     1K-blocks    Used      Avail Capacity  Mounted on
freenas-boot/ROOT/9.10-STABLE-201604140622                      10578835 1022349    9556486    10%    /
devfs                                                                  1       1          0   100%    /dev
tmpfs                                                              32768    8280      24488    25%    /etc
tmpfs                                                               4096       8       4088     0%    /mnt
tmpfs                                                            2750824   12312    2738512     0%    /var
freenas-boot/grub                                                9567055   10569    9556486     0%    /boot/grub
fdescfs                                                                1       1          0   100%    /dev/fd
main                                                          1882401316     112 1882401204     0%    /mnt/main
main/Backups                                                  1882401300      96 1882401204     0%    /mnt/main/Backups
main/Backups/Time-Machine                                      268435456     260  268435196     0%    /mnt/main/Backups/Time-Machine
main/Backups/Win7                                             1882401404     200 1882401204     0%    /mnt/main/Backups/Win7
main/jails                                                    1882401324     120 1882401204     0%    /mnt/main/jails
main/jails/.warden-template-pluginjail--x64                   1882404224    3020 1882401204     0%    /mnt/main/jails/.warden-template-pluginjail--x64
main/jails/.warden-template-pluginjail-9.3-x64                1882404232    3028 1882401204     0%    /mnt/main/jails/.warden-template-pluginjail-9.3-x64
main/jails/.warden-template-standard--x64                     1882404664    3460 1882401204     0%    /mnt/main/jails/.warden-template-standard--x64
main/jails/bsd                                                1882405664    4460 1882401204     0%    /mnt/main/jails/bsd
main/jails/couchpotato_1                                      1882404368    3164 1882401204     0%    /mnt/main/jails/couchpotato_1
main/jails/plexmediaserver_1                                  1882405472    4268 1882401204     0%    /mnt/main/jails/plexmediaserver_1
main/jails/sabnzbd_1                                          1882404296    3092 1882401204     0%    /mnt/main/jails/sabnzbd_1
main/jails/sonarr_1                                           1882404384    3180 1882401204     0%    /mnt/main/jails/sonarr_1
main/jails/transmission_1                                     1882404280    3076 1882401204     0%    /mnt/main/jails/transmission_1
main/mainshare                                                1882401364     160 1882401204     0%    /mnt/main/mainshare
main01                                                         942659228     152  942659076     0%    /mnt/main01
main2                                                         3770671016     120 3770670896     0%    /mnt/main2
sys_logs_hdd                                                   149309512     108  149309404     0%    /mnt/sys_logs_hdd
sys_logs_hdd/.system                                           149309508     104  149309404     0%    /var/db/system
sys_logs_hdd/.system/cores                                     149311120    1716  149309404     0%    /var/db/system/cores
sys_logs_hdd/.system/samba4                                    149309780     376  149309404     0%    /var/db/system/samba4
sys_logs_hdd/.system/syslog-f36704f2fe794cb6a75657843255655d   149309940     536  149309404     0%    /var/db/system/syslog-f36704f2fe794cb6a75657843255655d
sys_logs_hdd/.system/rrd-f36704f2fe794cb6a75657843255655d      149319268    9864  149309404     0%    /var/db/system/rrd-f36704f2fe794cb6a75657843255655d
sys_logs_hdd/.system/configs-f36704f2fe794cb6a75657843255655d  149309500      96  149309404     0%    /var/db/system/configs-f36704f2fe794cb6a75657843255655d
linprocfs                                                              4       4          0   100%    /compat/linux/proc
 
Last edited:

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Hardware and a guess at previous freenas version?

Also output of zfs list
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
I was on 9.10-STABLE-201604140622 before the 20160418 release.

Hardware is:
Intel Core i3-3220
ASRock H77M
Corsair Vengeance LP 8GB (2x4GB)


Code:
 ~# zfs list
NAME                                                            USED  AVAIL  REFER  MOUNTPOINT
freenas-boot                                                   5.05G  9.11G    31K  none
freenas-boot/ROOT                                              4.67G  9.11G    31K  none
freenas-boot/ROOT/9.10-STABLE-201604111739                      544K  9.11G   999M  /
freenas-boot/ROOT/9.10-STABLE-201604140622                     4.67G  9.11G   998M  /
freenas-boot/ROOT/FreeNAS-8863f903d550e9d8a1e9f8c73ae9b4f0      430K  9.11G   996M  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201601181840               100K  9.11G  1.01G  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602020212                91K  9.11G  1.01G  /
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201602031011              1.12M  9.11G  1.01G  /
freenas-boot/grub                                               379M  9.11G  10.3M  legacy
main                                                           2.80G  1.75T   112K  /mnt/main
main/Backups                                                    556K  1.75T    96K  /mnt/main/Backups
main/Backups/Time-Machine                                       260K   256G   260K  /mnt/main/Backups/Time-Machine
main/Backups/Win7                                               200K  1.75T   200K  /mnt/main/Backups/Win7
main/jails                                                     2.72G  1.75T   120K  /mnt/main/jails
main/jails/.warden-template-pluginjail--x64                     719M  1.75T  2.95M  /mnt/main/jails/.warden-template-pluginjail--x64
main/jails/.warden-template-pluginjail-9.3-x64                  450M  1.75T  2.96M  /mnt/main/jails/.warden-template-pluginjail-9.3-x64
main/jails/.warden-template-standard--x64                      1.57G  1.75T  3.38M  /mnt/main/jails/.warden-template-standard--x64
main/jails/bsd                                                 1.68M  1.75T  4.36M  /mnt/main/jails/bsd
main/jails/couchpotato_1                                        424K  1.75T  3.09M  /mnt/main/jails/couchpotato_1
main/jails/plexmediaserver_1                                   1.51M  1.75T  4.17M  /mnt/main/jails/plexmediaserver_1
main/jails/sabnzbd_1                                            368K  1.75T  3.02M  /mnt/main/jails/sabnzbd_1
main/jails/sonarr_1                                             440K  1.75T  3.11M  /mnt/main/jails/sonarr_1
main/jails/transmission_1                                       336K  1.75T  3.00M  /mnt/main/jails/transmission_1
main/mainshare                                                  160K  1.75T   160K  /mnt/main/mainshare
main01                                                         10.5M   899G   152K  /mnt/main01
main2                                                          8.20M  3.51T   120K  /mnt/main2
sys_logs_hdd                                                   14.3M   142G   108K  /mnt/sys_logs_hdd
sys_logs_hdd/.system                                           12.6M   142G   104K  legacy
sys_logs_hdd/.system/configs-f36704f2fe794cb6a75657843255655d    96K   142G    96K  legacy
sys_logs_hdd/.system/cores                                     1.68M   142G  1.68M  legacy
sys_logs_hdd/.system/rrd-f36704f2fe794cb6a75657843255655d      9.88M   142G  9.88M  legacy
sys_logs_hdd/.system/samba4                                     376K   142G   376K  legacy
sys_logs_hdd/.system/syslog-f36704f2fe794cb6a75657843255655d    540K   142G   540K  legacy
 

jgreco

Resident Grinch
Joined
May 29, 2011
Messages
18,680
I have no ideas. @dlavigne ... this would seem to be an unusual development. Bug report suggested?
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
A related question. Is there a way to confirm if my data is still on the drives?

Thanks for taking a look.
 

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
If I was you I would get a new USB stick, install latest freenas, boot that and import your pool. See if everything looks good via CLI. If that works try importing your config file.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
A related question. Is there a way to confirm if my data is still on the drives?

Thanks for taking a look.
How much data did you have? All those datasets (minus some jails stuff and the boot pool) look awfully empty, according to zfs list.

If I was you I would get a new USB stick, install latest freenas, boot that and import your pool. See if everything looks good via CLI. If that works try importing your config file.
Yeah, I'd try this, but it's not looking good.
 

styno

Patron
Joined
Apr 11, 2016
Messages
466
Was the zpool/zfs version upgraded as well when going to 9.10?
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
If I was you I would get a new USB stick, install latest freenas, boot that and import your pool. See if everything looks good via CLI. If that works try importing your config file.
I'll get a start on that and report back.
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
How much data did you have? All those datasets (minus some jails stuff and the boot pool) look awfully empty, according to zfs list.


Yeah, I'd try this, but it's not looking good.
I had ~4tb across the 3 pools hence the surprise when non of the plugins started up and the reported sizes were near 0. I have the data splattered around to reconstruct but ideally I'd like to get it restored. :-/
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
If I was you I would get a new USB stick, install latest freenas, boot that and import your pool. See if everything looks good via CLI. If that works try importing your config file.

I downloaded the latest 9.10 stable release and booted to the CLI. When I try to import the main pool I get a warning that a previous system had accessed it. So then reran with -f. That says it cannot create the mount point. /mnt is empty. zpool status says the pool is online and ok.
 

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
Use the GUI to import the pool. only use the cli to check if your data is there.
 

SweetAndLow

Sweet'NASty
Joined
Nov 6, 2013
Messages
6,421
This is super strange, can you provide the debug file that you can download from the GUI?
 

lomilomi

Dabbler
Joined
Jan 30, 2016
Messages
22
I'll get that posted tomorrow. Running a memory test for the rest of the night.
 
Status
Not open for further replies.
Top