FreeNAS 11.1-U7 Cannot import encrypted volume

T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Heracles said:
Hi again Topher,

I reviewed the results and unfortunately, I can not help you more... I never touched pool encryption because it is both way too dangerous and basically useless. Almost all of my data is encrypted in my NAS, but not at the pool level. I host my private Cloud based on Nextcloud and I use Nextcloud's server side encryption. I did a lot of tests, backup and restore and ensured myself I could recover my Dev server before deploying it to my prod server. I experimented with encryption in Dev for 1 year before putting it on the production side.

Is your pool recoverable from here ? personally, I do not know. It may be, because the boot mostly complains about ada3, so a single problematic drive should be Ok, but because of encryption, I am not sure. It is enough to screw a single crypto key to skrew up an entire cryptogram, no matter it is a file, a drive or a pool.

Let see if other people here have more experience with pool encryption, but as for me, I always knew enough about it for not touching it...

Good luck,
Click to expand...

At this point, I'm debating whether or not to click one of the buttons on the bottom. I've removed the ada3 that was giving the error(s) and booted it back up. It's still showing the same other results though... Plus the warning light still says "Critical" but now only lists "The volume NAS-Root state is UNKNOWN"
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Apollo said:
Here is a screenshot of my backup server.
Both pools are not currently connected to the server:
HGST-RAIDZ1-2 ( I think this one is not encrypted. I will have to check but I don't have access to my server at te moment.
HGST-RAID1 has encryption but no passphrase I think.

All encrypted but missing pools will only show the "Detach Volume" and "Unlock" icons.

In your case, the GUI shows the icons for a pool that is indeed encrypted and unlocked, however the Status shown as "Locked" is perplexing.
This is beyond my experience, but my gut's feeling suggest you may have an extra level of encryption within the pool itself.
Click to expand...
Any ideas what might happen if I tried clicking on "Encryption Re-Key" or "Remove Recovery Key"? & if I click "Download Key" will that give me the most up to date geli key?

Apollo said:
From your message output:

May 24 19:36:42 freenas GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
May 24 19:36:42 freenas GEOM_MIRROR: Device mirror/swap0 launched (2/2).
May 24 19:36:42 freenas GEOM_MIRROR: Device mirror/swap1 launched (2/2).
May 24 19:36:42 freenas GEOM_ELI: Device mirror/swap0.eli created.
May 24 19:36:42 freenas GEOM_ELI: Encryption: AES-XTS 128
May 24 19:36:42 freenas GEOM_ELI: Crypto: software
May 24 19:36:42 freenas GEOM_ELI: Device mirror/swap1.eli created.
May 24 19:36:42 freenas GEOM_ELI: Encryption: AES-XTS 128
May 24 19:36:42 freenas GEOM_ELI: Crypto: software
May 24 19:36:42 freenas GEOM_ELI: Device gptid/bda6d122-9131-11e8-991f-3860770e8bb4.eli created.
May 24 19:36:42 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 19:36:42 freenas GEOM_ELI: Crypto: software
May 24 19:36:42 freenas GEOM_ELI: Device gptid/bec972c2-9131-11e8-991f-3860770e8bb4.eli created.
May 24 19:36:42 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 19:36:42 freenas GEOM_ELI: Crypto: software
May 24 19:36:42 freenas GEOM_ELI: Device gptid/008eab85-d6e2-11e8-80d6-3860770e8bb4.eli created.
May 24 19:36:42 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 19:36:42 freenas GEOM_ELI: Crypto: software

This suggest that decryption of the pool is successful up to this point , but only 3 disks are used for the pool. Are you sure you have a 4 disk RAIDZ2? and not RAIDZ1? I don't know if the missing disk would trigger an error on the decryption. I think it would say it can't find one of the disk.
Click to expand...
I am 100% sure that I created a 4 disk RAIDZ2.

Apollo said:
Do you have more of that output messages showing information after what you have listed?
I don't know if errors have occurred after that.
Click to expand...
This is what I have from the console since then, after the reboot, etc:
Code:
May 24 22:26:59 freenas syslog-ng[1650]: syslog-ng starting up; version='3.7.3'
May 24 22:26:59 freenas Copyright (c) 1992-2017 The FreeBSD Project.
May 24 22:26:59 freenas Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
May 24 22:26:59 freenas     The Regents of the University of California. All rights reserved.
May 24 22:26:59 freenas FreeBSD is a registered trademark of The FreeBSD Foundation.
May 24 22:26:59 freenas FreeBSD 11.1-STABLE #0 r321665+9902d126c39(freenas/11.1-stable): Tue Aug 21 12:24:37 EDT 2018
May 24 22:26:59 freenas root@nemesis.tn.ixsystems.com:/freenas-11-releng/freenas/_BE/objs/freenas-11-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
May 24 22:26:59 freenas FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on LLVM 5.0.0svn)
May 24 22:26:59 freenas VT(efifb): resolution 800x600
May 24 22:26:59 freenas CPU: AMD E-450 APU with Radeon(tm) HD Graphics (1646.53-MHz K8-class CPU)
May 24 22:26:59 freenas Origin="AuthenticAMD"  Id=0x500f20  Family=0x14  Model=0x2  Stepping=0
May 24 22:26:59 freenas Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
May 24 22:26:59 freenas Features2=0x802209<SSE3,MON,SSSE3,CX16,POPCNT>
May 24 22:26:59 freenas AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
May 24 22:26:59 freenas AMD Features2=0x35ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,IBS,SKINIT,WDT>
May 24 22:26:59 freenas SVM: (disabled in BIOS) NP,NRIP,NAsids=8
May 24 22:26:59 freenas TSC: P-state invariant, performance statistics
May 24 22:26:59 freenas real memory  = 5351931904 (5104 MB)
May 24 22:26:59 freenas avail memory = 3658031104 (3488 MB)
May 24 22:26:59 freenas Event timer "LAPIC" quality 100
May 24 22:26:59 freenas ACPI APIC Table: <HPQOEM SLIC-CPC>
May 24 22:26:59 freenas FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
May 24 22:26:59 freenas FreeBSD/SMP: 1 package(s) x 2 core(s)
May 24 22:26:59 freenas WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
May 24 22:26:59 freenas ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20170728/tbfadt-796)
May 24 22:26:59 freenas ioapic0 <Version 2.1> irqs 0-23 on motherboard
May 24 22:26:59 freenas SMP: AP CPU #1 Launched!
May 24 22:26:59 freenas Timecounter "TSC" frequency 1646528796 Hz quality 800
May 24 22:26:59 freenas random: entropy device external interface
May 24 22:26:59 freenas kbd1 at kbdmux0
May 24 22:26:59 freenas module_register_init: MOD_LOAD (vesa, 0xffffffff80fc84c0, 0) error 19
May 24 22:26:59 freenas nexus0
May 24 22:26:59 freenas cryptosoft0: <software crypto> on motherboard
May 24 22:26:59 freenas aesni0: No AESNI support.
May 24 22:26:59 freenas padlock0: No ACE support.
May 24 22:26:59 freenas acpi0: <HPQOEM SLIC-CPC> on motherboard
May 24 22:26:59 freenas acpi0: Power Button (fixed)
May 24 22:26:59 freenas cpu0: <ACPI CPU> on acpi0
May 24 22:26:59 freenas cpu1: <ACPI CPU> on acpi0
May 24 22:26:59 freenas attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
May 24 22:26:59 freenas Timecounter "i8254" frequency 1193182 Hz quality 0
May 24 22:26:59 freenas Event timer "i8254" frequency 1193182 Hz quality 100
May 24 22:26:59 freenas atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
May 24 22:26:59 freenas atrtc0: registered as a time-of-day clock, resolution 1.000000s
May 24 22:26:59 freenas Event timer "RTC" frequency 32768 Hz quality 0
May 24 22:26:59 freenas hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
May 24 22:26:59 freenas Timecounter "HPET" frequency 14318180 Hz quality 950
May 24 22:26:59 freenas Event timer "HPET" frequency 14318180 Hz quality 550
May 24 22:26:59 freenas Event timer "HPET1" frequency 14318180 Hz quality 450
May 24 22:26:59 freenas Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
May 24 22:26:59 freenas acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
May 24 22:26:59 freenas pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
May 24 22:26:59 freenas pci0: <ACPI PCI bus> on pcib0
May 24 22:26:59 freenas vgapci0: <VGA-compatible display> port 0xf000-0xf0ff mem 0xc0000000-0xcfffffff,0xfeb00000-0xfeb3ffff irq 18 at device 1.0 on pci0
May 24 22:26:59 freenas vgapci0: Boot video device
May 24 22:26:59 freenas pcib1: <ACPI PCI-PCI bridge> irq 16 at device 4.0 on pci0
May 24 22:26:59 freenas pcib1: [GIANT-LOCKED]
May 24 22:26:59 freenas ahci0: <AMD SB7x0/SB8x0/SB9x0 AHCI SATA controller> port 0xf140-0xf147,0xf130-0xf133,0xf120-0xf127,0xf110-0xf113,0xf100-0xf10f mem 0xfeb4b000-0xfeb4b3ff irq 19 at device 17.0 on pci0
May 24 22:26:59 freenas ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported
May 24 22:26:59 freenas ahci0: quirks=0x22000<ATI_PMP_BUG,1MSI>
May 24 22:26:59 freenas ahcich0: <AHCI channel> at channel 0 on ahci0
May 24 22:26:59 freenas ahcich1: <AHCI channel> at channel 1 on ahci0
May 24 22:26:59 freenas ahcich2: <AHCI channel> at channel 2 on ahci0
May 24 22:26:59 freenas ahcich3: <AHCI channel> at channel 3 on ahci0
May 24 22:26:59 freenas ahcich4: <AHCI channel> at channel 4 on ahci0
May 24 22:26:59 freenas ahcich5: <AHCI channel> at channel 5 on ahci0
May 24 22:26:59 freenas ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb4a000-0xfeb4afff irq 18 at device 18.0 on pci0
May 24 22:26:59 freenas usbus0 on ohci0
May 24 22:26:59 freenas usbus0: 12Mbps Full Speed USB v1.0
May 24 22:26:59 freenas ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb49000-0xfeb490ff irq 17 at device 18.2 on pci0
May 24 22:26:59 freenas usbus1: EHCI version 1.0
May 24 22:26:59 freenas usbus1 on ehci0
May 24 22:26:59 freenas usbus1: 480Mbps High Speed USB v2.0
May 24 22:26:59 freenas ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb48000-0xfeb48fff irq 18 at device 19.0 on pci0
May 24 22:26:59 freenas usbus2 on ohci1
May 24 22:26:59 freenas usbus2: 12Mbps Full Speed USB v1.0
May 24 22:26:59 freenas ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb47000-0xfeb470ff irq 17 at device 19.2 on pci0
May 24 22:26:59 freenas usbus3: EHCI version 1.0
May 24 22:26:59 freenas usbus3 on ehci1
May 24 22:26:59 freenas usbus3: 480Mbps High Speed USB v2.0
May 24 22:26:59 freenas pci0: <multimedia, HDA> at device 20.2 (no driver attached)
May 24 22:26:59 freenas isab0: <PCI-ISA bridge> at device 20.3 on pci0
May 24 22:26:59 freenas isa0: <ISA bus> on isab0
May 24 22:26:59 freenas pcib2: <ACPI PCI-PCI bridge> at device 20.4 on pci0
May 24 22:26:59 freenas pci1: <ACPI PCI bus> on pcib2
May 24 22:26:59 freenas ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb46000-0xfeb46fff irq 18 at device 20.5 on pci0
May 24 22:26:59 freenas usbus4 on ohci2
May 24 22:26:59 freenas usbus4: 12Mbps Full Speed USB v1.0
May 24 22:26:59 freenas pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0
May 24 22:26:59 freenas pci2: <ACPI PCI bus> on pcib3
May 24 22:26:59 freenas pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0
May 24 22:26:59 freenas pci3: <ACPI PCI bus> on pcib4
May 24 22:26:59 freenas re0: <RealTek 810xE PCIe 10/100baseTX> port 0xe000-0xe0ff mem 0xd0004000-0xd0004fff,0xd0000000-0xd0003fff irq 17 at device 0.0 on pci3
May 24 22:26:59 freenas re0: Using 1 MSI-X message
May 24 22:26:59 freenas re0: turning off MSI enable bit.
May 24 22:26:59 freenas re0: Chip rev. 0x40800000
May 24 22:26:59 freenas re0: MAC rev. 0x00200000
May 24 22:26:59 freenas miibus0: <MII bus> on re0
May 24 22:26:59 freenas rlphy0: <RTL8201E 10/100 media interface> PHY 1 on miibus0
May 24 22:26:59 freenas rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto, auto-flow
May 24 22:26:59 freenas re0: Using defaults for TSO: 65518/35/2048
May 24 22:26:59 freenas re0: Ethernet address: 38:60:77:0e:8b:b4
May 24 22:26:59 freenas ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb45000-0xfeb45fff irq 18 at device 22.0 on pci0
May 24 22:26:59 freenas usbus5 on ohci3
May 24 22:26:59 freenas usbus5: 12Mbps Full Speed USB v1.0
May 24 22:26:59 freenas ehci2: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb44000-0xfeb440ff irq 17 at device 22.2 on pci0
May 24 22:26:59 freenas usbus6: EHCI version 1.0
May 24 22:26:59 freenas usbus6 on ehci2
May 24 22:26:59 freenas usbus6: 480Mbps High Speed USB v2.0
May 24 22:26:59 freenas amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb4
May 24 22:26:59 freenas acpi_button0: <Power Button> on acpi0
May 24 22:26:59 freenas orm0: <ISA Option ROM> at iomem 0xce800-0xcf7ff on isa0
May 24 22:26:59 freenas amdsbwd0: <AMD SB8xx/SB9xx/Axx Watchdog Timer> at iomem 0xfec000f0-0xfec000f3,0xfec000f4-0xfec000f7 on isa0
May 24 22:26:59 freenas atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
May 24 22:26:59 freenas atkbd0: <AT Keyboard> irq 1 on atkbdc0
May 24 22:26:59 freenas kbd0 at atkbd0
May 24 22:26:59 freenas atkbd0: [GIANT-LOCKED]
May 24 22:26:59 freenas hwpstate0: <Cool`n'Quiet 2.0> on cpu0
May 24 22:26:59 freenas ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
May 24 22:26:59 freenas to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
May 24 22:26:59 freenas ZFS filesystem version: 5
May 24 22:26:59 freenas ZFS storage pool version: features support (5000)
May 24 22:26:59 freenas Timecounters tick every 1.000 msec
May 24 22:26:59 freenas freenas_sysctl: adding account.
May 24 22:26:59 freenas freenas_sysctl: adding directoryservice.
May 24 22:26:59 freenas freenas_sysctl: adding middlewared.
May 24 22:26:59 freenas freenas_sysctl: adding network.
May 24 22:26:59 freenas freenas_sysctl: adding services.
May 24 22:26:59 freenas ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
May 24 22:26:59 freenas ugen0.1: <ATI OHCI root HUB> at usbus0
May 24 22:26:59 freenas ugen6.1: <ATI EHCI root HUB> at usbus6
May 24 22:26:59 freenas uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
May 24 22:26:59 freenas uhub1: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus6
May 24 22:26:59 freenas ugen4.1: <ATI OHCI root HUB> at usbus4
May 24 22:26:59 freenas ugen3.1: <ATI EHCI root HUB> at usbus3
May 24 22:26:59 freenas uhub2: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
May 24 22:26:59 freenas uhub3: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
May 24 22:26:59 freenas ugen1.1: <ATI EHCI root HUB> at usbus1
May 24 22:26:59 freenas ugen5.1: <ATI OHCI root HUB> at usbus5
May 24 22:26:59 freenas uhub4: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
May 24 22:26:59 freenas uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
May 24 22:26:59 freenas ugen2.1: <ATI OHCI root HUB> at usbus2
May 24 22:26:59 freenas uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
May 24 22:26:59 freenas uhub2: 2 ports with 2 removable, self powered
May 24 22:26:59 freenas uhub0: 5 ports with 5 removable, self powered
May 24 22:26:59 freenas uhub5: 4 ports with 4 removable, self powered
May 24 22:26:59 freenas uhub6: 5 ports with 5 removable, self powered
May 24 22:26:59 freenas uhub1: 4 ports with 4 removable, self powered
May 24 22:26:59 freenas uhub3: 5 ports with 5 removable, self powered
May 24 22:26:59 freenas uhub4: 5 ports with 5 removable, self powered
May 24 22:26:59 freenas ugen3.2: <vendor 0x1a40 USB 2.0 Hub> at usbus3
May 24 22:26:59 freenas uhub7 on uhub3
May 24 22:26:59 freenas uhub7: <vendor 0x1a40 USB 2.0 Hub, class 9/0, rev 2.00/1.11, addr 2> on usbus3
May 24 22:26:59 freenas ugen0.2: <Dell Dell USB Keyboard> at usbus0
May 24 22:26:59 freenas ukbd0 on uhub0
May 24 22:26:59 freenas ukbd0: <EP1 Interrupt> on usbus0
May 24 22:26:59 freenas kbd2 at ukbd0
May 24 22:26:59 freenas uhub7: 4 ports with 4 removable, self powered
May 24 22:26:59 freenas ugen3.3: <JMicron USB to ATAATAPI bridge> at usbus3
May 24 22:26:59 freenas umass0 on uhub7
May 24 22:26:59 freenas umass0: <MSC Bulk-Only Transfer> on usbus3
May 24 22:26:59 freenas umass0:  SCSI over Bulk-Only; quirks = 0x4000
May 24 22:26:59 freenas umass0:7:0: Attached to scbus7
May 24 22:26:59 freenas ugen1.2: <SanDisk Cruzer Fit> at usbus1
May 24 22:26:59 freenas (probe0:umass-sim0:0:0:0): REPORT LUNS. CDB: a0 00 00 00 00 00 00 00 00 10 00 00
May 24 22:26:59 freenas umass1(probe0:umass-sim0:0:0:0): CAM status: SCSI Status Error
May 24 22:26:59 freenas on uhub4
May 24 22:26:59 freenas (probe0:umass-sim0:0:0:0): SCSI status: Check Condition
May 24 22:26:59 freenas umass1: (probe0:umass-sim0:0:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
May 24 22:26:59 freenas syslog-ng[1650]: Error processing log message: <SanDisk Cruzer Fit, class 0/0, rev 2.10/1.00, addr 2> on usbus1
May 24 22:26:59 freenas (probe0:umass1: umass-sim0:0: SCSI over Bulk-Only; quirks = 0x8100
May 24 22:26:59 freenas 0:0): Error 22, Unretryable error
May 24 22:26:59 freenas umass1:8:1: Attached to scbus8
May 24 22:26:59 freenas ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
May 24 22:26:59 freenas da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
May 24 22:26:59 freenas ada0: da0: <ST33000651NS G009> ATA8-ACS SATA 3.x device
May 24 22:26:59 freenas syslog-ng[1650]: Error processing log message: <ST330006 51NS > Fixed Direct Access SPC-3 SCSI device
May 24 22:26:59 freenas ada0: Serial Number Z294CBSQ
May 24 22:26:59 freenas da0: Serial Number 000000000000
May 24 22:26:59 freenas ada0: 300.000MB/s transfersda0: 40.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes
May 24 22:26:59 freenas da0: 2861588MB (5860533168 512 byte sectors)
May 24 22:26:59 freenas )
May 24 22:26:59 freenas ada0: Command Queueing enabled
May 24 22:26:59 freenas da0: quirks=0x2<NO_6_BYTE>
May 24 22:26:59 freenas ada0: 2861588MB (5860533168 512 byte sectors)
May 24 22:26:59 freenas da1 at umass-sim1 bus 1 scbus8 target 0 lun 0
May 24 22:26:59 freenas ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
May 24 22:26:59 freenas da1: <SanDisk Cruzer Fit 1.00> Removable Direct Access SPC-4 SCSI device
May 24 22:26:59 freenas ada1: <ST33000651NS G008> ATA8-ACS SATA 3.x device
May 24 22:26:59 freenas da1: Serial Number 4C530001100526102492
May 24 22:26:59 freenas ada1: Serial Number Z293BX3V
May 24 22:26:59 freenas da1: 40.000MB/s transfersada1: 300.000MB/s transfers
May 24 22:26:59 freenas (SATA 2.x, UDMA6, PIO 8192bytes)
May 24 22:26:59 freenas ada1: Command Queueing enabled
May 24 22:26:59 freenas da1: 7632MB (15630336 512 byte sectors)
May 24 22:26:59 freenas ada1: 2861588MB (5860533168 512 byte sectors)
May 24 22:26:59 freenas da1: quirks=0x2<NO_6_BYTE>
May 24 22:26:59 freenas ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
May 24 22:26:59 freenas ada2: <ST33000651NS G008> ATA8-ACS SATA 3.x device
May 24 22:26:59 freenas ada2: Serial Number Z293BQB2
May 24 22:26:59 freenas ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
May 24 22:26:59 freenas ada2: Command Queueing enabled
May 24 22:26:59 freenas ada2: 2861588MB (5860533168 512 byte sectors)
May 24 22:26:59 freenas random: unblocking device.
May 24 22:26:59 freenas Trying to mount root from zfs:freenas-boot/ROOT/default []...
May 24 22:26:59 freenas kernel: re0: link state changed to UP
May 24 22:26:59 freenas kernel: re0: link state changed to UP
May 24 22:26:59 freenas SVM: disabled by BIOS.
May 24 22:26:59 freenas module_register_init: MOD_LOAD (vmm, 0xffffffff829f3400, 0) error 6
May 24 22:26:59 freenas GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
May 24 22:26:59 freenas GEOM_MIRROR: Device mirror/swap0 launched (2/2).
May 24 22:26:59 freenas GEOM_MIRROR: Cancelling unmapped because of da0p1.
May 24 22:26:59 freenas GEOM_MIRROR: Device mirror/swap1 launched (2/2).
May 24 22:26:59 freenas GEOM_ELI: Device mirror/swap0.eli created.
May 24 22:26:59 freenas GEOM_ELI: Encryption: AES-XTS 128
May 24 22:26:59 freenas GEOM_ELI:     Crypto: software
May 24 22:26:59 freenas GEOM_ELI: Device mirror/swap1.eli created.
May 24 22:26:59 freenas GEOM_ELI: Encryption: AES-XTS 128
May 24 22:26:59 freenas GEOM_ELI:     Crypto: software
May 24 22:26:59 freenas GEOM_ELI: Device gptid/bda6d122-9131-11e8-991f-3860770e8bb4.eli created.
May 24 22:26:59 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 22:26:59 freenas GEOM_ELI:     Crypto: software
May 24 22:26:59 freenas GEOM_ELI: Device gptid/bec972c2-9131-11e8-991f-3860770e8bb4.eli created.
May 24 22:26:59 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 22:26:59 freenas GEOM_ELI:     Crypto: software
May 24 22:26:59 freenas GEOM_ELI: Device gptid/008eab85-d6e2-11e8-80d6-3860770e8bb4.eli created.
May 24 22:26:59 freenas GEOM_ELI: Encryption: AES-XTS 256
May 24 22:26:59 freenas GEOM_ELI:     Crypto: software
May 24 22:26:59 freenas hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> K8/4/48/0x1ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA>
May 24 22:26:59 freenas kernel: re0: link state changed to DOWN
May 24 22:26:59 freenas kernel: re0: link state changed to DOWN
May 24 22:26:59 freenas kernel: re0: link state changed to UP
May 24 22:26:59 freenas kernel: re0: link state changed to UP
May 24 22:27:04 freenas nfsd: can't register svc name
May 24 22:27:05 freenas ntpd[2076]: ntpd 4.2.8p10-a (1): Starting
May 24 22:27:08 freenas proftpd[2225]: 127.0.0.1 - ProFTPD 1.3.6 (stable) (built Tue Aug 21 2018 16:56:03 UTC) standalone mode STARTUP
May 24 22:27:31 freenas root: /etc/rc: WARNING: failed precmd routine for minio
May 24 22:36:50 freenas proftpd[5359]: 127.0.0.1 (192.168.1.20[192.168.1.20]) - NASPlex chdir("/mnt/NAS-Root/NASPlex") failed: No such file or director

...although, just now when I clicked on it, it won't load any console messages. I have no idea why.
Screen Shot 2019-05-24 at 23.40.49.png

Thanks for your continuing help with this!!
 
A

Apollo

Wizard
Joined
Jun 13, 2013
Messages
1,458
The last of your log ends at plex message.
I think you loaded your original messages using dmesg.
Can you see if you have more of that message?
You could try downloading the key again, and make sure you keep in the separate location than your current one.
The part I can't figure out is why there is no errors in the message history.

I would start fresh with a new install on Freenas on a new boot disk and try importing the pool again with the various keys.
Try to recall the steps you took from the time you had a working system to the time you started having problems.
Try to put in on paper for yourself to go through. Maybe you changed the keys at some point. Maybe you removed a disk, or added a disk.
Think of everything.
It might help shade some light.
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Apollo said:
The last of your log ends at plex message.
I think you loaded your original messages using dmesg.
Can you see if you have more of that message?
You could try downloading the key again, and make sure you keep in the separate location than your current one.
The part I can't figure out is why there is no errors in the message history.

I would start fresh with a new install on Freenas on a new boot disk and try importing the pool again with the various keys.
Try to recall the steps you took from the time you had a working system to the time you started having problems.
Try to put in on paper for yourself to go through. Maybe you changed the keys at some point. Maybe you removed a disk, or added a disk.
Think of everything.
It might help shade some light.
Click to expand...
This:
Code:
May 25 14:24:05 freenas syslog-ng[1648]: syslog-ng starting up; version='3.7.3'
May 25 14:24:05 freenas Copyright (c) 1992-2017 The FreeBSD Project.
May 25 14:24:05 freenas Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
May 25 14:24:05 freenas     The Regents of the University of California. All rights reserved.
May 25 14:24:05 freenas FreeBSD is a registered trademark of The FreeBSD Foundation.
May 25 14:24:05 freenas FreeBSD 11.1-STABLE #0 r321665+9902d126c39(freenas/11.1-stable): Tue Aug 21 12:24:37 EDT 2018
May 25 14:24:05 freenas root@nemesis.tn.ixsystems.com:/freenas-11-releng/freenas/_BE/objs/freenas-11-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
May 25 14:24:05 freenas FreeBSD clang version 5.0.0 (tags/RELEASE_500/final 312559) (based on LLVM 5.0.0svn)
May 25 14:24:05 freenas VT(efifb): resolution 800x600
May 25 14:24:05 freenas CPU: AMD E-450 APU with Radeon(tm) HD Graphics (1646.53-MHz K8-class CPU)
May 25 14:24:05 freenas Origin="AuthenticAMD"  Id=0x500f20  Family=0x14  Model=0x2  Stepping=0
May 25 14:24:05 freenas Features=0x178bfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,MMX,FXSR,SSE,SSE2,HTT>
May 25 14:24:05 freenas Features2=0x802209<SSE3,MON,SSSE3,CX16,POPCNT>
May 25 14:24:05 freenas AMD Features=0x2e500800<SYSCALL,NX,MMX+,FFXSR,Page1GB,RDTSCP,LM>
May 25 14:24:05 freenas AMD Features2=0x35ff<LAHF,CMP,SVM,ExtAPIC,CR8,ABM,SSE4A,MAS,Prefetch,IBS,SKINIT,WDT>
May 25 14:24:05 freenas SVM: (disabled in BIOS) NP,NRIP,NAsids=8
May 25 14:24:05 freenas TSC: P-state invariant, performance statistics
May 25 14:24:05 freenas real memory  = 5351931904 (5104 MB)
May 25 14:24:05 freenas avail memory = 3658031104 (3488 MB)
May 25 14:24:05 freenas Event timer "LAPIC" quality 100
May 25 14:24:05 freenas ACPI APIC Table: <HPQOEM SLIC-CPC>
May 25 14:24:05 freenas FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
May 25 14:24:05 freenas FreeBSD/SMP: 1 package(s) x 2 core(s)
May 25 14:24:05 freenas WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
May 25 14:24:05 freenas ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20170728/tbfadt-796)
May 25 14:24:05 freenas ioapic0 <Version 2.1> irqs 0-23 on motherboard
May 25 14:24:05 freenas SMP: AP CPU #1 Launched!
May 25 14:24:05 freenas Timecounter "TSC" frequency 1646528904 Hz quality 800
May 25 14:24:05 freenas random: entropy device external interface
May 25 14:24:05 freenas kbd1 at kbdmux0
May 25 14:24:05 freenas module_register_init: MOD_LOAD (vesa, 0xffffffff80fc84c0, 0) error 19
May 25 14:24:05 freenas nexus0
May 25 14:24:05 freenas cryptosoft0: <software crypto> on motherboard
May 25 14:24:05 freenas aesni0: No AESNI support.
May 25 14:24:05 freenas padlock0: No ACE support.
May 25 14:24:05 freenas acpi0: <HPQOEM SLIC-CPC> on motherboard
May 25 14:24:05 freenas acpi0: Power Button (fixed)
May 25 14:24:05 freenas cpu0: <ACPI CPU> on acpi0
May 25 14:24:05 freenas cpu1: <ACPI CPU> on acpi0
May 25 14:24:05 freenas attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
May 25 14:24:05 freenas Timecounter "i8254" frequency 1193182 Hz quality 0
May 25 14:24:05 freenas Event timer "i8254" frequency 1193182 Hz quality 100
May 25 14:24:05 freenas atrtc0: <AT realtime clock> port 0x70-0x71 irq 8 on acpi0
May 25 14:24:05 freenas atrtc0: registered as a time-of-day clock, resolution 1.000000s
May 25 14:24:05 freenas Event timer "RTC" frequency 32768 Hz quality 0
May 25 14:24:05 freenas hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
May 25 14:24:05 freenas Timecounter "HPET" frequency 14318180 Hz quality 950
May 25 14:24:05 freenas Event timer "HPET" frequency 14318180 Hz quality 550
May 25 14:24:05 freenas Event timer "HPET1" frequency 14318180 Hz quality 450
May 25 14:24:05 freenas Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
May 25 14:24:05 freenas acpi_timer0: <32-bit timer at 3.579545MHz> port 0x808-0x80b on acpi0
May 25 14:24:05 freenas pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
May 25 14:24:05 freenas pci0: <ACPI PCI bus> on pcib0
May 25 14:24:05 freenas vgapci0: <VGA-compatible display> port 0xf000-0xf0ff mem 0xc0000000-0xcfffffff,0xfeb00000-0xfeb3ffff irq 18 at device 1.0 on pci0
May 25 14:24:05 freenas vgapci0: Boot video device
May 25 14:24:05 freenas pcib1: <ACPI PCI-PCI bridge> irq 16 at device 4.0 on pci0
May 25 14:24:05 freenas pcib1: [GIANT-LOCKED]
May 25 14:24:05 freenas ahci0: <AMD SB7x0/SB8x0/SB9x0 AHCI SATA controller> port 0xf140-0xf147,0xf130-0xf133,0xf120-0xf127,0xf110-0xf113,0xf100-0xf10f mem 0xfeb4b000-0xfeb4b3ff irq 19 at device 17.0 on pci0
May 25 14:24:05 freenas ahci0: AHCI v1.20 with 6 3Gbps ports, Port Multiplier supported
May 25 14:24:05 freenas ahci0: quirks=0x22000<ATI_PMP_BUG,1MSI>
May 25 14:24:05 freenas ahcich0: <AHCI channel> at channel 0 on ahci0
May 25 14:24:05 freenas ahcich1: <AHCI channel> at channel 1 on ahci0
May 25 14:24:05 freenas ahcich2: <AHCI channel> at channel 2 on ahci0
May 25 14:24:05 freenas ahcich3: <AHCI channel> at channel 3 on ahci0
May 25 14:24:05 freenas ahcich4: <AHCI channel> at channel 4 on ahci0
May 25 14:24:05 freenas ahcich5: <AHCI channel> at channel 5 on ahci0
May 25 14:24:05 freenas ohci0: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb4a000-0xfeb4afff irq 18 at device 18.0 on pci0
May 25 14:24:05 freenas usbus0 on ohci0
May 25 14:24:05 freenas usbus0: 12Mbps Full Speed USB v1.0
May 25 14:24:05 freenas ehci0: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb49000-0xfeb490ff irq 17 at device 18.2 on pci0
May 25 14:24:05 freenas usbus1: EHCI version 1.0
May 25 14:24:05 freenas usbus1 on ehci0
May 25 14:24:05 freenas usbus1: 480Mbps High Speed USB v2.0
May 25 14:24:05 freenas ohci1: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb48000-0xfeb48fff irq 18 at device 19.0 on pci0
May 25 14:24:05 freenas usbus2 on ohci1
May 25 14:24:05 freenas usbus2: 12Mbps Full Speed USB v1.0
May 25 14:24:05 freenas ehci1: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb47000-0xfeb470ff irq 17 at device 19.2 on pci0
May 25 14:24:05 freenas usbus3: EHCI version 1.0
May 25 14:24:05 freenas usbus3 on ehci1
May 25 14:24:05 freenas usbus3: 480Mbps High Speed USB v2.0
May 25 14:24:05 freenas pci0: <multimedia, HDA> at device 20.2 (no driver attached)
May 25 14:24:05 freenas isab0: <PCI-ISA bridge> at device 20.3 on pci0
May 25 14:24:05 freenas isa0: <ISA bus> on isab0
May 25 14:24:05 freenas pcib2: <ACPI PCI-PCI bridge> at device 20.4 on pci0
May 25 14:24:05 freenas pci1: <ACPI PCI bus> on pcib2
May 25 14:24:05 freenas ohci2: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb46000-0xfeb46fff irq 18 at device 20.5 on pci0
May 25 14:24:05 freenas usbus4 on ohci2
May 25 14:24:05 freenas usbus4: 12Mbps Full Speed USB v1.0
May 25 14:24:05 freenas pcib3: <ACPI PCI-PCI bridge> at device 21.0 on pci0
May 25 14:24:05 freenas pci2: <ACPI PCI bus> on pcib3
May 25 14:24:05 freenas pcib4: <ACPI PCI-PCI bridge> at device 21.1 on pci0
May 25 14:24:05 freenas pci3: <ACPI PCI bus> on pcib4
May 25 14:24:05 freenas re0: <RealTek 810xE PCIe 10/100baseTX> port 0xe000-0xe0ff mem 0xd0004000-0xd0004fff,0xd0000000-0xd0003fff irq 17 at device 0.0 on pci3
May 25 14:24:05 freenas re0: Using 1 MSI-X message
May 25 14:24:05 freenas re0: turning off MSI enable bit.
May 25 14:24:05 freenas re0: Chip rev. 0x40800000
May 25 14:24:05 freenas re0: MAC rev. 0x00200000
May 25 14:24:05 freenas miibus0: <MII bus> on re0
May 25 14:24:05 freenas rlphy0: <RTL8201E 10/100 media interface> PHY 1 on miibus0
May 25 14:24:05 freenas rlphy0:  10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, auto, auto-flow
May 25 14:24:05 freenas re0: Using defaults for TSO: 65518/35/2048
May 25 14:24:05 freenas re0: Ethernet address: 38:60:77:0e:8b:b4
May 25 14:24:05 freenas ohci3: <AMD SB7x0/SB8x0/SB9x0 USB controller> mem 0xfeb45000-0xfeb45fff irq 18 at device 22.0 on pci0
May 25 14:24:05 freenas usbus5 on ohci3
May 25 14:24:05 freenas usbus5: 12Mbps Full Speed USB v1.0
May 25 14:24:05 freenas ehci2: <AMD SB7x0/SB8x0/SB9x0 USB 2.0 controller> mem 0xfeb44000-0xfeb440ff irq 17 at device 22.2 on pci0
May 25 14:24:05 freenas usbus6: EHCI version 1.0
May 25 14:24:05 freenas usbus6 on ehci2
May 25 14:24:05 freenas usbus6: 480Mbps High Speed USB v2.0
May 25 14:24:05 freenas amdtemp0: <AMD CPU On-Die Thermal Sensors> on hostb4
May 25 14:24:05 freenas acpi_button0: <Power Button> on acpi0
May 25 14:24:05 freenas orm0: <ISA Option ROM> at iomem 0xce800-0xcf7ff on isa0
May 25 14:24:05 freenas amdsbwd0: <AMD SB8xx/SB9xx/Axx Watchdog Timer> at iomem 0xfec000f0-0xfec000f3,0xfec000f4-0xfec000f7 on isa0
May 25 14:24:05 freenas atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
May 25 14:24:05 freenas atkbd0: <AT Keyboard> irq 1 on atkbdc0
May 25 14:24:05 freenas kbd0 at atkbd0
May 25 14:24:05 freenas atkbd0: [GIANT-LOCKED]
May 25 14:24:05 freenas hwpstate0: <Cool`n'Quiet 2.0> on cpu0
May 25 14:24:05 freenas ZFS NOTICE: Prefetch is disabled by default if less than 4GB of RAM is present;
May 25 14:24:05 freenas to enable, add "vfs.zfs.prefetch_disable=0" to /boot/loader.conf.
May 25 14:24:05 freenas ZFS filesystem version: 5
May 25 14:24:05 freenas ZFS storage pool version: features support (5000)
May 25 14:24:05 freenas Timecounters tick every 1.000 msec
May 25 14:24:05 freenas freenas_sysctl: adding account.
May 25 14:24:05 freenas freenas_sysctl: adding directoryservice.
May 25 14:24:05 freenas freenas_sysctl: adding middlewared.
May 25 14:24:05 freenas freenas_sysctl: adding network.
May 25 14:24:05 freenas freenas_sysctl: adding services.
May 25 14:24:05 freenas ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
May 25 14:24:05 freenas ugen0.1: <ATI OHCI root HUB> at usbus0
May 25 14:24:05 freenas ugen6.1: <ATI EHCI root HUB> at usbus6
May 25 14:24:05 freenas uhub0: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus0
May 25 14:24:05 freenas uhub1: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus6
May 25 14:24:05 freenas ugen3.1: <ATI EHCI root HUB> at usbus3
May 25 14:24:05 freenas ugen4.1: <ATI OHCI root HUB> at usbus4
May 25 14:24:05 freenas uhub2: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
May 25 14:24:05 freenas uhub3: ugen1.1: <ATI EHCI root HUB> at usbus1
May 25 14:24:05 freenas syslog-ng[1648]: Error processing log message: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus4
May 25 14:24:05 freenas uhub4: <ATI EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
May 25 14:24:05 freenas ugen5.1: <ATI OHCI root HUB> at usbus5
May 25 14:24:05 freenas ugen2.1: <ATI OHCI root HUB> at usbus2
May 25 14:24:05 freenas uhub5: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus5
May 25 14:24:05 freenas uhub6: <ATI OHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
May 25 14:24:05 freenas uhub3: 2 ports with 2 removable, self powered
May 25 14:24:05 freenas uhub0: 5 ports with 5 removable, self powered
May 25 14:24:05 freenas uhub5: 4 ports with 4 removable, self powered
May 25 14:24:05 freenas uhub6: 5 ports with 5 removable, self powered
May 25 14:24:05 freenas uhub1: 4 ports with 4 removable, self powered
May 25 14:24:05 freenas uhub4: 5 ports with 5 removable, self powered
May 25 14:24:05 freenas uhub2: 5 ports with 5 removable, self powered
May 25 14:24:05 freenas ugen3.2: <vendor 0x1a40 USB 2.0 Hub> at usbus3
May 25 14:24:05 freenas uhub7 on uhub2
May 25 14:24:05 freenas uhub7: <vendor 0x1a40 USB 2.0 Hub, class 9/0, rev 2.00/1.11, addr 2> on usbus3
May 25 14:24:05 freenas ugen0.2: <Dell Dell USB Keyboard> at usbus0
May 25 14:24:05 freenas ukbd0 on uhub0
May 25 14:24:05 freenas ukbd0: <EP1 Interrupt> on usbus0
May 25 14:24:05 freenas kbd2 at ukbd0
May 25 14:24:05 freenas uhub7: 4 ports with 4 removable, self powered
May 25 14:24:05 freenas ugen1.2: <SanDisk Cruzer Fit> at usbus1
May 25 14:24:05 freenas umass0 on uhub4
May 25 14:24:05 freenas umass0: <SanDisk Cruzer Fit, class 0/0, rev 2.10/1.00, addr 2> on usbus1
May 25 14:24:05 freenas umass0:  SCSI over Bulk-Only; quirks = 0x8100
May 25 14:24:05 freenas umass0:7:0: Attached to scbus7
May 25 14:24:05 freenas ugen3.3: <JMicron USB to ATAATAPI bridge> at usbus3
May 25 14:24:05 freenas umass1 on uhub7
May 25 14:24:05 freenas umass1: <MSC Bulk-Only Transfer> on usbus3
May 25 14:24:05 freenas umass1:  SCSI over Bulk-Only; quirks = 0x4000
May 25 14:24:05 freenas umass1:8:1: Attached to scbus8
May 25 14:24:05 freenas (probe0:umass-sim1:1:0:0): REPORT LUNS. CDB: a0 00 00 00 00 00 00 00 00 10 00 00
May 25 14:24:05 freenas (probe0:umass-sim1:1:0:0): CAM status: SCSI Status Error
May 25 14:24:05 freenas (probe0:umass-sim1:1:0:0): SCSI status: Check Condition
May 25 14:24:05 freenas (probe0:umass-sim1:1:0:0): SCSI sense: ILLEGAL REQUEST asc:20,0 (Invalid command operation code)
May 25 14:24:05 freenas (probe0:umass-sim1:1:0:0): Error 22, Unretryable error
May 25 14:24:05 freenas ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
May 25 14:24:05 freenas ada0: <ST33000651NS G009> ATA8-ACS SATA 3.x device
May 25 14:24:05 freenas ada0: Serial Number Z294CBSQ
May 25 14:24:05 freenas ada0: 300.000MB/s transfers (da1 at umass-sim1 bus 1 scbus8 target 0 lun 0
May 25 14:24:05 freenas SATA 2.x, da1: UDMA6, <ST330006 51NS > Fixed Direct Access SPC-3 SCSI device
May 25 14:24:05 freenas PIO 8192bytesda1: Serial Number 000000000000
May 25 14:24:05 freenas )
May 25 14:24:05 freenas da1: 40.000MB/s transfersada0: Command Queueing enabled
May 25 14:24:05 freenas da1: 2861588MB (5860533168 512 byte sectors)
May 25 14:24:05 freenas ada0: 2861588MB (5860533168 512 byte sectors)
May 25 14:24:05 freenas da1: quirks=0x2<NO_6_BYTE>
May 25 14:24:05 freenas ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
May 25 14:24:05 freenas da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
May 25 14:24:05 freenas ada1: da0: <ST33000651NS G008> ATA8-ACS SATA 3.x device
May 25 14:24:05 freenas syslog-ng[1648]: Error processing log message: <SanDisk Cruzer Fit 1.00> Removable Direct Access SPC-4 SCSI device
May 25 14:24:05 freenas ada1: Serial Number Z293BX3V
May 25 14:24:05 freenas da0: Serial Number 4C530001100526102492
May 25 14:24:05 freenas ada1: 300.000MB/s transfersda0: 40.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes
May 25 14:24:05 freenas da0: 7632MB (15630336 512 byte sectors)
May 25 14:24:05 freenas )
May 25 14:24:05 freenas ada1: Command Queueing enabled
May 25 14:24:05 freenas da0: quirks=0x2<NO_6_BYTE>
May 25 14:24:05 freenas ada1: 2861588MB (5860533168 512 byte sectors)
May 25 14:24:05 freenas ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
May 25 14:24:05 freenas ada2: <ST33000651NS G008> ATA8-ACS SATA 3.x device
May 25 14:24:05 freenas ada2: Serial Number Z293BQB2
May 25 14:24:05 freenas ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
May 25 14:24:05 freenas ada2: Command Queueing enabled
May 25 14:24:05 freenas ada2: 2861588MB (5860533168 512 byte sectors)
May 25 14:24:05 freenas random: unblocking device.
May 25 14:24:05 freenas Trying to mount root from zfs:freenas-boot/ROOT/default []...
May 25 14:24:05 freenas kernel: re0: link state changed to UP
May 25 14:24:05 freenas kernel: re0: link state changed to UP
May 25 14:24:05 freenas SVM: disabled by BIOS.
May 25 14:24:05 freenas module_register_init: MOD_LOAD (vmm, 0xffffffff829f3400, 0) error 6
May 25 14:24:05 freenas GEOM_RAID5: Module loaded, version 1.3.20140711.62 (rev f91e28e40bf7)
May 25 14:24:05 freenas GEOM_MIRROR: Device mirror/swap0 launched (2/2).
May 25 14:24:05 freenas GEOM_MIRROR: Cancelling unmapped because of da1p1.
May 25 14:24:05 freenas GEOM_MIRROR: Device mirror/swap1 launched (2/2).
May 25 14:24:05 freenas GEOM_ELI: Device mirror/swap0.eli created.
May 25 14:24:05 freenas GEOM_ELI: Encryption: AES-XTS 128
May 25 14:24:05 freenas GEOM_ELI:     Crypto: software
May 25 14:24:05 freenas GEOM_ELI: Device mirror/swap1.eli created.
May 25 14:24:05 freenas GEOM_ELI: Encryption: AES-XTS 128
May 25 14:24:05 freenas GEOM_ELI:     Crypto: software
May 25 14:24:05 freenas GEOM_ELI: Device gptid/bda6d122-9131-11e8-991f-3860770e8bb4.eli created.
May 25 14:24:05 freenas GEOM_ELI: Encryption: AES-XTS 256
May 25 14:24:05 freenas GEOM_ELI:     Crypto: software
May 25 14:24:05 freenas GEOM_ELI: Device gptid/bec972c2-9131-11e8-991f-3860770e8bb4.eli created.
May 25 14:24:05 freenas GEOM_ELI: Encryption: AES-XTS 256
May 25 14:24:05 freenas GEOM_ELI:     Crypto: software
May 25 14:24:05 freenas GEOM_ELI: Device gptid/008eab85-d6e2-11e8-80d6-3860770e8bb4.eli created.
May 25 14:24:05 freenas GEOM_ELI: Encryption: AES-XTS 256
May 25 14:24:05 freenas GEOM_ELI:     Crypto: software
May 25 14:24:05 freenas hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> K8/4/48/0x1ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA>
May 25 14:24:05 freenas kernel: re0: link state changed to DOWN
May 25 14:24:05 freenas kernel: re0: link state changed to DOWN
May 25 14:24:05 freenas kernel: re0: link state changed to UP
May 25 14:24:05 freenas kernel: re0: link state changed to UP
May 25 14:24:10 freenas nfsd: can't register svc name
May 25 14:24:11 freenas ntpd[2074]: ntpd 4.2.8p10-a (1): Starting
May 25 14:24:14 freenas proftpd[2223]: 127.0.0.1 - ProFTPD 1.3.6 (stable) (built Tue Aug 21 2018 16:56:03 UTC) standalone mode STARTUP
May 25 14:24:36 freenas root: /etc/rc: WARNING: failed precmd routine for minio
May 25 14:26:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:27:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:28:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:29:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:30:12 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:31:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:32:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:33:12 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:34:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:35:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:36:11 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2
May 25 14:37:12 freenas /autosnap.py: [tools.autosnap:259] Volume NAS-Root not imported, skipping snapshot task #2

Is what I had when I clicked on the console window at the bottom
Screen Shot 2019-05-25 at 14.39.23.png ,
after it finished booting today.

Current zpool status:
Code:
[root@freenas ~]# zpool status                                                                                                     
  pool: freenas-boot                                                                                                               
 state: ONLINE                                                                                                                     
  scan: scrub repaired 0 in 0 days 00:01:44 with 0 errors on Wed May 15 03:46:45 2019                                               
config:                                                                                                                             
                                                                                                                                    
        NAME        STATE     READ WRITE CKSUM                                                                                     
        freenas-boot  ONLINE       0     0     0                                                                                   
          da0p2     ONLINE       0     0     0                                                                                     
                                                                                                                                    
errors: No known data errors                                                                                                       
[root@freenas ~]#

Volume/pool status:
Screen Shot 2019-05-25 at 14.41.37.png
So unless you know of somewhere else I can find more of that message, that's all I have for you. Sorry.

I have downloaded the key again, and actually put today's date in the file name when I downloaded it.

I tried a clean install on a separate drive previously, and it made no difference, but I've downloaded that new key, and try with 11.1-U6 now to see if it can still read the volume, and let you know what happens. If you think of anything in the mean time, please let me know! I should be checking on here fairly frequently, just in case!

I may look around a little for that error message first, though.
As always, thank you!
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Apollo said:
The last of your log ends at plex message.
I think you loaded your original messages using dmesg.
Can you see if you have more of that message?
You could try downloading the key again, and make sure you keep in the separate location than your current one.
The part I can't figure out is why there is no errors in the message history.

I would start fresh with a new install on Freenas on a new boot disk and try importing the pool again with the various keys.
Try to recall the steps you took from the time you had a working system to the time you started having problems.
Try to put in on paper for yourself to go through. Maybe you changed the keys at some point. Maybe you removed a disk, or added a disk.
Think of everything.
It might help shade some light.
Click to expand...

More info for you... So when I hilighted the Volume in the GUI, the "Volume Status" button was at the bottom, and this is what I got:
Code:
Request Method:    GET
Request URL:    http://192.168.1.199/admin/storage/volumestatus/datagrid/?id=1&dojo.preventCache=1558810643095
Software Version:    FreeNAS-11.1-U6 (caffd76fa)
Exception Type:    IndexError
Exception Value:   
list index out of range
Exception Location:    ./freenasUI/middleware/zfs.py in parse_status, line 761
Server time:    Sat, 25 May 2019 14:57:23 -0400
Traceback
Environment:

Software Version: FreeNAS-11.1-U6 (caffd76fa)
Request Method: GET
Request URL: http://192.168.1.199/admin/storage/volumestatus/datagrid/?id=1&dojo.preventCache=1558810643095


Traceback:
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/exception.py" in inner
  42.             response = get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _legacy_get_response
  249.             response = self._get_response(request)
File "/usr/local/lib/python3.6/site-packages/django/core/handlers/base.py" in _get_response
  178.             response = middleware_method(request, callback, callback_args, callback_kwargs)
File "./freenasUI/freeadmin/middleware.py" in process_view
  162.         return login_required(view_func)(request, *view_args, **view_kwargs)
File "/usr/local/lib/python3.6/site-packages/django/contrib/auth/decorators.py" in _wrapped_view
  23.                 return view_func(request, *args, **kwargs)
File "./freenasUI/freeadmin/options.py" in wrapper
  210.                 return self._admin.admin_view(view)(*args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/django/utils/decorators.py" in _wrapped_view
  149.                     response = view_func(request, *args, **kwargs)
File "/usr/local/lib/python3.6/site-packages/django/views/decorators/cache.py" in _wrapped_view_func
  57.         response = view_func(request, *args, **kwargs)
File "./freenasUI/freeadmin/site.py" in inner
  142.             return view(request, *args, **kwargs)
File "./freenasUI/freeadmin/options.py" in datagrid
  961.         context.update(self.get_datagrid_context(request=request))
File "./freenasUI/storage/admin.py" in get_datagrid_context
  415.         pool = notifier().zpool_parse(volume.vol_name)
File "./freenasUI/middleware/notifier.py" in zpool_parse
  3386.         parse = zfs.parse_status(name, doc, res)
File "./freenasUI/middleware/zfs.py" in parse_status
  761.     status = data.split('config:')[1]

Exception Type: IndexError at /admin/storage/volumestatus/datagrid/
Exception Value: list index out of range

 

Request information
GET
Variable    Value
id    '1'
dojo.preventCache    '1558810643095'
POST
No POST data

FILES
No FILES data

COOKIES
Variable    Value
fntreeSaveStateCookie    'root'
csrftoken    '********'
sessionid    'ybfmp00kf2rudv1ixnu6jxkciajjjyef'
META
Variable    Value

When I clicked on the "Storage" icon at the top to go back in, the volume had gone back to saying "locked" to everything, and having only the detach and unlock buttons at the bottom. I clicked the unlock one, and it went back to saying
Screen Shot 2019-05-25 at 15.02.28.png
So, that was weird.
 
A

Apollo

Wizard
Joined
Jun 13, 2013
Messages
1,458
Can you post the content of:

/val/log/debug.log
/var/log/dmesg.today
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Apollo said:
Can you post the content of:

/val/log/debug.log
/var/log/dmesg.today
Click to expand...


Thanks to your help everyone - I found enough of my data backed up that I'm confident/comfortable that I have the rest someplace. & even if I don't - I have 99% the most important stuff.

I decided just to reformat everything. I was just getting too frustrated and stressed.

I appreciate ALL of the help that ALL of you gave to me!!!

If I ever see anyone on here that I can help, I will ABSOLUTELY pay it all forward!

Thank you.
 
Heracles

Heracles

Wizard
Joined
Feb 2, 2018
Messages
1,401
Good for you that you had second copies.

Now I trust that your next pool will not be encrypted and that you will now have a formal backup plan for your important data. You have been lucky on this one. You may not be on the next one. Don't rely on luck and prepare yourself :smile:
 
A

Apollo

Wizard
Joined
Jun 13, 2013
Messages
1,458
This is too bad.
It is just sad we won't be able to know the root cause of the problem.
I suspect the removal of the overheating drive might have been one possible cause, or simply trying to add the other one.
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Heracles said:
Good for you that you had second copies.

Now I trust that your next pool will not be encrypted and that you will now have a formal backup plan for your important data. You have been lucky on this one. You may not be on the next one. Don't rely on luck and prepare yourself :)
Click to expand...

I actually am normally fairly well backed up. But I had a 3TB partition on a 4TB drive fail, and had to dd the data off, and I decided to copy the rest of the data off from the other partitions, zero the drive, and repartition it. WHILE doing that, I packed other drives/partitions nearly completely full - including the NAS up to about 90/95%. ALSO - we had a slight power hiccup and an external drive I had data on unmounted itself mid transfer, and it's partition map bit the dust. I had JUST started taking the data off of the NAS & other places & putting it back. Got the NAS down to probably 60%, and then all of the hell we were just dealing with, broke loose. & just functioning with bare minimum everything.
Just that everything happened all at once - so, normally I'm ok, but I got my ass handed to me by Murphy's Law. Of which I am a frequent victim! (Not just IT issues, everything hits me - all at once lol!)
 
T

TopherPSU

Dabbler
Joined
May 20, 2019
Messages
18
Apollo said:
This is too bad.
It is just sad we won't be able to know the root cause of the problem.
I suspect the removal of the overheating drive might have been one possible cause, or simply trying to add the other one.
Click to expand...

I too would like to have figured it out, but I simply need the storage space back. If you read my last response to Heracles, you'll see some fun details that were going on!
 
You must log in or register to reply here.

Similar threads

T
  • Locked
decryption problem after upgrade
Replies
7
Views
1K
tsf0x13
T
A
Unable to import volume.
Replies
13
Views
2K
pro lamer
pro lamer
L
  • Locked
Middleware Error when importing encrypted ZFS Volume
Replies
7
Views
2K
agartha79
agartha79
D
Can't import volume after rebuilding FreeNas boot stick
Replies
5
Views
1K
PhiloEpisteme
PhiloEpisteme
N
SOLVED Unable to decrypt Volumes
Replies
1
Views
1K
NASOD6572
N
Top