After deleting my pool i get the message "savecore 2901 - - /dev/nvd0p3: Operation not permitted"

[Revan]

I have created one pool to test a little around.
Then i destroyed it according to this manual:

9. Storage — FreeNAS®11.2-U3 User Guide Table of Contents

www.ixsystems.com

The manual says, that it will copy some system configuration data back to the system disk, if the last pool got deleted.
That was in my case the case.

/dev/nvd0p3 is my system disk. It's a SSD. The pool was on 6 HDs.

The messages were only shown in the IPMI ikvm console, not in the webserver display and not in the the webservers log console, which i have activated to be shown.

Do i have to assume, that some of the data couldn't copied back to the system disk?
And if yes, what kind of data was this?

These were the error messages (without date):

Code:

savecore 2901 - -  /dev/nvd0p3: Operation not permitted
savecore 3011 - -  /dev/nvd0p3: Operation not permitted
savecore 3371 - -  /dev/nvd0p3: Operation not permitted
savecore 3457 - -  /dev/nvd0p3: Operation not permitted

 

[sretalla]

Your system dataset would potentially have been on your data pool and would have needed to move back to the boot pool when you deleted it.

Check under System | System Dataset for where it currently thinks it is.

 

[Revan]

Your system dataset would potentially have been on your data pool and would have needed to move back to the boot pool when you deleted it.

Check under System | System Dataset for where it currently thinks it is.

Ok, i tried it again.
I created a new pool.
Then i updated TrueNAS to 12.0-U2
And after that, i deleted the pool again.
This time, with the new TrueNAS version i got only two error messages instead of four:

Code:

hostname   savecore 6544 - - /dev/nvd0p3: Operation not permitted
hostname   savecore 6648 - - /dev/nvd0p3: Operation not permitted

"System | System Dataset" says after deleting the pool, that the System Dataset is on "boot-pool".

 

[Revan]

Okay, now, after creating a new pool on the new TrueNAS 12.0-U2 version i get the error message

Code:

Error getting disk data

This didn't happen yesterday with TrueNAS 12.0-U1.1

EDIT:
But after switching from Storage/Pool to Dashboard and back to Storage/Pool i get at least my new pool listed.
I wonder, why that error message was shown?

 

[Revan]

Ok, i did it again one more time.
Deleted the pool and created it again.

I got 5 of these messages:

Code:

Error getting disk data

I had to click 5 times at least on that pop up message window in the webinterface to get rid of it.

 

[sretalla]

What are the last several lines of dmesg showing?

Is your boot pool on nvme0?

Do you see some core dumps in /var/db/system/cores/ ?

 

[Revan]

Code:

GEOM_MIRROR: Device mirror/swap0 launched (3/3).
GEOM_MIRROR: Device mirror/swap1 launched (3/3).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
igb0: link state changed to DOWN
igb0: link state changed to UP
CPU: Intel(R) Pentium(R) CPU G4500 @ 3.50GHz (3504.12-MHz K8-class CPU)
  Origin="GenuineIntel"  Id=0x506e3  Family=0x6  Model=0x5e  Stepping=3
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x4ffaebbf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,SDBG,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,RDRAND>
  AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
  AMD Features2=0x121<LAHF,ABM,Prefetch>
  Structured Extended Features=0x2942607<FSGSBASE,TSCADJ,SGX,ERMS,INVPCID,NFPUSG,RDSEED,SMAP,CLFLUSHOPT,PROCTRACE>
  Structured Extended Features3=0x9c002600<MCUOPT,MD_CLEAR,TSXFA,IBPB,STIBP,L1DFL,SSBD>
  XSAVE Features=0xf<XSAVEOPT,XSAVEC,XINUSE,XSAVES>
  VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
  TSC: P-state invariant, performance statistics
Security policy loaded: MAC/ntpd (mac_ntpd)
GEOM_ELI: Device mirror/swap1.eli destroyed.
GEOM_MIRROR: Device swap1: provider destroyed.
GEOM_MIRROR: Device swap1 destroyed.
GEOM_ELI: Device mirror/swap0.eli destroyed.
GEOM_MIRROR: Device swap0: provider destroyed.
GEOM_MIRROR: Device swap0 destroyed.
GEOM_ELI: Device nvd0p3.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_MIRROR: Device mirror/swap0 launched (3/3).
GEOM_MIRROR: Device mirror/swap1 launched (3/3).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli destroyed.
GEOM_MIRROR: Device swap1: provider destroyed.
GEOM_MIRROR: Device swap1 destroyed.
GEOM_ELI: Device mirror/swap0.eli destroyed.
GEOM_MIRROR: Device swap0: provider destroyed.
GEOM_MIRROR: Device swap0 destroyed.
GEOM_ELI: Device nvd0p3.eli destroyed.
GEOM_MIRROR: Device mirror/swap0 launched (3/3).
GEOM_MIRROR: Device mirror/swap1 launched (3/3).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli destroyed.
GEOM_MIRROR: Device swap1: provider destroyed.
GEOM_MIRROR: Device swap1 destroyed.
GEOM_ELI: Device mirror/swap0.eli destroyed.
GEOM_MIRROR: Device swap0: provider destroyed.
GEOM_MIRROR: Device swap0 destroyed.
GEOM_ELI: Device nvd0p3.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_MIRROR: Device mirror/swap0 launched (3/3).
GEOM_MIRROR: Device mirror/swap1 launched (3/3).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli destroyed.
GEOM_MIRROR: Device swap1: provider destroyed.
GEOM_MIRROR: Device swap1 destroyed.
GEOM_ELI: Device mirror/swap0.eli destroyed.
GEOM_MIRROR: Device swap0: provider destroyed.
GEOM_MIRROR: Device swap0 destroyed.
GEOM_ELI: Device nvd0p3.eli destroyed.
GEOM_MIRROR: Device mirror/swap0 launched (3/3).
GEOM_MIRROR: Device mirror/swap1 launched (3/3).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI:     Crypto: hardware

A directroy called /var/sb/system/cores does not exist, but if you meant

Code:

ls /var/db/system/cores

that one is empty.

 

[Revan]

Is your boot pool on nvme0?

Yes, it is.

 

[sretalla]

Seems there is trouble creating the swap on your NVME0 drive.

I would try backing up your config, reinstalling and restoring the config to see if that can correct it.

I suspect something wrong with the partitioning on your boot drive.

 

[Revan]

Seems there is trouble creating the swap on your NVME0 drive.

I would try backing up your config, reinstalling and restoring the config to see if that can correct it.

I suspect something wrong with the partitioning on your boot drive.

You might be correct.

There is only one partition on my boot drive:

Code:

root@##########[~]# fdisk -s  /dev/nvd0
/dev/nvd0: 31130 cyl 255 hd 63 sec
Part        Start        Size Type Flags
   1:           1   500118191 0xee 0x00
root@##########[~]#

But according to the IPMI console, savecore is trying to write to partition 3 which doesn't exist:

Code:

.... ##########.local savecore 3611 - - /dev/nvd0p3: Operation not permitted

I will reinstall TrueNAS and see if that helps.