UNIQUE constraint failed: storage_disk.disk_identifier - Could it be dual actuator drives?

cru-rootsyn

Cadet
Joined
Sep 12, 2023
Messages
5
I am receiving the following error when I try to do anything with my pools through the web UI. This includes modifying a pool or trying to create a new pool.

Create Pool​

Error: [EFAULT] (sqlite3.IntegrityError) UNIQUE constraint failed: storage_disk.disk_identifier [SQL: INSERT INTO storage_disk (disk_identifier, disk_name, disk_subsystem, disk_number, disk_serial, disk_lunid, disk_size, disk_description, disk_transfermode, disk_hddstandby, disk_advpowermgmt, disk_togglesmart, disk_smartoptions, disk_passwd, disk_model, disk_rotationrate, disk_type, disk_bus) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)] [parameters: ('{serial_lunid}ZKL02FBC0000C008774A_6000c500af41f4bf', 'sdbm', 'scsi', 17408, 'ZKL02FBC0000C008774A', '6000c500af41f4bf', 7000259821568, '', 'Auto', 'Always On', 'Disabled', 1, '', '', 'ST14000NM0001', '7200', 'HDD', 'SCSI')] (Background on this error at: https://sqlalche.me/e/14/gkpj)

I have switched this system from the latest version of truenas core (2023/01/12) to TrueNas Scale Cobia. After the upgrade I started getting this error, in an attempt to fix the problem I backed up my config blew out the OS and re-imported the config. This did not fix the problem.

This system has some seagate dual actuator drives and the duplicate serial numbers for the LUNS have caused me issues in the past, I feel like this could be a potential cause of the problem. All of the pools in the system that matter are healthy enough but I do have a pool with a couple disks that have smart failures. The pool with the 2 drives that are throwing smart errors are not a primary concern at this point, as I will address this issue later.

Workarounds that I have yet to try.

1. Create/modify the pools that I need to modify via the command line via zpool and import the pool back into truenas. This was a valid workaround that I had to use in SCALE to get past the dual actuator problem.

2. Blow out the OS again and instead of importing the entire config re-import the pools and rebuild the config by hand.

Looking for any suggestions as to which option or better or if there is another workaround / fix I should try.

My configuration:

I am Running my NAS sustem on a Dell 740

OS Version:TrueNAS-SCALE-23.10.1
Product:PowerEdge R740
Model:Intel(R) Xeon(R) Gold 6144 CPU @ 3.50GHz
Memory:1008 GiB
System Serial:CQ1K0T2

I have installed 2 LSI 2308 cards for external disk shelves
I am running a HP D6000 SAS disk shelf with 70 drive bays
The system is fully loaded with 2.5 in SAS spinners 5x (1T) and 10x SSD 400GB HGST enterprise SSD
The multi Actuator drives are in the D6000, but there also some standard SSD and STATA drives in there all of which show up properly.




zpool status shows
Code:
  pool: data0
 state: ONLINE
  scan: scrub repaired 0B in 21:50:19 with 0 errors on Sun Dec 31 21:50:27 2023
config:

    NAME                                      STATE     READ WRITE CKSUM
    data0                                     ONLINE       0     0     0
      raidz2-0                                ONLINE       0     0     0
        b1d7112a-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b16ac072-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1e81867-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1bf712b-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1562035-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b15f4113-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1df2f45-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1448225-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1efcb08-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1c74b18-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b0428d66-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1b0c60e-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b0d95661-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b14ea7d4-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1b8c7df-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b1cee779-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b3208c00-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b3c83d2f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b64934ad-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6f1a789-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6219616-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b64101e0-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b5bf4197-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6291a5f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b63886db-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6e26cfa-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6e9d50e-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6c325a6-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b65c05d2-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6cb7afa-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6db7193-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6305909-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b6d330c4-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
      raidz2-1                                ONLINE       0     0     0
        b7839c39-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b883d5b4-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb24f6ac-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb42ceec-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bad1c78e-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb143b3f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb1bb7dc-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        ba2e64ab-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb5aa2ef-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb3301c4-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bada185b-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb52866d-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bac9f98f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb4bc270-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb3b2083-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb619001-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb2bd5cc-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bcbb9b48-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bd49e4c1-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c00b077b-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c0738f34-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c012d066-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c0917a13-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c04bd721-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c0829678-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c05d1fba-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c0899c11-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c07aaf1a-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c0543b9f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c098c597-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c064c00c-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c06af79b-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c043be7f-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
    logs   
      mirror-2                                ONLINE       0     0     0
        bf2f73ab-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c1ef3a32-50cf-11ee-aef5-b026281de5fa  ONLINE       0     0     0
    spares
      c344083a-50cf-11ee-aef5-b026281de5fa    AVAIL   
      c355ff58-50cf-11ee-aef5-b026281de5fa    AVAIL   
      c35c82b9-50cf-11ee-aef5-b026281de5fa    AVAIL   

errors: No known data errors

  pool: data1
 state: ONLINE
  scan: scrub repaired 0B in 07:26:42 with 0 errors on Sun Dec 31 07:26:49 2023
config:

    NAME                                      STATE     READ WRITE CKSUM
    data1                                     ONLINE       0     0     0
      raidz2-0                                ONLINE       0     0     0
        04fd3762-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        04566067-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        051436f8-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        045e0e90-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        051c6397-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        9b14c666-921c-11ee-ba37-b026281de5fa  ONLINE       0     0     0
        04665f25-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        05058462-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        03c20ad1-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
    logs   
      mirror-1                                ONLINE       0     0     0
        03abfef3-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        02ee832d-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0

errors: No known data errors

  pool: data2
 state: ONLINE
  scan: scrub repaired 0B in 01:01:34 with 0 errors on Sun Dec 31 01:01:38 2023
config:

    NAME                                      STATE     READ WRITE CKSUM
    data2                                     ONLINE       0     0     0
      raidz1-0                                ONLINE       0     0     0
        bb89a45c-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b9a0c82a-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb62cffd-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        b8b49fc7-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
      raidz1-1                                ONLINE       0     0     0
        bcceaa71-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc546dc6-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc368a3e-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc5e7107-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
      raidz1-2                                ONLINE       0     0     0
        bcb4cb5b-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc9b9222-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc6e6e98-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bba53a81-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
      raidz1-3                                ONLINE       0     0     0
        bc425a28-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bc8119e5-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb700735-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        bb9ba971-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
      raidz1-4                                ONLINE       0     0     0
        c06e39cb-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c1beb8e1-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c1b52f92-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
        c322614a-50d1-11ee-aef5-b026281de5fa  ONLINE       0     0     0
    spares
      c31bfd75-50d1-11ee-aef5-b026281de5fa    AVAIL   
      c372ac48-50d1-11ee-aef5-b026281de5fa    AVAIL   
      c368a92e-50d1-11ee-aef5-b026281de5fa    AVAIL   
      c388e838-50d1-11ee-aef5-b026281de5fa    AVAIL   
      c37cb8cc-50d1-11ee-aef5-b026281de5fa    AVAIL   

errors: No known data errors

  pool: system
 state: ONLINE
  scan: scrub repaired 0B in 00:00:29 with 0 errors on Sun Dec 31 00:00:37 2023
config:

    NAME                                    STATE     READ WRITE CKSUM
    system                                  ONLINE       0     0     0
      7971cfaf-50d2-11ee-aef5-b026281de5fa  ONLINE       0     0     0

errors: No known data errors



lsblk shows

Code:
NAME     MAJ:MIN RM   SIZE RO TYPE  MOUNTPOINTS
loop0      7:0    0     0B  0 loop 
loop1      7:1    0     0B  0 loop 
loop2      7:2    0     0B  0 loop 
loop3      7:3    0     0B  0 loop 
loop4      7:4    0     0B  0 loop 
loop5      7:5    0     0B  0 loop 
loop6      7:6    0     0B  0 loop 
loop7      7:7    0     0B  0 loop 
sda        8:0    0   1.1T  0 disk 
└─sda1     8:1    0   1.1T  0 part 
sdb        8:16   0   1.1T  0 disk 
└─sdb1     8:17   0   1.1T  0 part 
sdc        8:32   0   1.1T  0 disk 
├─sdc1     8:33   0     1M  0 part 
├─sdc2     8:34   0   512M  0 part 
├─sdc3     8:35   0   1.1T  0 part 
└─sdc4     8:36   0    16G  0 part 
  └─sdc4 253:0    0    16G  0 crypt [SWAP]
sdd        8:48   0   1.1T  0 disk 
└─sdd1     8:49   0   1.1T  0 part 
sde        8:64   0   1.1T  0 disk 
├─sde1     8:65   0     2G  0 part 
└─sde2     8:66   0   1.1T  0 part 
sdf        8:80   0   1.1T  0 disk 
└─sdf1     8:81   0   1.1T  0 part 
sdg        8:96   0 372.5G  0 disk 
└─sdg1     8:97   0 372.5G  0 part 
sdh        8:112  0 372.5G  0 disk 
└─sdh1     8:113  0 372.5G  0 part 
sdi        8:128  0 372.5G  0 disk 
└─sdi1     8:129  0 372.5G  0 part 
sdj        8:144  0 372.5G  0 disk 
└─sdj1     8:145  0 372.5G  0 part 
sdk        8:160  0 372.5G  0 disk 
└─sdk1     8:161  0 372.5G  0 part 
sdl        8:176  0 372.5G  0 disk 
└─sdl1     8:177  0 372.5G  0 part 
sdm        8:192  0 372.5G  0 disk 
└─sdm1     8:193  0 372.5G  0 part 
sdn        8:208  0 372.5G  0 disk 
└─sdn1     8:209  0 372.5G  0 part 
sdo        8:224  0 372.5G  0 disk 
└─sdo1     8:225  0 372.5G  0 part 
sdp        8:240  0 372.5G  0 disk 
└─sdp1     8:241  0 372.5G  0 part 
sr0       11:0    1   1.5G  0 rom   
sdq       65:0    0  10.9T  0 disk 
├─sdq1    65:1    0     2G  0 part 
└─sdq2    65:2    0  10.9T  0 part 
sdr       65:16   0  10.9T  0 disk 
├─sdr1    65:17   0     2G  0 part 
└─sdr2    65:18   0  10.9T  0 part 
sds       65:32   0  10.9T  0 disk 
└─sds1    65:33   0  10.9T  0 part 
sdt       65:48   0  10.9T  0 disk 
├─sdt1    65:49   0     2G  0 part 
└─sdt2    65:50   0  10.9T  0 part 
sdu       65:64   0  10.9T  0 disk 
├─sdu1    65:65   0     2G  0 part 
└─sdu2    65:66   0  10.9T  0 part 
sdv       65:80   0  10.9T  0 disk 
├─sdv1    65:81   0     2G  0 part 
└─sdv2    65:82   0  10.9T  0 part 
sdw       65:96   0  10.9T  0 disk 
├─sdw1    65:97   0     2G  0 part 
└─sdw2    65:98   0  10.9T  0 part 
sdx       65:112  0  10.9T  0 disk 
├─sdx1    65:113  0     2G  0 part 
└─sdx2    65:114  0  10.9T  0 part 
sdy       65:128  0  10.9T  0 disk 
├─sdy1    65:129  0     2G  0 part 
└─sdy2    65:130  0  10.9T  0 part 
sdz       65:144  0   2.7T  0 disk 
├─sdz1    65:145  0     2G  0 part 
└─sdz2    65:146  0   2.7T  0 part 
sdaa      65:160  0   2.7T  0 disk 
├─sdaa1   65:161  0     2G  0 part 
└─sdaa2   65:162  0   2.7T  0 part 
sdab      65:176  0  10.9T  0 disk 
├─sdab1   65:177  0     2G  0 part 
└─sdab2   65:178  0  10.9T  0 part 
sdac      65:192  0   2.7T  0 disk 
├─sdac1   65:193  0     2G  0 part 
└─sdac2   65:194  0   2.7T  0 part 
sdad      65:208  0   2.7T  0 disk 
├─sdad1   65:209  0     2G  0 part 
└─sdad2   65:210  0   2.7T  0 part 
sdae      65:224  0   2.7T  0 disk 
├─sdae1   65:225  0     2G  0 part 
└─sdae2   65:226  0   2.7T  0 part 
sdaf      65:240  0   2.7T  0 disk 
├─sdaf1   65:241  0     2G  0 part 
└─sdaf2   65:242  0   2.7T  0 part 
sdag      66:0    0   2.7T  0 disk 
├─sdag1   66:1    0     2G  0 part 
└─sdag2   66:2    0   2.7T  0 part 
sdah      66:16   0   2.7T  0 disk 
├─sdah1   66:17   0     2G  0 part 
└─sdah2   66:18   0   2.7T  0 part 
sdai      66:32   0   2.7T  0 disk 
├─sdai1   66:33   0     2G  0 part 
└─sdai2   66:34   0   2.7T  0 part 
sdaj      66:48   0   2.7T  0 disk 
├─sdaj1   66:49   0     2G  0 part 
└─sdaj2   66:50   0   2.7T  0 part 
sdak      66:64   0   2.7T  0 disk 
├─sdak1   66:65   0     2G  0 part 
└─sdak2   66:66   0   2.7T  0 part 
sdal      66:80   0   2.7T  0 disk 
├─sdal1   66:81   0     2G  0 part 
└─sdal2   66:82   0   2.7T  0 part 
sdam      66:96   0   2.7T  0 disk 
├─sdam1   66:97   0     2G  0 part 
└─sdam2   66:98   0   2.7T  0 part 
sdan      66:112  0   2.7T  0 disk 
├─sdan1   66:113  0     2G  0 part 
└─sdan2   66:114  0   2.7T  0 part 
sdao      66:128  0   2.7T  0 disk 
├─sdao1   66:129  0     2G  0 part 
└─sdao2   66:130  0   2.7T  0 part 
sdap      66:144  0   2.7T  0 disk 
├─sdap1   66:145  0     2G  0 part 
└─sdap2   66:146  0   2.7T  0 part 
sdaq      66:160  0   2.7T  0 disk 
├─sdaq1   66:161  0     2G  0 part 
└─sdaq2   66:162  0   2.7T  0 part 
sdar      66:176  0   2.7T  0 disk 
├─sdar1   66:177  0     2G  0 part 
└─sdar2   66:178  0   2.7T  0 part 
sdas      66:192  0   2.7T  0 disk 
├─sdas1   66:193  0     2G  0 part 
└─sdas2   66:194  0   2.7T  0 part 
sdat      66:208  0   2.7T  0 disk 
├─sdat1   66:209  0     2G  0 part 
└─sdat2   66:210  0   2.7T  0 part 
sdau      66:224  0   2.7T  0 disk 
├─sdau1   66:225  0     2G  0 part 
└─sdau2   66:226  0   2.7T  0 part 
sdav      66:240  0   2.7T  0 disk 
├─sdav1   66:241  0     2G  0 part 
└─sdav2   66:242  0   2.7T  0 part 
sdaw      67:0    0   2.7T  0 disk 
├─sdaw1   67:1    0     2G  0 part 
└─sdaw2   67:2    0   2.7T  0 part 
sdax      67:16   0   6.4T  0 disk 
├─sdax1   67:17   0     2G  0 part 
└─sdax2   67:18   0   6.4T  0 part 
sday      67:32   0   2.7T  0 disk 
├─sday1   67:33   0     2G  0 part 
└─sday2   67:34   0   2.7T  0 part 
sdaz      67:48   0   2.7T  0 disk 
├─sdaz1   67:49   0     2G  0 part 
└─sdaz2   67:50   0   2.7T  0 part 
sdba      67:64   0   6.4T  0 disk 
├─sdba1   67:65   0     2G  0 part 
└─sdba2   67:66   0   6.4T  0 part 
sdbb      67:80   0   6.4T  0 disk 
├─sdbb1   67:81   0     2G  0 part 
└─sdbb2   67:82   0   6.4T  0 part 
sdbc      67:96   0   6.4T  0 disk 
├─sdbc1   67:97   0     2G  0 part 
└─sdbc2   67:98   0   6.4T  0 part 
sdbd      67:112  0   6.4T  0 disk 
├─sdbd1   67:113  0     2G  0 part 
└─sdbd2   67:114  0   6.4T  0 part 
sdbe      67:128  0   6.4T  0 disk 
├─sdbe1   67:129  0     2G  0 part 
└─sdbe2   67:130  0   6.4T  0 part 
sdbf      67:144  0   6.4T  0 disk 
├─sdbf1   67:145  0     2G  0 part 
└─sdbf2   67:146  0   6.4T  0 part 
sdbg      67:160  0   6.4T  0 disk 
├─sdbg1   67:161  0     2G  0 part 
└─sdbg2   67:162  0   6.4T  0 part 
sdbh      67:176  0   6.4T  0 disk 
├─sdbh1   67:177  0     2G  0 part 
└─sdbh2   67:178  0   6.4T  0 part 
sdbi      67:192  0   6.4T  0 disk 
├─sdbi1   67:193  0     2G  0 part 
└─sdbi2   67:194  0   6.4T  0 part 
sdbj      67:208  0   6.4T  0 disk 
├─sdbj1   67:209  0     2G  0 part 
└─sdbj2   67:210  0   6.4T  0 part 
sdbk      67:224  0   6.4T  0 disk 
├─sdbk1   67:225  0     2G  0 part 
└─sdbk2   67:226  0   6.4T  0 part 
sdbl      67:240  0   6.4T  0 disk 
sdbm      68:0    0   6.4T  0 disk 
├─sdbm1   68:1    0     2G  0 part 
└─sdbm2   68:2    0   6.4T  0 part 
sdbn      68:16   0   6.4T  0 disk 
├─sdbn1   68:17   0     2G  0 part 
└─sdbn2   68:18   0   6.4T  0 part 
sdbo      68:32   0   6.4T  0 disk 
├─sdbo1   68:33   0     2G  0 part 
└─sdbo2   68:34   0   6.4T  0 part 
sdbp      68:48   0   6.4T  0 disk 
├─sdbp1   68:49   0     2G  0 part 
└─sdbp2   68:50   0   6.4T  0 part 
sdbq      68:64   0   6.4T  0 disk 
├─sdbq1   68:65   0     2G  0 part 
└─sdbq2   68:66   0   6.4T  0 part 
sdbr      68:80   0   6.4T  0 disk 
├─sdbr1   68:81   0     2G  0 part 
└─sdbr2   68:82   0   6.4T  0 part 
sdbs      68:96   0   6.4T  0 disk 
├─sdbs1   68:97   0     2G  0 part 
└─sdbs2   68:98   0   6.4T  0 part 
sdbt      68:112  0   6.4T  0 disk 
├─sdbt1   68:113  0     2G  0 part 
└─sdbt2   68:114  0   6.4T  0 part 
sdbu      68:128  0   6.4T  0 disk 
├─sdbu1   68:129  0     2G  0 part 
└─sdbu2   68:130  0   6.4T  0 part 
sdbv      68:144  0   6.4T  0 disk 
├─sdbv1   68:145  0     2G  0 part 
└─sdbv2   68:146  0   6.4T  0 part 
sdbw      68:160  0   6.4T  0 disk 
├─sdbw1   68:161  0     2G  0 part 
└─sdbw2   68:162  0   6.4T  0 part 
sdbx      68:176  0   6.4T  0 disk 
├─sdbx1   68:177  0     2G  0 part 
└─sdbx2   68:178  0   6.4T  0 part 
sdby      68:192  0   6.4T  0 disk 
├─sdby1   68:193  0     2G  0 part 
└─sdby2   68:194  0   6.4T  0 part 
sdbz      68:208  0   6.4T  0 disk 
├─sdbz1   68:209  0     2G  0 part 
└─sdbz2   68:210  0   6.4T  0 part 
sdca      68:224  0   6.4T  0 disk 
├─sdca1   68:225  0     2G  0 part 
└─sdca2   68:226  0   6.4T  0 part 
sdcb      68:240  0   6.4T  0 disk 
├─sdcb1   68:241  0     2G  0 part 
└─sdcb2   68:242  0   6.4T  0 part 
sdcc      69:0    0   6.4T  0 disk 
├─sdcc1   69:1    0     2G  0 part 
└─sdcc2   69:2    0   6.4T  0 part 
sdcd      69:16   0   6.4T  0 disk 
├─sdcd1   69:17   0     2G  0 part 
└─sdcd2   69:18   0   6.4T  0 part 
sdce      69:32   0   6.4T  0 disk 
├─sdce1   69:33   0     2G  0 part 
└─sdce2   69:34   0   6.4T  0 part 
sdcf      69:48   0   6.4T  0 disk 
├─sdcf1   69:49   0     2G  0 part 
└─sdcf2   69:50   0   6.4T  0 part 
sdcg      69:64   0   6.4T  0 disk 
├─sdcg1   69:65   0     2G  0 part 
└─sdcg2   69:66   0   6.4T  0 part 
sdch      69:80   0   6.4T  0 disk 
├─sdch1   69:81   0     2G  0 part 
└─sdch2   69:82   0   6.4T  0 part 
sdci      69:96   0   6.4T  0 disk 
├─sdci1   69:97   0     2G  0 part 
└─sdci2   69:98   0   6.4T  0 part 
sdcj      69:112  0   6.4T  0 disk 
├─sdcj1   69:113  0     2G  0 part 
└─sdcj2   69:114  0   6.4T  0 part 
sdck      69:128  0   6.4T  0 disk 
├─sdck1   69:129  0     2G  0 part 
└─sdck2   69:130  0   6.4T  0 part 
sdcl      69:144  0   6.4T  0 disk 
├─sdcl1   69:145  0     2G  0 part 
└─sdcl2   69:146  0   6.4T  0 part 
sdcm      69:160  0   6.4T  0 disk 
├─sdcm1   69:161  0     2G  0 part 
└─sdcm2   69:162  0   6.4T  0 part 
sdcn      69:176  0   6.4T  0 disk 
├─sdcn1   69:177  0     2G  0 part 
└─sdcn2   69:178  0   6.4T  0 part 
sdco      69:192  0   6.4T  0 disk 
├─sdco1   69:193  0     2G  0 part 
└─sdco2   69:194  0   6.4T  0 part 
sdcp      69:208  0   6.4T  0 disk 
├─sdcp1   69:209  0     2G  0 part 
└─sdcp2   69:210  0   6.4T  0 part 
sdcq      69:224  0   6.4T  0 disk 
├─sdcq1   69:225  0     2G  0 part 
└─sdcq2   69:226  0   6.4T  0 part 
sdcr      69:240  0   6.4T  0 disk 
├─sdcr1   69:241  0     2G  0 part 
└─sdcr2   69:242  0   6.4T  0 part 
sdcs      70:0    0   6.4T  0 disk 
├─sdcs1   70:1    0     2G  0 part 
└─sdcs2   70:2    0   6.4T  0 part 
sdct      70:16   0   6.4T  0 disk 
├─sdct1   70:17   0     2G  0 part 
└─sdct2   70:18   0   6.4T  0 part 
sdcu      70:32   0   6.4T  0 disk 
├─sdcu1   70:33   0     2G  0 part 
└─sdcu2   70:34   0   6.4T  0 part 
sdcv      70:48   0   6.4T  0 disk 
├─sdcv1   70:49   0     2G  0 part 
└─sdcv2   70:50   0   6.4T  0 part 
sdcw      70:64   0   6.4T  0 disk 
├─sdcw1   70:65   0     2G  0 part 
└─sdcw2   70:66   0   6.4T  0 part 
sdcx      70:80   0   6.4T  0 disk 
├─sdcx1   70:81   0     2G  0 part 
└─sdcx2   70:82   0   6.4T  0 part 
sdcy      70:96   0   6.4T  0 disk 
├─sdcy1   70:97   0     2G  0 part 
└─sdcy2   70:98   0   6.4T  0 part 
sdcz      70:112  0   6.4T  0 disk 
├─sdcz1   70:113  0     2G  0 part 
└─sdcz2   70:114  0   6.4T  0 part 
sdda      70:128  0   6.4T  0 disk 
├─sdda1   70:129  0     2G  0 part 
└─sdda2   70:130  0   6.4T  0 part 
sddb      70:144  0   6.4T  0 disk 
├─sddb1   70:145  0     2G  0 part 
└─sddb2   70:146  0   6.4T  0 part 
sddc      70:160  0   6.4T  0 disk 
├─sddc1   70:161  0     2G  0 part 
└─sddc2   70:162  0   6.4T  0 part 
sddd      70:176  0   6.4T  0 disk 
├─sddd1   70:177  0     2G  0 part 
└─sddd2   70:178  0   6.4T  0 part 
sdde      70:192  0   6.4T  0 disk 
├─sdde1   70:193  0     2G  0 part 
└─sdde2   70:194  0   6.4T  0 part 
sddf      70:208  0   6.4T  0 disk 
├─sddf1   70:209  0     2G  0 part 
└─sddf2   70:210  0   6.4T  0 part 
sddg      70:224  0   6.4T  0 disk 
├─sddg1   70:225  0     2G  0 part 
└─sddg2   70:226  0   6.4T  0 part 
sddh      70:240  0   6.4T  0 disk 
├─sddh1   70:241  0     2G  0 part 
└─sddh2   70:242  0   6.4T  0 part 
sddi      71:0    0   6.4T  0 disk 
├─sddi1   71:1    0     2G  0 part 
└─sddi2   71:2    0   6.4T  0 part 
sddj      71:16   0   6.4T  0 disk 
├─sddj1   71:17   0     2G  0 part 
└─sddj2   71:18   0   6.4T  0 part 
sddk      71:32   0   6.4T  0 disk 
├─sddk1   71:33   0     2G  0 part 
└─sddk2   71:34   0   6.4T  0 part 
sddl      71:48   0   6.4T  0 disk 
├─sddl1   71:49   0     2G  0 part 
└─sddl2   71:50   0   6.4T  0 part 
sddm      71:64   0   6.4T  0 disk 
├─sddm1   71:65   0     2G  0 part 
└─sddm2   71:66   0   6.4T  0 part 
sddn      71:80   0   6.4T  0 disk 
├─sddn1   71:81   0     2G  0 part 
└─sddn2   71:82   0   6.4T  0 part 
sddo      71:96   0   6.4T  0 disk 
├─sddo1   71:97   0     2G  0 part 
└─sddo2   71:98   0   6.4T  0 part 
sddp      71:112  0   6.4T  0 disk 
├─sddp1   71:113  0     2G  0 part 
└─sddp2   71:114  0   6.4T  0 part 
sddq      71:128  0   6.4T  0 disk 
├─sddq1   71:129  0     2G  0 part 
└─sddq2   71:130  0   6.4T  0 part 
sddr      71:144  1     0B  0 disk  



System details list
 

Attachments

  • debug-cyclops-20240112003143.tgz
    1.2 MB · Views: 33
  • lspci-output.txt
    24.4 KB · Views: 40

cru-rootsyn

Cadet
Joined
Sep 12, 2023
Messages
5
An additional detail that I forgot to mention, I have 2 bond interfaces in the machine

bond0 which is a mellanox Connect-X 3 50Gbps
and
bond1 which is the onboard 10gbps intel sfp+ cards
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
This system has some seagate dual actuator drives and the duplicate serial numbers for the LUNS have caused me issues in
Very likely, the middleware expects drive serial numbers to be unique. This was only a problem in edge cases that didn't matter, previously, but dual-actuator disks do matter...

I'd suggest filling a bug report
 

Arwen

MVP
Joined
May 17, 2014
Messages
3,611
I glanced at your Jira ticket, (have to be logged in to see it...), and saw something odd. Probably unrelated to your problem. But, never the less a problem for the future.

The storage pool "data0" has 2 RAID-Z2 vDevs with the width of 33 disks. This is way above the suggested maximum of 10 to 12 disks per RAID-Zx vDev. I know that some people have had success with RAID-Zx vDevs using 15, even 18 disks. However, I would think that 33 is beyond reasonable and will likely introduce odd performance behavior. Like during a scrub or re-silver.


As for the original issue, I don't know. I was just reading this post & bug to learn about the dual actuator drives.

Good luck in either case.
 

cru-rootsyn

Cadet
Joined
Sep 12, 2023
Messages
5
I glanced at your Jira ticket, (have to be logged in to see it...), and saw something odd. Probably unrelated to your problem. But, never the less a problem for the future.

The storage pool "data0" has 2 RAID-Z2 vDevs with the width of 33 disks. This is way above the suggested maximum of 10 to 12 disks per RAID-Zx vDev. I know that some people have had success with RAID-Zx vDevs using 15, even 18 disks. However, I would think that 33 is beyond reasonable and will likely introduce odd performance behavior. Like during a scrub or re-silver.


As for the original issue, I don't know. I was just reading this post & bug to learn about the dual actuator drives.

Good luck in either case.

Thanks for the pointer. This system was previously CORE, does that general guideline apply to CORE as well?

Seems to be chugging along just fine and its pretty performant.. :shrug:

I believe you are refering to the dual actuator drives, that was splitting them down the middle into 2 vdevs one LUN on each side. What would the optimal vdev config for that be. do like 6x11 with RaidZ2?
 
Last edited:

Arwen

MVP
Joined
May 17, 2014
Messages
3,611
The width of a RAID-Zx vDev applies to all ZFS' OSes, including TrueNAS Core. It's a ZFS thing.

Yes, some people have few problems with very wide RAID-Zx vDevs. Some times the problem shows up later. And the problem may show up with smaller files, where larger files that fit a 31 wide RAID-Z2 stripe might not have problems. (I say 31 because the other 2 disks are parity for RAID-Z2, thus 31 data disks.)

I have no suggestion for dual actuator drives.
 
Top