Drive is missing in TrueNAS, but shows up in SAS BIOS and Linux

[UntouchedWagons]

• Dell Poweredge R510
• Dual Xeon X5660's
• 64GB DDR3 ECC-RAM
• Seven 8TB Western Digital whites + one 8TB WD Red, Intel 120GB SSD
• LSI SAS controller in IT mode (not sure of the model off the top of my head
• 10gtek 10gig NIC

Up until today my R510 had been running Proxmox and it is under proxmox that I made the ZFS pool. The ZFS pool was made using GPT partition labels. The other day the drive in row 2 column 3 died and I replaced it with the WD Red drive that I had. Today I replaced Proxmox with TrueNAS Core 12.0-U3.1 and manually imported the pool so that ZFS would continue using the GPT labels, but the drive in row 2 column 3 was missing. I took the drive out and could feel the platters spinning. I replace the drive with a random spare hard drive but TrueNAS could't see that drive either.

I put the 8TB Red back in and rebooted into the SAS controller's BIOS, the SAS controller was able to see all eight 8TB drives. I booted into SystemRescueCD and it too was able to see all eight drives. I rebooted again back into TrueNAS and it still can't see this one particular hard drive.

What's going on? I can get the exact make and model of the SAS controller but it'll have to be tomorrow morning.

 

[c77dk]

when you say "can't see" in TrueNAS - how do you try to list the drives? From the gui or cli?

 

[UntouchedWagons]

Both.

# ls /dev/da*
/dev/da0 /dev/da1 /dev/da2 /dev/da3 /dev/da4 /dev/da5 /dev/da6 /dev/da7 /dev/da7p2
/dev/da0p1 /dev/da1p1 /dev/da2p1 /dev/da3p1 /dev/da4p1 /dev/da5p1 /dev/da6p1 /dev/da7p1

I can't get code formatting to work. As you can see there's eight drives, da7 is the boot drive.

# ls /dev/gpt/
R1C1 R1C2 R1C3 R1C4 R2C1 R2C2 R2C4

R2C3 is missing but if I boot into linux it shows up.

 

[UntouchedWagons]

Can I not edit my posts? Here's the actual SAS controller:

#lspci | grep SAS
Serial Attached SCSI Controller: Broadcom / LSI SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon] (rev 03)

All eight drives show up in Linux:

#ls /dev/disk/by-partlabel/
R1C1 R1C2 R1C3 R1C4 R2C1 R2C2 R2C3 R2C4

I'm thinking this is some sort of driver issue.

 

[c77dk]

It could sound like driver/firmware - maybe someone else have some ideas with that hardware.

I don't really expect to see the disk, but what's the output of

Code:

camcontrol devlist

? Maybe dmesg can be helpful?

 

[UntouchedWagons]

# camcontrol devlist
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 3 lun 0 (pass0,da0)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 4 lun 0 (pass1,da1)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 5 lun 0 (pass2,da2)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 6 lun 0 (pass3,da3)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 7 lun 0 (pass4,da4)
<DP BACKPLANE 1.10> at scbus0 target 8 lun 0 (pass5,ses0)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 9 lun 0 (pass6,da5)
<ATA WDC WD80EZAZ-11T 0A83> at scbus0 target 10 lun 0 (pass7,da6)
<ASMT ASM105x 0> at scbus6 target 0 lun 0 (pass8,da7)

 

[UntouchedWagons]

I decided to switch back to Proxmox.