SOLVED Unable to replace failed disk via GUI (FreeNAS 11.3-U2.1)

[nemo1478]

I have a failed disk in my FreeNAS server. There are 8 2TB drives in a RAIDZ2 configuration. I have always been able to easily replace failed drives via the Legacy GUI but now that the Legacy GUI option is unavailable I'm attempting to do the replacement via the new GUI.

The failed disk was making a loud clicking sound, the activity light was not flashing and it was in an Unavailable state in the GUI so I placed it Offline, shut down the server and replaced the faulty disk. After powering up the server, I clicked on Replace in the GUI but I am not getting the option to select a member disk and of course 'Replace Disk' is greyed out. I replaced the disk with two others but I'm still having the same problem.

I need some advice on what I should do next. I have little to no experience with FreeBSD and I have not attempted to touch the command line.....yet. Needless to say I feel frustrated. Please let me know what further information you require.

RAIDZ2
/dev/gptid/bd8aefc9-cfbf-11e8-8054-0cc47a6b2ec2 is currently offline

 

[sretalla]

In the list of disks under Storage | Disks, do you see a disk that isn't assigned to a pool?

 

[nemo1478]

I see 7 disks with the same pool name and two in the boot pool (mirrored USB drives). The 8th disk is not listed. The drive is just sitting in the chassis. It has power but the activity light is not even flashing.

 

[sretalla]

Until you can see the disk there, you won't be able to add it as a replacement.

Are the disks you're adding actually blank?

 

[nemo1478]

No, this disk like others I used to successfully replace failed disks in the past was previously used as a storage drive in a larger FreeNAS build. I have quite a few of these 2TB drives from that build still available.

You're giving me some hope here. Is there a way that I can format this disk?

 

[sretalla]

Use gpart destroy -F /dev/ada3 (where ada3 is the disk you found to be the new one using gpart list)

This probably goes without saying, but be EXTREMELY CAREFUL when using that command, since it can act on disks with no regard for their status of being in a pool or not.

 

[nemo1478]

So I googled a command and here is the result.

 

[sretalla]

That looks like the output from zpool status

Not so helpful here...

Unless you wanted to use it to rule out the rawuuids from each of the partitions you will find with gpart list

 

[nemo1478]

root@freenas[~]# gpart list
Geom name: da0
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da0p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r0w0e0
efimedia: HD(1,GPT,fb7c7365-cfbf-11e8-8054-0cc47a6b2ec2,0x80,0x400000)
rawuuid: fb7c7365-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da0p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,fbb25d8c-cfbf-11e8-8054-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: fbb25d8c-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da0
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e3

Geom name: da1
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da1p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 65536
Mode: r1w1e1
efimedia: HD(1,GPT,2207eaee-1f58-11ea-9ffa-0cc47a6b2ec2,0x80,0x400000)
rawuuid: 2207eaee-1f58-11ea-9ffa-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da1p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2
efimedia: HD(2,GPT,22258de9-1f58-11ea-9ffa-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: 22258de9-1f58-11ea-9ffa-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da1
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Mode: r2w2e5

Geom name: da2
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da2p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,c492ed16-cfbf-11e8-8054-0cc47a6b2ec2,0x80,0x400000)
rawuuid: c492ed16-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da2p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,c54b51bf-cfbf-11e8-8054-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: c54b51bf-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da2
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da3
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da3p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,db485d20-cfbf-11e8-8054-0cc47a6b2ec2,0x80,0x400000)
rawuuid: db485d20-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da3p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,de3032ba-cfbf-11e8-8054-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: de3032ba-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da3
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da4
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da4p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,e71b60d8-cfbf-11e8-8054-0cc47a6b2ec2,0x80,0x400000)
rawuuid: e71b60d8-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da4p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,e7d27a25-cfbf-11e8-8054-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: e7d27a25-cfbf-11e8-8054-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da4
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da5
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da5p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 65536
Mode: r1w1e1
efimedia: HD(1,GPT,06a873a7-1ed8-11ea-83ef-0cc47a6b2ec2,0x80,0x400000)
rawuuid: 06a873a7-1ed8-11ea-83ef-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da5p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 2147549184
Mode: r1w1e2
efimedia: HD(2,GPT,06c32a1d-1ed8-11ea-83ef-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: 06c32a1d-1ed8-11ea-83ef-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da5
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Mode: r2w2e5

Geom name: da6
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 3907029127
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da6p1
Mediasize: 2147483648 (2.0G)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e1
efimedia: HD(1,GPT,e92a906b-3193-11ea-9426-0cc47a6b2ec2,0x80,0x400000)
rawuuid: e92a906b-3193-11ea-9426-0cc47a6b2ec2
rawtype: 516e7cb5-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 2147483648
offset: 65536
type: freebsd-swap
index: 1
end: 4194431
start: 128
2. Name: da6p2
Mediasize: 1998251364352 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r1w1e2
efimedia: HD(2,GPT,e9c98fb2-3193-11ea-9426-0cc47a6b2ec2,0x400080,0xe8a08808)
rawuuid: e9c98fb2-3193-11ea-9426-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 1998251364352
offset: 2147549184
type: freebsd-zfs
index: 2
end: 3907029127
start: 4194432
Consumers:
1. Name: da6
Mediasize: 2000398934016 (1.8T)
Sectorsize: 512
Stripesize: 4096
Stripeoffset: 0
Mode: r2w2e5

Geom name: da7
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 30310359
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da7p1
Mediasize: 524288 (512K)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 20480
Mode: r0w0e0
efimedia: HD(1,GPT,585974b7-ecdd-11e8-8d67-0cc47a6b2ec2,0x28,0x400)
rawuuid: 585974b7-ecdd-11e8-8d67-0cc47a6b2ec2
rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
label: (null)
length: 524288
offset: 20480
type: freebsd-boot
index: 1
end: 1063
start: 40
2. Name: da7p2
Mediasize: 15518359552 (14G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 544768
Mode: r1w1e1
efimedia: HD(2,GPT,58659cd4-ecdd-11e8-8d67-0cc47a6b2ec2,0x428,0x1ce7bb0)
rawuuid: 58659cd4-ecdd-11e8-8d67-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 15518359552
offset: 544768
type: freebsd-zfs
index: 2
end: 30310359
start: 1064
Consumers:
1. Name: da7
Mediasize: 15518924800 (14G)
Sectorsize: 512
Mode: r1w1e2

Geom name: da8
modified: false
state: OK
fwheads: 255
fwsectors: 63
last: 30310359
first: 40
entries: 128
scheme: GPT
Providers:
1. Name: da8p1
Mediasize: 524288 (512K)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 20480
Mode: r0w0e0
efimedia: HD(1,GPT,5879409b-ecdd-11e8-8d67-0cc47a6b2ec2,0x28,0x400)
rawuuid: 5879409b-ecdd-11e8-8d67-0cc47a6b2ec2
rawtype: 83bd6b9d-7f41-11dc-be0b-001560b84f0f
label: (null)
length: 524288
offset: 20480
type: freebsd-boot
index: 1
end: 1063
start: 40
2. Name: da8p2
Mediasize: 15518359552 (14G)
Sectorsize: 512
Stripesize: 0
Stripeoffset: 544768
Mode: r1w1e1
efimedia: HD(2,GPT,58857ff2-ecdd-11e8-8d67-0cc47a6b2ec2,0x428,0x1ce7bb0)
rawuuid: 58857ff2-ecdd-11e8-8d67-0cc47a6b2ec2
rawtype: 516e7cba-6ecf-11d6-8ff8-00022d09712b
label: (null)
length: 15518359552
offset: 544768
type: freebsd-zfs
index: 2
end: 30310359
start: 1064
Consumers:
1. Name: da8
Mediasize: 15518924800 (14G)
Sectorsize: 512
Mode: r1w1e2

 

[nemo1478]

I'm still not sure how to identify the new disk from the output of the 'gpart list' command. da0-da8 is still only 9 disks (7 pool + 2 boot). So the new disk is still missing? Am I correct?

 

[sretalla]

So the new disk is still missing? Am I correct?

Sounds like it may be... are you sure it's correctly connected? Maybe we need to see the output from dmesg to figure out if there's something preventing it from being presented.

If you take the rawuuid of daXp2 for each of the disks, you should find it in your zpool status somewhere.

Since the numbers match up, we can save ourselves the pain of doing that.

 

[nemo1478]

root@freenas[~]# dmesg
Copyright (c) 1992-2019 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.3-RELEASE-p7 #0 r325575+ca0f1a6ba25(HEAD): Tue Apr 21 20:46:20 UTC 2020
root@tnbuild01.tn.ixsystems.com:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
FreeBSD clang version 8.0.0 (tags/RELEASE_800/final 356365) (based on LLVM 8.0.0)
VT(vga): text 80x25
CPU: Intel(R) Xeon(R) CPU E3-1245 v3 @ 3.40GHz (3400.07-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x306c3 Family=0x6 Model=0x3c Stepping=3
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x7ffafbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x21<LAHF,ABM>
Structured Extended Features=0x27ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,NFPUSG>
XSAVE Features=0x1<XSAVEOPT>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
real memory = 34359738368 (32768 MB)
avail memory = 33262927872 (31722 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <SUPERM SMCI--MB>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 hardware threads
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ioapic0 <Version 2.0> irqs 0-23 on motherboard
SMP: AP CPU #1 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #7 Launched!
SMP: AP CPU #5 Launched!
Timecounter "TSC-low" frequency 1700036154 Hz quality 1000
random: entropy device external interface
random: registering fast source Intel Secure Key RNG
random: fast provider: "Intel Secure Key RNG"
kbd1 at kbdmux0
mlx5en: Mellanox Ethernet driver 3.5.1 (April 2019)
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS,AES-GCM,AES-ICM> on motherboard
padlock0: No ACE support.
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x1808-0x180b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 1.1 on pci0
pci2: <ACPI PCI bus> on pcib2
mps0: <Avago Technologies (LSI) SAS2308> port 0xe000-0xe0ff mem 0xf7240000-0xf724ffff,0xf7200000-0xf723ffff irq 17 at device 0.0 on pci2
mps0: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
mps0: IOCCapabilities: 5a85c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,MSIXIndex,HostDisc>
xhci0: <Intel Lynx Point USB 3.0 controller> mem 0xf7500000-0xf750ffff irq 16 at device 20.0 on pci0
xhci0: 32 bytes context size, 64-bit DMA
xhci0: Port routing mask set to 0xffffffff
usbus0 on xhci0
usbus0: 5.0Gbps Super Speed USB v3.0
ehci0: <Intel Lynx Point USB 2.0 controller USB-B> mem 0xf7514000-0xf75143ff irq 16 at device 26.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci0
usbus1: 480Mbps High Speed USB v2.0
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 0.0 on pci3
pci4: <ACPI PCI bus> on pcib4
vgapci0: <VGA-compatible display> port 0xd000-0xd07f mem 0xf6000000-0xf6ffffff,0xf7000000-0xf701ffff irq 16 at device 0.0 on pci4
vgapci0: Boot video device
pcib5: <ACPI PCI-PCI bridge> irq 18 at device 28.2 on pci0
pci5: <ACPI PCI bus> on pcib5
igb0: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0xc000-0xc01f mem 0xf7400000-0xf747ffff,0xf7480000-0xf7483fff irq 18 at device 0.0 on pci5
igb0: Using MSIX interrupts with 5 vectors
igb0: Ethernet address: 0c:c4:7a:6b:2e:c2
igb0: Bound queue 0 to cpu 0
igb0: Bound queue 1 to cpu 1
igb0: Bound queue 2 to cpu 2
igb0: Bound queue 3 to cpu 3
pcib6: <ACPI PCI-PCI bridge> irq 19 at device 28.3 on pci0
pci6: <ACPI PCI bus> on pcib6
igb1: <Intel(R) PRO/1000 Network Connection, Version - 2.5.3-k> port 0xb000-0xb01f mem 0xf7300000-0xf737ffff,0xf7380000-0xf7383fff irq 19 at device 0.0 on pci6
igb1: Using MSIX interrupts with 5 vectors
igb1: Ethernet address: 0c:c4:7a:6b:2e:c3
igb1: Bound queue 0 to cpu 4
igb1: Bound queue 1 to cpu 5
igb1: Bound queue 2 to cpu 6
igb1: Bound queue 3 to cpu 7
ehci1: <Intel Lynx Point USB 2.0 controller USB-A> mem 0xf7513000-0xf75133ff irq 22 at device 29.0 on pci0
usbus2: EHCI version 1.0
usbus2 on ehci1
usbus2: 480Mbps High Speed USB v2.0
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Lynx Point AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf043,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xf7512000-0xf75127ff irq 19 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
ahciem0: <AHCI enclosure management bridge> on ahci0
acpi_button0: <Sleep Button> on acpi0
acpi_button1: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 5 on acpi0
ipmi0: <IPMI System Interface> port 0xca2,0xca3 on acpi0
ipmi0: KCS mode found at io 0xca2 on acpi
ichwd0: <Intel Lynx Point watchdog timer> on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
wbwd0: <Nuvoton NCT6776 (0xc3/0x33) Watchdog Timer> at port 0x2e-0x2f on isa0
ichwd0: <Intel Lynx Point watchdog timer> at port 0x1830-0x1837,0x1860-0x187f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xce000-0xcefff on isa0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
ipmi0: IPMI device rev. 1, firmware rev. 1.92, version 2.0
mps0: SAS Address for SATA device = 455d3d43e2bdab94
mps0: SAS Address from SATA device = 455d3d43e2bdab94
ipmi0: Number of channels 2
mps0: SAS Address for SATA device = 90843a27aea596a3
ipmi0: Attached watchdog
ugen1.1: <Intel EHCI root HUB> at usbus1
ugen0.1: <0x8086 XHCI root HUB> at usbus0
ugen2.1: <Intel EHCI root HUB> at usbus2
uhub0: mps0: SAS Address from SATA device = 90843a27aea596a3
<Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus2
uhub2: <0x8086 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus0
mps0: SAS Address for SATA device = 2a053f206b685527
mps0: SAS Address from SATA device = 2a053f206b685527
mps0: SAS Address for SATA device = 3b2a71317b6c5246
mps0: SAS Address from SATA device = 3b2a71317b6c5246
mps0: SAS Address for SATA device = 405c5b279f9b787e
mps0: SAS Address from SATA device = 405c5b279f9b787e
mps0: SAS Address for SATA device = 3b2a713287893c57
mps0: SAS Address from SATA device = 3b2a713287893c57
mps0: SAS Address for SATA device = 90853721a7aa91a6
mps0: SAS Address from SATA device = 90853721a7aa91a6
mps0: SAS Address for SATA device = 3b2a71328789554e
mps0: SAS Address from SATA device = 3b2a71328789554e
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 200terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Retrying command
uhub2: 17 ports with 17 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen1.2: <vendor 0x8087 product 0x8008> at usbus1
uhub3 on uhub0
uhub3: <vendor 0x8087 product 0x8008, class 9/0, rev 2.00/0.05, addr 2> on usbus1
ugen2.2: <vendor 0x8087 product 0x8000> at usbus2
uhub4 on uhub1
uhub4: <vendor 0x8087 product 0x8000, class 9/0, rev 2.00/0.05, addr 2> on usbus2
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 261terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Retrying command
uhub3: 4 ports with 4 removable, self powered
uhub4: 6 ports with 6 removable, self powered
ugen0.2: <ADATA USB Flash Drive> at usbus0
umass0 on uhub2
umass0: <ADATA USB Flash Drive, class 0/0, rev 2.10/11.00, addr 1> on usbus0
umass0: SCSI over Bulk-Only; quirks = 0x8100
umass0:9:0: Attached to scbus9
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 262terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Retrying command
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 263terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Retrying command
ugen0.3: <ADATA USB Flash Drive> at usbus0
umass1 on uhub2
umass1: <ADATA USB Flash Drive, class 0/0, rev 2.10/11.00, addr 2> on usbus0
umass1: SCSI over Bulk-Only; quirks = 0x8100
umass1:10:1: Attached to scbus10
ugen0.4: <vendor 0x0557 product 0x7000> at usbus0
uhub5 on uhub2
uhub5: <vendor 0x0557 product 0x7000, class 9/0, rev 2.00/0.00, addr 3> on usbus0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 264terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Error 5, Retries exhausted
uhub5: 4 ports with 3 removable, self powered
ugen0.5: <vendor 0x0557 product 0x2419> at usbus0
ukbd0 on uhub5
ukbd0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
kbd2 at ukbd0
ses0 at ahciem0 bus 0 scbus7 target 0 lun 0
ses0: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses0: SEMB SES Device
da7 at umass-sim0 bus 0 scbus9 target 0 lun 0
da8 at umass-sim1 bus 1 scbus10 target 0 lun 0
da7: <ADATA USB Flash Drive 1100> Removable Direct Access SPC-4 SCSI device
da8: <ADATA USB Flash Drive 1100> Removable Direct Access SPC-4 SCSI device
da8: Serial Number 282192137346005F
da8: 40.000MB/s transfers
da8: 14800MB (30310400 512 byte sectors)
da7: Serial Number 2821920463440001
da7: 40.000MB/s transfers
da7: 14800MB (30310400 512 byte sectors)
da7: quirks=0x2<NO_6_BYTE>
da8: quirks=0x2<NO_6_BYTE>
da1 at mps0 bus 0 scbus0 target 1 lun 0
da1: <ATA WDC WD2003FYPS-2 5G11> Fixed Direct Access SPC-4 SCSI device
da1: Serial Number WD-WCAVY5679191
da1: 300.000MB/s transfers
da1: Command Queueing enabled
da1: 1907729MB (3907029168 512 byte sectors)
da5 at mps0 bus 0 scbus0 target 6 lun 0
da5: <ATA WDC WD2003FYPS-2 5G11> Fixed Direct Access SPC-4 SCSI device
da5: Serial Number WD-WCAVY6312644
da5: 300.000MB/s transfers
da5: Command Queueing enabled
da5: 1907729MB (3907029168 512 byte sectors)
da0 at mps0 bus 0 scbus0 target 0 lun 0
da0: <ATA WDC WD20EARS-00M AB51> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number WD-WMAZA1689326
da0: 300.000MB/s transfers
da0: Command Queueing enabled
da0: 1907729MB (3907029168 512 byte sectors)
da0: quirks=0x8<4K>
da4 at mps0 bus 0 scbus0 target 5 lun 0
da4: <ATA ST2000DM001-1ER1 CC26> Fixed Direct Access SPC-4 SCSI device
da4: Serial Number Z4Z3NP8Y
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 1907729MB (3907029168 512 byte sectors)
da4: quirks=0x8<4K>
da6 at mps0 bus 0 scbus0 target 7 lun 0
da6: <ATA ST2000DM001-1ER1 CC26> Fixed Direct Access SPC-4 SCSI device
da6: Serial Number Z4Z3NPQP
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 1907729MB (3907029168 512 byte sectors)
da6: quirks=0x8<4K>
da2 at mps0 bus 0 scbus0 target 3 lun 0
da2: <ATA ST2000DM001-1ER1 CC25> Fixed Direct Access SPC-4 SCSI device
da2: Serial Number Z4Z2B3NH
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 1907729MB (3907029168 512 byte sectors)
da2: quirks=0x8<4K>
da3 at mps0 bus 0 scbus0 target 4 lun 0
da3: <ATA TOSHIBA DT01ACA2 ABB0> Fixed Direct Access SPC-4 SCSI device
da3: Serial Number 16VXTWGTS
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 1907729MB (3907029168 512 byte sectors)
Trying to mount root from zfs:freenas-boot/ROOT/11.3-U2.1 []...
random: unblocking device.
lo0: link state changed to UP
igb0: link state changed to UP
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/4/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI> UCP/8/48/0x3f8<EDG,THR,REA,WRI,INV,QUA,PRC> UCF/1/48/0x60<REA,WRI>
igb0: link state changed to DOWN
ums0 on uhub5
ums0: <vendor 0x0557 product 0x2419, class 0/0, rev 1.10/1.00, addr 4> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_MIRROR: Device mirror/swap1 launched (2/2).
GEOM_MIRROR: Device mirror/swap2 launched (2/2).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
GEOM_ELI: Device mirror/swap2.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: hardware
igb0: link state changed to UP
CPU: Intel(R) Xeon(R) CPU E3-1245 v3 @ 3.40GHz (3400.07-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x306c3 Family=0x6 Model=0x3c Stepping=3
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0x7ffafbff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,SDBG,FMA,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,MOVBE,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16C,RDRAND>
AMD Features=0x2c100800<SYSCALL,NX,Page1GB,RDTSCP,LM>
AMD Features2=0x21<LAHF,ABM>
Structured Extended Features=0x27ab<FSGSBASE,TSCADJ,BMI1,AVX2,SMEP,BMI2,ERMS,INVPCID,NFPUSG>
Structured Extended Features3=0x9c000400<MD_CLEAR,IBPB,STIBP,L1DFL,SSBD>
XSAVE Features=0x1<XSAVEOPT>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
bridge0: Ethernet address: 02:20:ed:fb:52:00
epair0a: Ethernet address: 02:10:d0:00:05:0a
epair0b: Ethernet address: 02:c9:0d:00:06:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: changing name to 'vnet0.1'
bridge0: link state changed to UP
igb0: promiscuous mode enabled
igb0: link state changed to DOWN
vnet0.1: promiscuous mode enabled
lo0: link state changed to UP
igb0: link state changed to UP
pid 1013 (syslog-ng), jid 0, uid 0: exited on signal 6 (core dumped)
root@freenas[~]#

 

[nemo1478]

[/QUOTE]
If you take the rawuuid of daXp2 for each of the disks, you should find it in your zpool status somewhere.

Since the numbers match up, we can save ourselves the pain of doing that.
[/QUOTE]

I don't understand what you mean by this?

 

[nemo1478]

Good news!!! I replaced the drive again for the 5th time, this time with a WD drive instead of all the Seagate's that I tried before. The member disk showed up in the GUI and I was able to do the replacement. Resilvering is in progress!

I have no idea what made the difference since this WD is also a spare from the previous build that I mentioned earlier and it's not empty plus the other 4 Seagate's are all working drives.

The new disk is showing up under Storage - Disks as da9 and it's status is unused.

Thank you so much sretalla for your patience, expertise and assistance. It was good to know that I could reach out to someone for help.

 

[sretalla]

Looks like you had a problem with the seagate disks: you had this in the dmesg a whole heap of times when you had one connected:

(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00 length 36 SMID 262terminated ioc 804b loginfo 31111000 scsi 0 state c xfer 0
(probe3:mps0:0:2:0): INQUIRY. CDB: 12 00 00 00 24 00
(probe3:mps0:0:2:0): CAM status: CCB request completed with an error
(probe3:mps0:0:2:0): Retrying command


That would explain why it was not visible to the OS, the controller couldn't get it to respond.