After replacing disk in pool, multi path is not enabled for disk

[surrealillusion]

I've come across an odd behaviour when replacing a disk in our zpool. Following the instructions in the docs on replacing a failed drive and having it re-silver a spool status shows all drives are online and the pool is healthy. The GUI on the other hand shows a few things that weren't there before.

Attached are two screenshots of the View Disks and Multipath tabs. Originally when the pool was set up none of the disks were listed in the GUI and disk1 was in the Multipath tab (assigned to da0 and da2, which now only shows disks 2-23).

Hardware specs:

CPU: 2 x Intel Xeon E5 2620
Motherboard: Supermicro X9DRI-LN4F
RAM: 128GB
HBA: LSI 9207-8e
NIC: Intel Quad port ET
IPMI: 172.17.16.24 (dedicated NIC port)
FreeNAS 9.2.1.6

 

[dlavigne]

Does running this command fix it? service ix-multipath start

 

[William Grzybowski]

Can you paste "zpool status" please?

 

[surrealillusion]

[root@FUEL-ZNAS01] ~# zpool status
pool: ZStore01
state: ONLINE
scan: resilvered 729G in 5h7m with 0 errors on Tue Sep 9 17:10:19 2014
config:

NAME STATE READ WRITE CKSUM
ZStore01 ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
gptid/f73ffe01-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f78f66d1-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f7dfc98a-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f82feedb-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f883cfa0-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f8d44c58-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
raidz2-1 ONLINE 0 0 0
gptid/f93c4006-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f98af336-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/f9dca8ff-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fa2bf519-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fa7ca212-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/facd9e14-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
raidz2-2 ONLINE 0 0 0
gptid/fb335cd0-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fb7de2ef-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fbcb1aea-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fc1ce2d7-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fc6c78c3-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fcbbca97-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
raidz2-3 ONLINE 0 0 0
gptid/fd226264-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fd725797-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fdc3cdd5-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/fe14a35e-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0
gptid/befb8e83-383a-11e4-b02f-90e2ba4a9ff4 ONLINE 0 0 0
gptid/feb14486-f8b1-11e3-9853-90e2ba4a9ff4 ONLINE 0 0 0

errors: No known data errors

 

[surrealillusion]

Does running this command fix it? service ix-multipath start

Did not appear to correct anything in the GUI

 

[William Grzybowski]

That does not looks right.

glabel status
and
gmultipath status

please.

 

[surrealillusion]

[root@FUEL-ZNAS01] ~# glabel status
Name Status Components
ufs/FreeNASs3 N/A da48s3
ufs/FreeNASs4 N/A da48s4
ufs/FreeNASs1a N/A da48s1a
ufsid/53a39ad90592dd9a N/A da48s2a
ufs/FreeNASs2a N/A da48s2a
gptid/f883cfa0-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk7p2
gptid/fb7de2ef-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk16p2
gptid/f93c4006-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk9p2
gptid/f9dca8ff-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk11p2
gptid/fbcb1aea-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk17p2
gptid/fa2bf519-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk12p2
gptid/fc6c78c3-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk19p2
gptid/fa7ca212-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk13p2
gptid/f73ffe01-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk3p2
gptid/f98af336-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk10p2
gptid/fcbbca97-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk20p2
gptid/fe14a35e-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk24p2
gptid/facd9e14-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk14p2
gptid/fd226264-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk21p2
gptid/f78f66d1-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk4p2
gptid/f7dfc98a-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk5p2
gptid/f82feedb-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk6p2
gptid/fc1ce2d7-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk18p2
gptid/fdc3cdd5-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk23p2
gptid/f8d44c58-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk8p2
gptid/fd725797-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk22p2
gptid/fb335cd0-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk15p2
gptid/feb14486-f8b1-11e3-9853-90e2ba4a9ff4 N/A multipath/disk2p2
gptid/befb8e83-383a-11e4-b02f-90e2ba4a9ff4 N/A da46p2
[root@FUEL-ZNAS01] ~# gmultipath status
Name Status Components
multipath/disk7 OPTIMAL da45 (ACTIVE)
da44 (PASSIVE)
multipath/disk16 OPTIMAL da43 (ACTIVE)
da42 (PASSIVE)
multipath/disk9 OPTIMAL da41 (ACTIVE)
da40 (PASSIVE)
multipath/disk11 OPTIMAL da39 (ACTIVE)
da38 (PASSIVE)
multipath/disk17 OPTIMAL da37 (ACTIVE)
da36 (PASSIVE)
multipath/disk12 OPTIMAL da35 (ACTIVE)
da34 (PASSIVE)
multipath/disk19 OPTIMAL da33 (ACTIVE)
da32 (PASSIVE)
multipath/disk13 OPTIMAL da31 (ACTIVE)
da30 (PASSIVE)
multipath/disk3 OPTIMAL da29 (ACTIVE)
da28 (PASSIVE)
multipath/disk10 OPTIMAL da27 (ACTIVE)
da26 (PASSIVE)
multipath/disk20 OPTIMAL da25 (ACTIVE)
da24 (PASSIVE)
multipath/disk24 OPTIMAL da23 (ACTIVE)
da22 (PASSIVE)
multipath/disk14 OPTIMAL da21 (ACTIVE)
da20 (PASSIVE)
multipath/disk21 OPTIMAL da19 (ACTIVE)
da18 (PASSIVE)
multipath/disk4 OPTIMAL da17 (ACTIVE)
da16 (PASSIVE)
multipath/disk5 OPTIMAL da15 (ACTIVE)
da14 (PASSIVE)
multipath/disk6 OPTIMAL da13 (ACTIVE)
da12 (PASSIVE)
multipath/disk18 OPTIMAL da11 (ACTIVE)
da10 (PASSIVE)
multipath/disk23 OPTIMAL da9 (ACTIVE)
da8 (PASSIVE)
multipath/disk8 OPTIMAL da7 (ACTIVE)
da6 (PASSIVE)
multipath/disk22 OPTIMAL da5 (ACTIVE)
da4 (PASSIVE)
multipath/disk15 OPTIMAL da3 (ACTIVE)
da2 (PASSIVE)
multipath/disk2 OPTIMAL da1 (ACTIVE)
da0 (PASSIVE)
[root@FUEL-ZNAS01] ~#

 

[William Grzybowski]

Well, you have one disk in your pool which is not a multipath.

You should offline that disk (gptid/befb8e83-383a-11e4-b02f-90e2ba4a9ff4), run service ix-multipath start, and replace the missing entry with the multipath name.

 

[surrealillusion]

Given I'm still a bit new to all of this I want to double check that the following steps are the ones I should complete:

1. In the GUI under Volume Status, Offline da46p2
2. in CLI, run "service ix-multipath start"
3. Not sure where and what to put in for the missing entry.

Thanks in advance

 

[William Grzybowski]

After running "service ix-multipath start" it should create the multipath/diskXX to used in the replace.

 

[surrealillusion]

Offline'd the disk in the GUI then ran service ix-multipath start. The disk now shows as in the CLI:

9621282238160148922 OFFLINE 0 0 0 was /dev/gptid/befb8e83-383a-11e4-b02f-90e2ba4a9ff4

It does not appear the multipath is automatically generated.

Attempting to use this disk as a replacement throws an errror saying the disk is already part of the zpool.

Update:

I went through the CLI and ran:

zpool replace tank /dev/gptid/befb8e83-383a-11e4-b02f-90e2ba4a9ff4 /dev/multipath/disk1

and it appears to be re-silvering the drive now. Is there any reason why it's not showing disk1p2 like the other drives after running the ix-multipath start?

 

[dlavigne]

Did this ever get resolved?