I have a 20 Disk Pool in a R720XD using a R310 in IT mode. Everything has been fine so far. This morning I got a e-mail telling me its degrateded. I have replacement drives standing by but I have NO CLUE what drive is in what bay :( Guess I should have goten them.. I use this with my production iSCSI system so its not really possible to shutdown.
I understand that the da19 is the device that is offline. I have the gptid and ran a script that shows what serial they are.
I run the drives script but it don't come back with serials:
When I open my web browser, I hit zpool status, then click edit on da19, and i get 19042910240381 as the serial number. Don't know if that is the actual serial number. Just making sure. If I replace this serial number, that would work. Since i don't konw what serial is in what bay, my only option is to do a 3am shutdown remove each drive, record what serial number goes into what bay, then find that serial number and replace it? Any other options? Note this is a RAIDZ3 system, i thought i had at least one on-line spare, but my assumption is that i can not pull the drive i think it is, and then expect the zraid to keep working? If its not that drive, how long do i have to wait till i pull the next one? Just wondering.
I understand that the da19 is the device that is offline. I have the gptid and ran a script that shows what serial they are.
Code:
pool: pool1 state: DEGRADED status: One or more devices has experienced an unrecoverable error. An attempt was made to correct the error. Applications are unaffected. action: Determine if the device needs to be replaced, and clear the errors using 'zpool clear' or replace the device with 'zpool replace'. see: http://illumos.org/msg/ZFS-8000-9P scan: resilvered 25.5G in 0 days 00:19:04 with 0 errors on Mon Jul 29 10:00:33 2019 config: NAME STATE READ WRITE CKSUM pool1 DEGRADED 0 0 0 raidz3-0 DEGRADED 0 0 0 gptid/f6bbd828-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/f7c2452d-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/f8c8f66b-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/f9d3e76e-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/fae07f00-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/fbed5ba0-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/fd145f9c-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/fe27b8e7-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/ff3df68a-ad6b-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/00582c7b-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/017430b7-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/02933c5c-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/03b38d92-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/04d424b5-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/05f6ef71-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/073351c5-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/085a1e58-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 spare-17 DEGRADED 0 0 0 15896693473823712310 OFFLINE 6 0 0 was /dev/gptid/09851bce-ad6c-11e9-b966-bc305bf2c008 gptid/0c373339-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 gptid/0aaf7b5f-ad6c-11e9-b966-bc305bf2c008 ONLINE 0 0 0 spares 10396465602319241838 INUSE was /dev/gptid/0c373339-ad6c-11e9-b966-bc305bf2c008 errors: No known data errors
I run the drives script but it don't come back with serials:
Code:
+--------+--------------------------------------------+-----------------+ | da3 | gptid/f7c2452d-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da4 | gptid/f8c8f66b-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da5 | gptid/f9d3e76e-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da6 | gptid/fae07f00-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da7 | gptid/fbed5ba0-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da8 | gptid/fd145f9c-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da9 | gptid/fe27b8e7-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da10 | gptid/ff3df68a-ad6b-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da11 | gptid/00582c7b-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da12 | gptid/017430b7-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da13 | gptid/02933c5c-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da14 | gptid/03b38d92-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da15 | gptid/04d424b5-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da16 | gptid/05f6ef71-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da17 | gptid/073351c5-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da18 | gptid/085a1e58-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da19 | gptid/09851bce-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da20 | gptid/0aaf7b5f-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+ | da21 | gptid/0c373339-ad6c-11e9-b966-bc305bf2c008 | | +--------+--------------------------------------------+-----------------+
When I open my web browser, I hit zpool status, then click edit on da19, and i get 19042910240381 as the serial number. Don't know if that is the actual serial number. Just making sure. If I replace this serial number, that would work. Since i don't konw what serial is in what bay, my only option is to do a 3am shutdown remove each drive, record what serial number goes into what bay, then find that serial number and replace it? Any other options? Note this is a RAIDZ3 system, i thought i had at least one on-line spare, but my assumption is that i can not pull the drive i think it is, and then expect the zraid to keep working? If its not that drive, how long do i have to wait till i pull the next one? Just wondering.