zpool replacing for the same Hard Disk

Status
Not open for further replies.
N

negozio

Cadet
Joined
Jun 11, 2012
Messages
7
Hello,

The my pool is degraded, the harddisk da2 is off line, then i check with the camcontrol and the smart said is OK with da2.
I send the command replace:

zpool MEDIA replace /dev/gptid/cf497248-e182-11e1-be7b-001b21bb40b9 da2

OK the system make the resilver and the da2 is online, but the my pool can´t detach the "old" drive, and stay in offline and my pool is degraded, but the da2 is online and ok.

I know that i need erase the one file corrupt listed bellow and resilver again, but i can´t put off the "old" device of my pool.

Follow bellow my pool status for help-me to resolv this problem.

My pool have a two "steps" of 5 hard drives in one pool MEDIA
da4 is a SSD for cache.

Thanks for yours attention.

Regards

Alessandro

[root@NAZ] ~# zpool status -v
pool: MEDIA
state: DEGRADED
status: One or more devices has experienced an error resulting in data
corruption. Applications may be affected.
action: Restore the file in question if possible. Otherwise restore the
entire pool from backup.
see: http://www.sun.com/msg/ZFS-8000-8A
scan: resilvered 1.40T in 9h25m with 3 errors on Sat Mar 9 02:00:14 2013
config:

NAME STATE READ WRITE CKSUM
MEDIA DEGRADED 0 0 3
raidz1-0 DEGRADED 0 0 6
gptid/be973ed6-e182-11e1-be7b-001b21bb40b9 ONLINE 0 0 0
gptid/188cdb13-34ce-11e2-8330-1078d205723e ONLINE 0 0 0
6485236485708290913 OFFLINE 5 5.32M 1 was /dev/gptid/cf497248-e182-11e1-be7b-001b21bb40b9
replacing-3 ONLINE 0 0 0
gptid/cff686cd-e182-11e1-be7b-001b21bb40b9 ONLINE 0 0 0
da2 ONLINE 0 0 0
gptid/d0811f19-e182-11e1-be7b-001b21bb40b9 ONLINE 0 0 0
raidz1-1 ONLINE 0 0 0
gptid/f8b57a37-2d1b-11e2-bb42-1078d205723e ONLINE 0 0 0
gptid/f903282b-2d1b-11e2-bb42-1078d205723e ONLINE 0 0 0
gptid/f990c060-2d1b-11e2-bb42-1078d205723e ONLINE 0 0 0
gptid/fa2eaf0f-2d1b-11e2-bb42-1078d205723e ONLINE 0 0 0
gptid/facf329f-2d1b-11e2-bb42-1078d205723e ONLINE 0 0 0
cache
ada4 ONLINE 0 0 0

errors: Permanent errors have been detected in the following files:

/mnt/MEDIA/SERVER/ANDAMENTO_NUATO11/_ABASTECEDOR/FEVEREIRO/1º_CICLO_FEVEREIRO/FUSOES/PB/Frios_PB.psd
[root@NAZ] ~# zpool detach MEDIA 6485236485708290913
cannot detach 6485236485708290913: only applicable to mirror and replacing vdevs
[root@NAZ] ~# zpool detach MEDIA /dev/gptid/cff686cd-e182-11e1-be7b-001b21bb40b9
cannot detach /dev/gptid/cff686cd-e182-11e1-be7b-001b21bb40b9: no valid replicas
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
You forgot the FreeNAS version you are using.

negozio said:
Follow bellow my pool status for help-me to resolv this problem.
Click to expand...
Too hard to read. Use [code][/code] tags. From an SSH session as root output of the following:
Code:
zpool status -v

camcontrol devlist

glabel status

gpart show
 
N

negozio

Cadet
Joined
Jun 11, 2012
Messages
7
paleoN said:
You forgot the FreeNAS version you are using.

Too hard to read. Use [code][/code] tags. From an SSH session as root output of the following:
Code:
zpool status -v

camcontrol devlist

glabel status

gpart show
Click to expand...

Code:

pool: MEDIA
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
	corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
	entire pool from backup.
   see: http://www.sun.com/msg/ZFS-8000-8A
  scan: resilvered 1.40T in 9h25m with 3 errors on Sat Mar  9 02:00:14 2013
config:

	NAME                                              STATE     READ WRITE CKSUM
	MEDIA                                             DEGRADED     0     0     3
	  raidz1-0                                        DEGRADED     0     0     6
	    gptid/be973ed6-e182-11e1-be7b-001b21bb40b9    ONLINE       0     0     0
	    gptid/188cdb13-34ce-11e2-8330-1078d205723e    ONLINE       0     0     0
	    6485236485708290913                           OFFLINE      5 5.32M     1  was /dev/gptid/cf497248-e182-11e1-be7b-001b21bb40b9
	    replacing-3                                   ONLINE       0     0     0
	      gptid/cff686cd-e182-11e1-be7b-001b21bb40b9  ONLINE       0     0     0
	      da2                                         ONLINE       0     0     0
	    gptid/d0811f19-e182-11e1-be7b-001b21bb40b9    ONLINE       0     0     0
	  raidz1-1                                        ONLINE       0     0     0
	    gptid/f8b57a37-2d1b-11e2-bb42-1078d205723e    ONLINE       0     0     0
	    gptid/f903282b-2d1b-11e2-bb42-1078d205723e    ONLINE       0     0     0
	    gptid/f990c060-2d1b-11e2-bb42-1078d205723e    ONLINE       0     0     0
	    gptid/fa2eaf0f-2d1b-11e2-bb42-1078d205723e    ONLINE       0     0     0
	    gptid/facf329f-2d1b-11e2-bb42-1078d205723e    ONLINE       0     0     0
	cache
	  ada4                                            ONLINE       0     0     0

errors: Permanent errors have been detected in the following files:

        /mnt/MEDIA/SERVER/ANDAMENTO_NUATO11/_ABASTECEDOR/FEVEREIRO/1º_CICLO_FEVEREIRO/FUSOES/PB/Frios_PB.psd

Code:
[root@NAZ] ~# camcontrol devlist
<ATA WDC WD30EZRX-00M 0A80>        at scbus0 target 2 lun 0 (pass0,da0)
<ATA ST3000DM001-9YN1 CC4B>        at scbus0 target 3 lun 0 (pass1,da1)
<ATA WDC WD30EZRX-00M 0A80>        at scbus0 target 4 lun 0 (pass2,da2)
<ATA WDC WD30EZRX-00M 0A80>        at scbus0 target 5 lun 0 (pass3,da3)
<ATA ST3000DM001-9YN1 CC4B>        at scbus0 target 6 lun 0 (pass4,da4)
<ATA ST3000DM001-9YN1 CC4B>        at scbus0 target 7 lun 0 (pass5,da5)
<ATA ST3000DM001-9YN1 CC4B>        at scbus0 target 8 lun 0 (pass6,da6)
<ATA ST3000DM001-9YN1 CC4B>        at scbus0 target 9 lun 0 (pass7,da7)
<Corsair Nova 2 SSD 5.02>          at scbus1 target 0 lun 0 (pass8,ada0)
<OCZ-AGILITY3 2.22>                at scbus2 target 0 lun 0 (pass9,ada1)
<Marvell 91xx Config 1.01>         at scbus8 target 0 lun 0 (pass10)
<ST3000DM001-1CH166 CC43>          at scbus9 target 0 lun 0 (pass11,ada2)
<ST3000DM001-1CH166 CC43>          at scbus10 target 0 lun 0 (pass12,ada3)
<OCZ-AGILITY3 2.22>                at scbus13 target 0 lun 0 (pass13,ada4)

Code:

[root@NAZ] ~# glabel status
                                      Name  Status  Components
                             ufs/FreeNASs3     N/A  ada0s3
                             ufs/FreeNASs4     N/A  ada0s4
                                  ufs/CNID     N/A  ada1p2
gptid/f8b57a37-2d1b-11e2-bb42-1078d205723e     N/A  ada2p2
gptid/f903282b-2d1b-11e2-bb42-1078d205723e     N/A  ada3p2
                            ufs/FreeNASs1a     N/A  ada0s1a
gptid/be973ed6-e182-11e1-be7b-001b21bb40b9     N/A  da0p2
gptid/188cdb13-34ce-11e2-8330-1078d205723e     N/A  da1p2
gptid/cff686cd-e182-11e1-be7b-001b21bb40b9     N/A  da3p2
gptid/d0811f19-e182-11e1-be7b-001b21bb40b9     N/A  da4p2
gptid/f990c060-2d1b-11e2-bb42-1078d205723e     N/A  da5p2
gptid/fa2eaf0f-2d1b-11e2-bb42-1078d205723e     N/A  da6p2
gptid/facf329f-2d1b-11e2-bb42-1078d205723e     N/A  da7p2

Code:
[root@NAZ] ~# gpart show
=>      63  58626225  ada0  MBR  (28G)
        63   1930257     1  freebsd  [active]  (942M)
   1930320        63        - free -  (31k)
   1930383   1930257     2  freebsd  (942M)
   3860640      3024     3  freebsd  (1.5M)
   3863664     41328     4  freebsd  (20M)
   3904992  54721296        - free -  (26G)

=>       34  468862061  ada1  GPT  (223G)
         34         94        - free -  (47k)
        128    4194304     1  freebsd-swap  (2.0G)
    4194432  464667663     2  freebsd-ufs  (221G)

=>        34  5860533101  ada2  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)

=>        34  5860533101  ada3  GPT  (2.7T)
          34          94        - free -  (47k)
         128     4194304     1  freebsd-swap  (2.0G)
     4194432  5856338696     2  freebsd-zfs  (2.7T)
  5860533128           7        - free -  (3.5k)

=>      0  1930257  ada0s1  BSD  (942M)
        0       16          - free -  (8.0k)
       16  1930241       1  !0  (942M)

=>        34  5860533101  da0  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338703    2  freebsd-zfs  (2.7T)

=>        34  5860533101  da1  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338696    2  freebsd-zfs  (2.7T)
  5860533128           7       - free -  (3.5k)

=>        34  5860533101  da3  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338703    2  freebsd-zfs  (2.7T)

=>        34  5860533101  da4  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338703    2  freebsd-zfs  (2.7T)

=>        34  5860533101  da5  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338696    2  freebsd-zfs  (2.7T)
  5860533128           7       - free -  (3.5k)

=>        34  5860533101  da6  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338696    2  freebsd-zfs  (2.7T)
  5860533128           7       - free -  (3.5k)

=>        34  5860533101  da7  GPT  (2.7T)
          34          94       - free -  (47k)
         128     4194304    1  freebsd-swap  (2.0G)
     4194432  5856338696    2  freebsd-zfs  (2.7T)
  5860533128           7       - free -  (3.5k)


the SSD's one is read cache, and other is a cnid acelerator for fast search in the Nas via AFP

TKS
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
paleoN said:
You forgot the FreeNAS version you are using.
Click to expand...
Code:
cat /etc/version


negozio said:
zpool MEDIA replace /dev/gptid/cf497248-e182-11e1-be7b-001b21bb40b9 da2
Click to expand...
No, looks like you ran:
Code:
zpool replace MEDIA gptid/cff686cd-e182-11e1-be7b-001b21bb40b9 da2
Which is da3 and not the old offlined da2.

Try running:
Code:
zpool detach MEDIA da2
If that works then do the replace from the GUI.

And tell me what damned version you are running. It matters.
 
N

negozio

Cadet
Joined
Jun 11, 2012
Messages
7
Freenas 8.3

paleoN said:
Code:
cat /etc/version


No, looks like you ran:
Code:
zpool replace MEDIA gptid/cff686cd-e182-11e1-be7b-001b21bb40b9 da2
Which is da3 and not the old offlined da2.

Try running:
Code:
zpool detach MEDIA da2
If that works then do the replace from the GUI.

And tell me what damned version you are running. It matters.
Click to expand...
 
S

Scotchie

Cadet
Joined
Oct 25, 2013
Messages
1
Guys, I was in similar situation and this post helped me sort it out. Thanks alot.
 
Status
Not open for further replies.

Similar threads

E
  • Locked
How could I rename a disk partition?
Replies
5
Views
1K
cyberjock
C
Z
  • Locked
Upgraded drives - Error when trying to get volume to expand
Replies
4
Views
2K
zfrogz
Z
S
  • Locked
Yet another person with drive replacement issues (ZPOOL DEGRADED)
Replies
5
Views
6K
dmt0
D
A
  • Locked
ZFS: replaced faulty drive but now doesn't have GPTID label anymore :(
Replies
1
Views
2K
anudureio
A
O
  • Locked
[FreeNAS 8.2] Replacing a dead drive in zfs
Replies
10
Views
5K
paleoN
paleoN
Top