One or more devices has experienced an unrecoverable error.

[goma78]

Hi, I have the next errors in my NAS.

Nov 6 10:02:25 freenas smartd[2641]: Device: /dev/ada0, FAILED SMART self-check. BACK UP DATA NOW!
Nov 6 10:02:25 freenas smartd[2641]: Device: /dev/ada0, 624 Currently unreadable (pending) sectors
Nov 6 10:02:25 freenas smartd[2641]: Device: /dev/ada0, Failed SMART usage Attribute: 1 Raw_Read_Error_Rate.
Nov 6 10:02:25 freenas smartd[2641]: Device: /dev/ada1, 65533 Currently unreadable (pending) sectors
Nov 6 10:02:25 freenas smartd[2641]: Device: /dev/ada1, 6 Offline uncorrectable sectors

Please, I need your help.

What should I do? 2 disk are bad? The RAID is made with 4 new disks. What test should I do? Is there a guide?

Thank you.

 

[Ericloewe]

Oh, brilliant, two failing drives.

First of all backup everything that needs backing up.

Second, give us the output of zpool status and of smartctl -a /dev/ada0 (repeat this for all drives, so ada1, ada2...). Please use pastebin.

 

[goma78]

Ericloewe thank you for your fast answer,

Here you have you have asked:

zpool status: http://pastebin.com/CeMkDbr6
smartctl -a /dev/ada0: http://pastebin.com/UM9MnyLp
smartctl -a /dev/ada1: http://pastebin.com/n2Vr5BvD
smartctl -a /dev/ada2: http://pastebin.com/aFtz32yF
smartctl -a /dev/ada3http://pastebin.com/77NcHy4z:

I'm new here, hope I'm doing fine with pastebin.

 

[enemy85]

For whay i can see ada0 is to change asap, ada1 has lot of pending sectors (but i'm not sure how bad is that). The problem is that i have a raidz1 setup so in case of both drive failing u are screwed. I'll start backing up ur that and than changing ada0 first

 

[goma78]

Is there a guide of how to change the drive? Shutdown, change hdd and boot? or I have to do configuration?

 

[Ericloewe]

Is there a guide of how to change the drive? Shutdown, change hdd and boot? or I have to do configuration?

It's in the FreeNAS manual.

 

[sremick]

Do you have notifications on and both drives simultaneously failed? Or did you not poke around and check until now and happened to notice you now have 2 drives failing?

 

[goma78]

Scremick, the second, I don't know if they start simultaneosly.

I have changed the ada0. And know I have every 30 minutes the next error:

Nov 11 08:30:27 freenas smartd[2472]: Device: /dev/ada1, 65529 Currently unreadable (pending) sectors
Nov 11 08:30:27 freenas smartd[2472]: Device: /dev/ada1, 4 Offline uncorrectable sectors

Do I have to change the ada1 too? Or I can fix that errors.

 

[enemy85]

well, i guess it will be better to change that too for more reliability of the whole system, but wait for someone else more expert than me to answer that question...

 

[Ericloewe]

ada1 is also failing.

30 minutes is the default SMART query period, so the drive is basically constantly worsening.

 

[enemy85]

@Ericloewe what about the case of a disk that has just few Currently unreadable (pending) sectors? would it be "wise" keep it till that number starts to increase?

 

[Ericloewe]

@Ericloewe what about the case of a disk that has just few Currently unreadable (pending) sectors? would it be "wise" keep it till that number starts to increase?

It's a matter of feeling. Some tolerate no bad sectors and replace. I tolerate "a few" (less than 5 at most).

Considering they're pending, the drive's in particularly bad shape, so I'd replace.

 

[cyberjock]

That drive is trashed. Most drives are limited to 65k (give or take a little) for pending sectors. You've maxed out that list most likely. So this isn't a drive with a few bad sectors. This is rampant failure across the drive and needs to be dumped like a hot potato.