WARNING: The volume share (ZFS) status is ONLINE

Status
Not open for further replies.
G

GaryD

Cadet
Joined
Jun 5, 2014
Messages
8
Hi Guys,

I am getting this worrying message on the web interface:

Code:
WARNING: The volume share (ZFS) status is ONLINE: One or more devices has experienced an error resulting in data corruption. Applications may be affected.Restore the file in question if possible. Otherwise restore the entire pool from backup.


So after doing some reading, I now know that ECC RAM is the go. Of course I am not using it. I did run a memtest86 which has picked up an error. So obviously that's problem #1.

I've also seen threads with some of these logs being asked for, which show the errors. Hopefully someone can tell me whether the drives (to me it looks like 1-3 are looking sad) are also failing. Or is it possible the RAM has caused the issue?

Code:
BuildFreeNAS-9.2.1.5-RELEASE-x64 (80c1d35)
PlatformAMD Athlon(tm) II Neo N36L Dual-Core Processor
Memory8042MB


Code:
[root@freenas] ~# zpool status -v
  pool: share
state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 0 in 1h40m with 0 errors on Sun Jan  4 01:40:13 2015
config:

        NAME        STATE     READ WRITE CKSUM
        share       ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada0    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada1    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada2    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada3    ONLINE       0     0     0  block size: 512B configured, 4096B native

errors: Permanent errors have been detected in the following files:

        share:<0x32105>
        share:<0x32065>
        share:<0x32674>
        share:<0x31aa0>


Code:
smartctl -A /dev/ada0
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   113   099   006    Pre-fail  Always       -       58357280
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       123
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       133506130
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30378
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       75
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   098   098   000    Old_age   Always       -       2
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   065   057   045    Old_age   Always       -       35 (Min/Max 35/35)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       71
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       123
194 Temperature_Celsius     0x0022   035   043   000    Old_age   Always       -       35 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   032   004   000    Old_age   Always       -       58357280
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       166541651900070
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       963198413
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       1141125844

smartctl -A /dev/ada1
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   110   099   006    Pre-fail  Always       -       25968728
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       126
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       134787368
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30381
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   098   098   000    Old_age   Always       -       2
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   064   056   045    Old_age   Always       -       36 (Min/Max 36/36)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       126
194 Temperature_Celsius     0x0022   036   044   000    Old_age   Always       -       36 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   029   003   000    Old_age   Always       -       25968728
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       267950124725927
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1669123584
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3996331526


[root@freenas] ~# smartctl -A /dev/ada2
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   112   099   006    Pre-fail  Always       -       49030984
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       124
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       139728706
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30390
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   043   043   000    Old_age   Always       -       57
190 Airflow_Temperature_Cel 0x0022   064   056   045    Old_age   Always       -       36 (Min/Max 36/36)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       124
194 Temperature_Celsius     0x0022   036   044   000    Old_age   Always       -       36 (0 15 0 0 0)
195 Hardware_ECC_Recovered  0x001a   029   003   000    Old_age   Always       -       49030984
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       136631499650726
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       4051910982
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3781539549

[root@freenas] ~# smartctl -A /dev/ada3
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   105   094   006    Pre-fail  Always       -       8037400
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       125
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   082   060   030    Pre-fail  Always       -       4470748573
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30379
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   068   068   000    Old_age   Always       -       32
188 Command_Timeout         0x0032   100   098   000    Old_age   Always       -       4
189 High_Fly_Writes         0x003a   096   096   000    Old_age   Always       -       4
190 Airflow_Temperature_Cel 0x0022   065   057   045    Old_age   Always       -       35 (Min/Max 35/35)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       125
194 Temperature_Celsius     0x0022   035   043   000    Old_age   Always       -       35 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   024   003   000    Old_age   Always       -       8037400
197 Current_Pending_Sector  0x0012   100   099   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   099   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       179379309147814
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1552996618
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3815809396


The good news is, this NAS contains nothing important.

Thanks for your help, feel free to insult me and have a laugh at my expense ;)

Cheers
Gary
 
camilo suarez

camilo suarez

Explorer
Joined
Feb 28, 2014
Messages
86
i got this error too after the reboot of the last update posted on the stable train! the nas appears to be working perfect.
 
danb35

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
You've got metadata corruption, you've got bad RAM, and three of your four hard drives are showing bad sectors. What's suspicious to me is that ada1-ada3 are showing exactly the same number of bad sectors. This is looking very bad. Fortunately, as you say, there's no important data on the NAS.
 
camilo suarez

camilo suarez

Explorer
Joined
Feb 28, 2014
Messages
86
mine is showing this:

Code:
pool: freenas-boot                                                           
state: ONLINE                                                                 
status: One or more devices has experienced an error resulting in data         
        corruption.  Applications may be affected.                             
action: Restore the file in question if possible.  Otherwise restore the       
        entire pool from backup.                                               
   see: http://illumos.org/msg/ZFS-8000-8A                                     
  scan: scrub repaired 0 in 0h0m with 1 errors on Thu Feb  5 08:26:23 2015     
config:                                                                        
                                                                               
        NAME        STATE     READ WRITE CKSUM                                 
        freenas-boot  ONLINE       0     0     1                               
          da0p2     ONLINE       0     0     2                                 
                                                                               
errors: Permanent errors have been detected in the following files:            
                                                                               
        freenas-boot/ROOT/FreeNAS-9.3-STABLE-201502050159@2015-02-04-17:58:07:/u
sr/local/www/dojo/dojox/mobile/themes/holodark/holodark.css
 

Attachments

  • boot.PNG
    boot.PNG
    19.8 KB · Views: 248
danb35

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Sorry, my last was to @GaryD, not to you. You've got a borked boot device. Get a new one (or two to use a mirror), do a clean install, and upload your config database.
 
camilo suarez

camilo suarez

Explorer
Joined
Feb 28, 2014
Messages
86
thanks danb, what happens if i activate the other volume, delete the corrupted one and do the upgrade again?
 
Last edited:
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
GaryD said:
Hi Guys,

I am getting this worrying message on the web interface:

Code:
WARNING: The volume share (ZFS) status is ONLINE: One or more devices has experienced an error resulting in data corruption. Applications may be affected.Restore the file in question if possible. Otherwise restore the entire pool from backup.


So after doing some reading, I now know that ECC RAM is the go. Of course I am not using it. I did run a memtest86 which has picked up an error. So obviously that's problem #1.

I've also seen threads with some of these logs being asked for, which show the errors. Hopefully someone can tell me whether the drives (to me it looks like 1-3 are looking sad) are also failing. Or is it possible the RAM has caused the issue?

Code:
BuildFreeNAS-9.2.1.5-RELEASE-x64 (80c1d35)
PlatformAMD Athlon(tm) II Neo N36L Dual-Core Processor
Memory8042MB


Code:
[root@freenas] ~# zpool status -v
  pool: share
state: ONLINE
status: One or more devices has experienced an error resulting in data
        corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
        entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 0 in 1h40m with 0 errors on Sun Jan  4 01:40:13 2015
config:

        NAME        STATE     READ WRITE CKSUM
        share       ONLINE       0     0     0
          raidz1-0  ONLINE       0     0     0
            ada0    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada1    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada2    ONLINE       0     0     0  block size: 512B configured, 4096B native
            ada3    ONLINE       0     0     0  block size: 512B configured, 4096B native

errors: Permanent errors have been detected in the following files:

        share:<0x32105>
        share:<0x32065>
        share:<0x32674>
        share:<0x31aa0>


Code:
smartctl -A /dev/ada0
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   113   099   006    Pre-fail  Always       -       58357280
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       123
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       133506130
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30378
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       75
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   098   098   000    Old_age   Always       -       2
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   065   057   045    Old_age   Always       -       35 (Min/Max 35/35)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       71
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       123
194 Temperature_Celsius     0x0022   035   043   000    Old_age   Always       -       35 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   032   004   000    Old_age   Always       -       58357280
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       166541651900070
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       963198413
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       1141125844

smartctl -A /dev/ada1
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   110   099   006    Pre-fail  Always       -       25968728
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       126
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       134787368
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30381
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   098   098   000    Old_age   Always       -       2
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   064   056   045    Old_age   Always       -       36 (Min/Max 36/36)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       126
194 Temperature_Celsius     0x0022   036   044   000    Old_age   Always       -       36 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   029   003   000    Old_age   Always       -       25968728
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       267950124725927
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1669123584
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3996331526


[root@freenas] ~# smartctl -A /dev/ada2
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   112   099   006    Pre-fail  Always       -       49030984
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       124
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   081   060   030    Pre-fail  Always       -       139728706
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30390
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   100   000    Old_age   Always       -       0
189 High_Fly_Writes         0x003a   043   043   000    Old_age   Always       -       57
190 Airflow_Temperature_Cel 0x0022   064   056   045    Old_age   Always       -       36 (Min/Max 36/36)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       124
194 Temperature_Celsius     0x0022   036   044   000    Old_age   Always       -       36 (0 15 0 0 0)
195 Hardware_ECC_Recovered  0x001a   029   003   000    Old_age   Always       -       49030984
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       136631499650726
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       4051910982
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3781539549

[root@freenas] ~# smartctl -A /dev/ada3
smartctl 6.2 2013-07-26 r3841 [FreeBSD 9.2-RELEASE-p4 amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF READ SMART DATA SECTION ===
SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   105   094   006    Pre-fail  Always       -       8037400
  3 Spin_Up_Time            0x0003   094   093   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       125
  5 Reallocated_Sector_Ct   0x0033   100   100   036    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x000f   082   060   030    Pre-fail  Always       -       4470748573
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       30379
10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       79
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   068   068   000    Old_age   Always       -       32
188 Command_Timeout         0x0032   100   098   000    Old_age   Always       -       4
189 High_Fly_Writes         0x003a   096   096   000    Old_age   Always       -       4
190 Airflow_Temperature_Cel 0x0022   065   057   045    Old_age   Always       -       35 (Min/Max 35/35)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       75
193 Load_Cycle_Count        0x0032   100   100   000    Old_age   Always       -       125
194 Temperature_Celsius     0x0022   035   043   000    Old_age   Always       -       35 (0 14 0 0 0)
195 Hardware_ECC_Recovered  0x001a   024   003   000    Old_age   Always       -       8037400
197 Current_Pending_Sector  0x0012   100   099   000    Old_age   Always       -       16
198 Offline_Uncorrectable   0x0010   100   099   000    Old_age   Offline      -       16
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       179379309147814
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       1552996618
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       3815809396


The good news is, this NAS contains nothing important.

Thanks for your help, feel free to insult me and have a laugh at my expense ;)

Cheers
Gary
Click to expand...

Exposed your server to a focused gamma ray source directed at three of the drives and system RAM lately?
If not, my money's on a bad PSU.

Those hardware ECC recovered counts are astronomical. I'm fairly certain they should be 0 or close to 0 on Seagate drives.
 
G

GaryD

Cadet
Joined
Jun 5, 2014
Messages
8
Thanks guys you confirmed my suspicions. I'll replace the RAM and HDD's and create a new pool. I am currently backing up the data - as I can still read perfectly fine.

We did have a really close lightning strike recently, I wonder if that could have caused the issue.

Thanks for the help!
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
GaryD said:
Thanks guys you confirmed my suspicions. I'll replace the RAM and HDD's and create a new pool. I am currently backing up the data - as I can still read perfectly fine.

We did have a really close lightning strike recently, I wonder if that could have caused the issue.

Thanks for the help!
Click to expand...

Could be.
 
Status
Not open for further replies.

Similar threads

F
SMART Results help
Replies
6
Views
2K
sretalla
sretalla
P
  • Locked
View Previous SMART test results
Replies
11
Views
15K
Bidule0hm
Bidule0hm
mattlach
  • Locked
Scary SMART Values on New Seagate Enterprise Drives?
Replies
14
Views
6K
rs225
R
O
Pool degraded, no SMART errors
Replies
17
Views
2K
Odub
O
angelus249
  • Locked
Uncertain about SMART value "Seek_Error_Rate"
Replies
3
Views
7K
Magius
M
Top