high checksum errors

Status
Not open for further replies.

davidkierz

Cadet
Joined
Dec 10, 2013
Messages
3
i am getting high checksum errors on my pool.
these numbers are 24 hours after i zeroed everything out with a zpool clear and did a scrub.


Code:
  pool: WDRED
state: ONLINE
status: One or more devices has experienced an unrecoverable error.  An
        attempt was made to correct the error.  Applications are unaffected.
action: Determine if the device needs to be replaced, and clear the errors
        using 'zpool clear' or replace the device with 'zpool replace'.
  see: http://illumos.org/msg/ZFS-8000-9P
  scan: scrub repaired 15.1G in 25h37m with 0 errors on Thu Mar 20 13:20:36 2014
config:
 
        NAME                                            STATE    READ WRITE CKSUM
        WDRED                                          ONLINE      0    0    0
          raidz1-0                                      ONLINE      0    0    0
            gptid/35cd37b2-61ea-11e3-9443-8c89a51936b2  ONLINE      0    0  121K
            gptid/3658a56c-61ea-11e3-9443-8c89a51936b2  ONLINE      0    0  238K
            gptid/3734b175-61ea-11e3-9443-8c89a51936b2  ONLINE      0    0    0


my smartctl shows no errors, normal temps.
I am exporting a snapshot of my data before i power down and check connections etc
its a 6 core AMD Phenom(tm) II X6 1055T with 16 gigs of non ecc memory
I am wondering if there is really a hardware error?
Suggestions on what to do?
 

Yatti420

Wizard
Joined
Aug 12, 2012
Messages
1,437
Run a ram test.. Something is very wrong.. Can you post all specs.. "smartctl -a -q no serial /dev/ada#" for all smart attributes.. What motherboard etc? Thanks,
 

davidkierz

Cadet
Joined
Dec 10, 2013
Messages
3
this is the mobo
http://us.msi.com/product/mb/890FXAGD70.html

heres are the smart statistics

will do a memcheck86 as soon as the dump is done

Code:
[root@DKFREENAS01P] ~# smartctl -a -q noserial /dev/ada0
smartctl 6.1 2013-03-16 r3800 [FreeBSD 9.1-STABLE amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org
 
=== START OF INFORMATION SECTION ===
Model Family:     Western Digital Red (AF)
Device Model:     WDC WD30EFRX-68EUZN0
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu Mar 20 17:25:56 2014 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
 
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
 
General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 241) Self-test routine in progress...
                                        10% of test remaining.
Total time to complete Offline
data collection:                (42480) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   2) minutes.
Extended self-test routine
recommended polling time:        ( 426) minutes.
Conveyance self-test routine
recommended polling time:        (   5) minutes.
SCT capabilities:              (0x703d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.
 
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   215   178   021    Pre-fail  Always       -       4233
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       45
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   098   098   000    Old_age   Always       -       2179
 10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
 11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       45
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       38
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       6
194 Temperature_Celsius     0x0022   125   108   000    Old_age   Always       -       25
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   100   253   000    Old_age   Offline      -       0
 
SMART Error Log Version: 1
No Errors Logged
 
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      2137         -
# 2  Short offline       Completed without error       00%      2125         -
# 3  Short offline       Completed without error       00%      2113         -
# 4  Short offline       Completed without error       00%      2101         -
# 5  Short offline       Completed without error       00%      2089         -
# 6  Short offline       Completed without error       00%      2077         -
# 7  Short offline       Completed without error       00%      2065         -
# 8  Short offline       Completed without error       00%      2053         -
# 9  Short offline       Completed without error       00%      2041         -
#10  Short offline       Completed without error       00%      2029         -
#11  Short offline       Completed without error       00%      2018         -
#12  Short offline       Completed without error       00%      2006         -
#13  Short offline       Completed without error       00%      1994         -
#14  Short offline       Completed without error       00%      1982         -
#15  Short offline       Completed without error       00%      1970         -
#16  Short offline       Completed without error       00%      1958         -
#17  Short offline       Completed without error       00%      1946         -
#18  Short offline       Completed without error       00%      1934         -
#19  Short offline       Completed without error       00%      1922         -
#20  Short offline       Completed without error       00%      1910         -
#21  Short offline       Completed without error       00%      1899         -
 
SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


Code:
[root@DKFREENAS01P] ~# smartctl -a -q noserial /dev/ada1
smartctl 6.1 2013-03-16 r3800 [FreeBSD 9.1-STABLE amd64] (local build)
Copyright (C) 2002-13, Bruce Allen, Christian Franke, www.smartmontools.org
 
=== START OF INFORMATION SECTION ===
Model Family:    Western Digital Red (AF)
Device Model:    WDC WD30EFRX-68EUZN0
Firmware Version: 80.00A80
User Capacity:    3,000,592,982,016 bytes [3.00 TB]
Sector Sizes:    512 bytes logical, 4096 bytes physical
Rotation Rate:    5400 rpm
Device is:        In smartctl database [for details use: -P show]
ATA Version is:  ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Thu Mar 20 17:26:58 2014 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
 
=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
 
General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 241) Self-test routine in progress...
                                        10% of test remaining.
Total time to complete Offline
data collection:                (40380) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (  2) minutes.
Extended self-test routine
recommended polling time:        ( 405) minutes.
Conveyance self-test routine
recommended polling time:        (  5) minutes.
SCT capabilities:              (0x703d) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.
 
SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG    VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate    0x002f  200  200  051    Pre-fail  Always      -      0
  3 Spin_Up_Time            0x0027  215  178  021    Pre-fail  Always      -      4241
  4 Start_Stop_Count        0x0032  100  100  000    Old_age  Always      -      48
  5 Reallocated_Sector_Ct  0x0033  200  200  140    Pre-fail  Always      -      0
  7 Seek_Error_Rate        0x002e  200  200  000    Old_age  Always      -      0
  9 Power_On_Hours          0x0032  098  098  000    Old_age  Always      -      2178
10 Spin_Retry_Count        0x0032  100  253  000    Old_age  Always      -      0
11 Calibration_Retry_Count 0x0032  100  253  000    Old_age  Always      -      0
12 Power_Cycle_Count      0x0032  100  100  000    Old_age  Always      -      48
192 Power-Off_Retract_Count 0x0032  200  200  000    Old_age  Always      -      41
193 Load_Cycle_Count        0x0032  200  200  000    Old_age  Always      -      6
194 Temperature_Celsius    0x0022  125  109  000    Old_age  Always      -      25
196 Reallocated_Event_Count 0x0032  200  200  000    Old_age  Always      -      0
197 Current_Pending_Sector  0x0032  200  200  000    Old_age  Always      -      0
198 Offline_Uncorrectable  0x0030  100  253  000    Old_age  Offline      -      0
199 UDMA_CRC_Error_Count    0x0032  200  200  000    Old_age  Always      -      0
200 Multi_Zone_Error_Rate  0x0008  100  253  000    Old_age  Offline      -      0
 
SMART Error Log Version: 1
No Errors Logged
 
SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline      Completed without error      00%      2148        -
# 2  Short offline      Completed without error      00%      2137        -
# 3  Short offline      Completed without error      00%      2125        -
# 4  Short offline      Completed without error      00%      2113        -
# 5  Short offline      Completed without error      00%      2101        -
# 6  Short offline      Completed without error      00%      2089        -
# 7  Short offline      Completed without error      00%      2077        -
# 8  Short offline      Completed without error      00%      2065        -
# 9  Short offline      Completed without error      00%      2053        -
#10  Short offline      Completed without error      00%      2041        -
#11  Short offline      Completed without error      00%      2029        -
#12  Short offline      Completed without error      00%      2017        -
#13  Short offline      Completed without error      00%      2005        -
#14  Short offline      Completed without error      00%      1993        -
#15  Short offline      Completed without error      00%      1981        -
#16  Short offline      Completed without error      00%      1969        -
#17  Short offline      Completed without error      00%      1957        -
#18  Short offline      Completed without error      00%      1945        -
#19  Short offline      Completed without error      00%      1933        -
#20  Short offline      Completed without error      00%      1921        -
#21  Short offline      Completed without error      00%      1909        -
 
SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
 
[root@DKFREENAS01P] ~#
 
Status
Not open for further replies.
Top