Help with Smartctl Reading

BritshGOAT

Cadet
Joined
Mar 4, 2022
Messages
2
Hi, I've started rebuilding my NAS, creating from a fresh start using previous drives. before I start filling my pool up, I checked every drives S.M.A.R.T

When running a LONG test 2 of my drives
give me the following alert
Code:
Device: /dev/sdd [SAT], Self-Test Log error count increased from 3 to 4.
Device: /dev/sdd [SAT], Self-Test Log error count increased from 3 to 4.


Looking at the smartctl output I can't tell if they are dying or not, as it shows the smart test passed. I think ./sda is dying as its has values in LBA_of_first_error column but this is only a guess? as my pool will be a single raidz2 vdev, should I change these out before starting to use my NAS again or just upgrade 1?


Code:
=== START OF INFORMATION SECTION ===
Model Family:     Seagate IronWolf Pro
Device Model:     ST10000NE0008-2JM101
Serial Number:    ZHZ3P5X0
LU WWN Device Id: 5 000c50 0c2bc47e0
Firmware Version: EN01
User Capacity:    10,000,831,348,736 bytes [10.0 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    7200 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-4 (minor revision not indicated)
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Oct 31 05:29:43 2023 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
                                        was completed without error.
                                        Auto Offline Data Collection: Enabled.
Self-test execution status:      ( 249) Self-test routine in progress...
                                        90% of test remaining.
Total time to complete Offline
data collection:                (  567) seconds.
Offline data collection
capabilities:                    (0x7b) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 978) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x50bd) SCT Status supported.
                                        SCT Error Recovery Control supported.
                                        SCT Feature Control supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   083   064   044    Pre-fail  Always       -       195058177
  3 Spin_Up_Time            0x0003   092   090   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   100   100   020    Old_age   Always       -       167
  5 Reallocated_Sector_Ct   0x0033   100   100   010    Pre-fail  Always       -       96
  7 Seek_Error_Rate         0x000f   089   060   045    Pre-fail  Always       -       786170628
  9 Power_On_Hours          0x0032   077   077   000    Old_age   Always       -       20784
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       169
 18 Head_Health             0x000b   100   100   050    Pre-fail  Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
188 Command_Timeout         0x0032   100   099   000    Old_age   Always       -       1
190 Airflow_Temperature_Cel 0x0022   061   023   040    Old_age   Always   In_the_past 39 (48 120 39 32 0)
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       112
193 Load_Cycle_Count        0x0032   093   093   000    Old_age   Always       -       14203
194 Temperature_Celsius     0x0022   039   077   000    Old_age   Always       -       39 (0 13 0 0 0)
195 Hardware_ECC_Recovered  0x001a   083   064   000    Old_age   Always       -       195058177
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       8
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       8
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
200 Pressure_Limit          0x0023   100   100   001    Pre-fail  Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       19365h+54m+31.004s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       94449578193
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       498694099818

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Self-test routine in progress 90%     20784         -
# 2  Extended offline    Completed: read failure       90%     20784         -
# 3  Short offline       Completed: read failure       90%     20713         -
# 4  Short offline       Completed: read failure       90%     20600         -
# 5  Short offline       Completed: read failure       90%     20432         -
# 6  Extended offline    Completed without error       00%     20395         -
# 7  Short offline       Completed: read failure       90%     20313         -
# 8  Short offline       Completed: read failure       90%     20145         -
# 9  Short offline       Completed: read failure       90%     20000         -
#10  Short offline       Completed: read failure       90%     19832         -
#11  Extended offline    Completed without error       00%     19730         -
#12  Short offline       Completed without error       00%     19664         -
#13  Extended offline    Interrupted (host reset)      00%     18831         -
#14  Extended offline    Interrupted (host reset)      00%     18810         -
#15  Extended offline    Completed without error       00%     18796         -
#16  Extended offline    Completed without error       00%     18772         -
#17  Extended offline    Completed without error       00%     18748         -
#18  Extended offline    Completed without error       00%     18724         -
#19  Extended offline    Completed without error       00%     18690         -
#20  Extended offline    Completed: read failure       90%     18637         -
#21  Extended offline    Completed: read failure       90%     18613         -
6 of 10 failed self-tests are outdated by newer successful extended offline self-test # 6

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Code:
=== START OF INFORMATION SECTION ===
Model Family:     Seagate BarraCuda 3.5
Device Model:     ST8000DM004-2CX188
Serial Number:    WSC07XF1
LU WWN Device Id: 5 000c50 0d637dda3
Firmware Version: 0001
User Capacity:    8,001,563,222,016 bytes [8.00 TB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    5425 rpm
Form Factor:      3.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Oct 31 05:43:57 2023 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED
See vendor-specific Attribute list for marginal Attributes.

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
                                        was never started.
                                        Auto Offline Data Collection: Disabled.
Self-test execution status:      ( 121) The previous self-test completed having
                                        the read element of the test failed.
Total time to complete Offline
data collection:                (    0) seconds.
Offline data collection
capabilities:                    (0x73) SMART execute Offline immediate.
                                        Auto Offline data collection on/off support.
                                        Suspend Offline collection upon new
                                        command.
                                        No Offline surface scan supported.
                                        Self-test supported.
                                        Conveyance Self-test supported.
                                        Selective Self-test supported.
SMART capabilities:            (0x0003) Saves SMART data before entering
                                        power-saving mode.
                                        Supports SMART auto save timer.
Error logging capability:        (0x01) Error logging supported.
                                        General Purpose Logging supported.
Short self-test routine
recommended polling time:        (   1) minutes.
Extended self-test routine
recommended polling time:        ( 999) minutes.
Conveyance self-test routine
recommended polling time:        (   2) minutes.
SCT capabilities:              (0x30a5) SCT Status supported.
                                        SCT Data Table supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x000f   077   054   006    Pre-fail  Always       -       54799575
  3 Spin_Up_Time            0x0003   092   091   000    Pre-fail  Always       -       0
  4 Start_Stop_Count        0x0032   098   098   020    Old_age   Always       -       2253
  5 Reallocated_Sector_Ct   0x0033   098   098   010    Pre-fail  Always       -       4736
  7 Seek_Error_Rate         0x000f   095   060   045    Pre-fail  Always       -       2826869110
  9 Power_On_Hours          0x0032   081   081   000    Old_age   Always       -       16984 (68 15 0)
 10 Spin_Retry_Count        0x0013   100   100   097    Pre-fail  Always       -       0
 12 Power_Cycle_Count       0x0032   100   100   020    Old_age   Always       -       195
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   099    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   030   030   000    Old_age   Always       -       70
188 Command_Timeout         0x0032   100   098   000    Old_age   Always       -       6 6 14
189 High_Fly_Writes         0x003a   100   100   000    Old_age   Always       -       0
190 Airflow_Temperature_Cel 0x0022   064   027   040    Old_age   Always   In_the_past 36 (21 236 36 31 0)
191 G-Sense_Error_Rate      0x0032   100   100   000    Old_age   Always       -       0
192 Power-Off_Retract_Count 0x0032   100   100   000    Old_age   Always       -       674
193 Load_Cycle_Count        0x0032   099   099   000    Old_age   Always       -       2953
194 Temperature_Celsius     0x0022   036   073   000    Old_age   Always       -       36 (0 15 0 0 0)
195 Hardware_ECC_Recovered  0x001a   077   064   000    Old_age   Always       -       54799575
197 Current_Pending_Sector  0x0012   100   100   000    Old_age   Always       -       112
198 Offline_Uncorrectable   0x0010   100   100   000    Old_age   Offline      -       112
199 UDMA_CRC_Error_Count    0x003e   200   200   000    Old_age   Always       -       0
240 Head_Flying_Hours       0x0000   100   253   000    Old_age   Offline      -       15797h+36m+33.903s
241 Total_LBAs_Written      0x0000   100   253   000    Old_age   Offline      -       73043916656
242 Total_LBAs_Read         0x0000   100   253   000    Old_age   Offline      -       323584380662

SMART Error Log Version: 1
ATA Error Count: 70 (device log contains only the most recent five errors)
        CR = Command Register [HEX]
        FR = Features Register [HEX]
        SC = Sector Count Register [HEX]
        SN = Sector Number Register [HEX]
        CL = Cylinder Low Register [HEX]
        CH = Cylinder High Register [HEX]
        DH = Device/Head Register [HEX]
        DC = Device Command Register [HEX]
        ER = Error register [HEX]
        ST = Status register [HEX]
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 70 occurred at disk power-on lifetime: 16951 hours (706 days + 7 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00   3d+13:12:48.374  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:48.374  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:48.373  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:48.373  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:48.360  READ FPDMA QUEUED

Error 69 occurred at disk power-on lifetime: 16951 hours (706 days + 7 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 80 ff ff ff 4f 00   3d+13:12:47.762  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:47.762  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+13:12:47.762  READ FPDMA QUEUED
  60 00 90 ff ff ff 4f 00   3d+13:12:47.760  READ FPDMA QUEUED
  60 00 78 ff ff ff 4f 00   3d+13:12:47.759  READ FPDMA QUEUED

Error 68 occurred at disk power-on lifetime: 16946 hours (706 days + 2 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00   3d+08:46:02.688  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+08:46:02.678  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+08:46:02.678  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+08:46:02.677  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+08:46:02.676  READ FPDMA QUEUED

Error 67 occurred at disk power-on lifetime: 16946 hours (706 days + 2 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: UNC at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  60 00 00 ff ff ff 4f 00   3d+08:46:01.980  READ FPDMA QUEUED
  60 00 08 ff ff ff 4f 00   3d+08:46:01.974  READ FPDMA QUEUED
  60 00 08 ff ff ff 4f 00   3d+08:46:01.968  READ FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+08:46:01.963  READ FPDMA QUEUED
  60 00 08 ff ff ff 4f 00   3d+08:46:01.962  READ FPDMA QUEUED

Error 66 occurred at disk power-on lifetime: 16942 hours (705 days + 22 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER ST SC SN CL CH DH
  -- -- -- -- -- -- --
  40 51 00 ff ff ff 0f  Error: WP at LBA = 0x0fffffff = 268435455

  Commands leading to the command that caused the error were:
  CR FR SC SN CL CH DH DC   Powered_Up_Time  Command/Feature_Name
  -- -- -- -- -- -- -- --  ----------------  --------------------
  61 00 00 ff ff ff 4f 00   3d+04:42:49.107  WRITE FPDMA QUEUED
  61 00 00 ff ff ff 4f 00   3d+04:42:49.107  WRITE FPDMA QUEUED
  60 00 00 ff ff ff 4f 00   3d+04:42:49.104  READ FPDMA QUEUED
  60 00 08 ff ff ff 4f 00   3d+04:42:49.045  READ FPDMA QUEUED
  60 00 08 ff ff ff 4f 00   3d+04:42:49.041  READ FPDMA QUEUED

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed: read failure       90%     16984         -
# 2  Extended offline    Completed: read failure       90%     16984         -
# 3  Short offline       Completed without error       00%     16913         -
# 4  Short offline       Completed without error       00%     16758         -
# 5  Short offline       Completed: read failure       90%     16590         2806846328
# 6  Extended offline    Completed: read failure       90%     16518         2806846328
# 7  Short offline       Completed without error       00%     16472         -
# 8  Short offline       Completed: read failure       90%     16304         2806846328
# 9  Short offline       Completed without error       00%     16158         -
#10  Short offline       Completed: read failure       90%     15990         -
#11  Extended offline    Completed: read failure       90%     15870         -
#12  Short offline       Completed without error       00%     15824         -
#13  Short offline       Completed without error       00%     15656         -
#14  Short offline       Completed without error       00%     15641         -
#15  Extended offline    Interrupted (host reset)      00%     15640         -
#16  Short offline       Completed without error       00%     15582         -
#17  Short offline       Completed without error       00%     15409         -
#18  Short offline       Completed without error       00%     15160         -
#19  Short offline       Completed without error       00%     14992         -
#20  Short offline       Completed without error       00%     14824         -
#21  Extended offline    Interrupted (host reset)      90%     14783         -

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.
 

essinghigh

Dabbler
Joined
Feb 3, 2023
Messages
19
You're getting read failures on /dev/sdd and /dev/sda during extended & short tests. Likely time to replace the drives.
SMART values are also showing not too promising. Very concerned about your Current_Pending_Sector values.
 

danb35

Hall of Famer
Joined
Aug 16, 2011
Messages
15,504
Both disks have failed most of the SMART self-tests that have been run in the last 1000 hours or so. It's certainly time to replace them.
 

NugentS

MVP
Joined
Apr 16, 2020
Messages
2,947
And if you need a third opinion - both drives are likley junk

You need to replace both. Once they are free I try running badblocks over them in a full destructive pass after which they may pass smart tests. At that point they can be useful as scratch drives / temp useage - but never fully trust them.
 
Joined
Oct 22, 2019
Messages
3,641
Hi. Winnie, here. Because three people in-a-row suggest you replace the drives, I'm here to provide some "balance".

I think your drives are doing GREAT! :cool: Don't replace them! Keep them in your server forever! Give yourself another five years or so before making a decision. Enjoy life. Don't stress yourself with the burdens of a NAS server.
 

BritshGOAT

Cadet
Joined
Mar 4, 2022
Messages
2
Thanks for the help everyone, (even your suggestion winnie ) so I know what I'm looking for infuture, what stat(s) in sdd report shows it needs replacing?
 

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,994
# 2 Extended offline Completed: read failure 90% 20784 -

# 3 Short offline Completed: read failure 90% 20713 -

# 4 Short offline Completed: read failure 90% 20600 -

# 5 Short offline Completed: read failure 90% 20432 -
This. If the drive cannot complete a SMART Long test, it is toast. This is not the only indicator of pending doom. Read my little Hard Drive Troubleshooting Guide, I haven't updated it in a while for some nvme specific info but you will get the point.
 
Top