Why is my scrub taking so long?

Status
Not open for further replies.

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
HTML:
########## SMART status report summary for all drives ##########

+------+---------------+----+-----+-----+-----+-------+-------+--------+------+------+------+-------+----+
|Device|Serial         |Temp|Power|Start|Spin |ReAlloc|Current|Offline |UDMA  |Seek  |High  |Command|Last|
|      |               |    |On   |Stop |Retry|Sectors|Pending|Uncorrec|CRC   |Errors|Fly   |Timeout|Test|
|      |               |    |Hours|Count|Count|       |Sectors|Sectors |Errors|      |Writes|Count  |Age |
+------+---------------+----+-----+-----+-----+-------+-------+--------+------+------+------+-------+----+
|ada0  |WD-WCATRA994010| 32 |25494|  241|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   0|
|ada1  |WD-WCATRA643974| 30 |28502|  420|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   1|
|ada2 ?|BTPR251404F5040AGN|  |19799|    0|     |      0|       |        |      |   N/A|   N/A|    N/A| 825|
|da0 ? |WD-WMC4N0F63AAE| 27 | 9871|  115|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   3|
|da1 ? |WD-WCC4NNPTEN30| 27 |13202|  147|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   3|
|da2 ? |WD-WCC4N0598278| 28 |16828|  159|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   3|
|da3 ? |WD-WCC4N0594308| 28 |17005|  164|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   2|
|da4   |WD-WCC4N0345057| 28 | 6466|   41|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   1|
|da5   |WD-WMC4N0256459| 27 | 5272|   41|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   1|
|da6   |WD-WMC4N1274437| 28 |18057|  169|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   1|
|da7 ? |WD-WCC4NLATJSJD| 28 |13035|  140|    0|      0|      0|       0|     0|   N/A|   N/A|    N/A|   3|
+------+---------------+----+-----+-----+-----+-------+-------+--------+------+------+------+-------+----+



########## SMART status report for ada0 drive (Western Digital Caviar: WD-WCATRA994010) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   176   174   021    Pre-fail  Always       -       4175
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       241
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   066   066   000    Old_age   Always       -       25494
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       239
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       200
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       40
194 Temperature_Celsius     0x0022   115   103   000    Old_age   Always       -       32
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     25483         -
# 2  Short offline       Completed without error       00%     25479         -
# 3  Short offline       Completed without error       00%     25458         -
# 4  Short offline       Completed without error       00%     25432         -
# 5  Short offline       Completed without error       00%     25408         -
# 6  Short offline       Completed without error       00%     25384         -
# 7  Short offline       Completed without error       00%     25360         -
# 8  Short offline       Completed without error       00%     25336         -
# 9  Extended offline    Completed without error       00%     25316         -
#10  Short offline       Completed without error       00%     25312         -
#11  Short offline       Completed without error       00%     25288         -
#12  Short offline       Completed without error       00%     25265         -
#13  Short offline       Completed without error       00%     25241         -
#14  Short offline       Completed without error       00%     25217         -
#15  Short offline       Completed without error       00%     25193         -
#16  Short offline       Completed without error       00%     25169         -
#17  Extended offline    Completed without error       00%     25150         -
#18  Short offline       Completed without error       00%     25145         -
#19  Short offline       Completed without error       00%     25125         -
#20  Short offline       Completed without error       00%     25097         -
#21  Short offline       Completed without error       00%     25074         -




########## SMART status report for ada1 drive (Western Digital Caviar: WD-WCATRA643974) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   176   175   021    Pre-fail  Always       -       4183
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       420
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   100   253   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   061   061   000    Old_age   Always       -       28502
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       418
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       374
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       45
194 Temperature_Celsius     0x0022   117   102   000    Old_age   Always       -       30
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   200   200   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     28487         -
# 2  Short offline       Completed without error       00%     28466         -
# 3  Short offline       Completed without error       00%     28440         -
# 4  Short offline       Completed without error       00%     28416         -
# 5  Short offline       Completed without error       00%     28392         -
# 6  Short offline       Completed without error       00%     28368         -
# 7  Extended offline    Completed without error       00%     28348         -
# 8  Short offline       Completed without error       00%     28344         -
# 9  Short offline       Completed without error       00%     28320         -
#10  Short offline       Completed without error       00%     28296         -
#11  Short offline       Completed without error       00%     28273         -
#12  Short offline       Completed without error       00%     28249         -
#13  Short offline       Completed without error       00%     28225         -
#14  Short offline       Completed without error       00%     28201         -
#15  Extended offline    Completed without error       00%     28182         -
#16  Short offline       Completed without error       00%     28177         -
#17  Short offline       Completed without error       00%     28154         -
#18  Short offline       Completed without error       00%     28133         -
#19  Short offline       Completed without error       00%     28106         -
#20  Short offline       Completed without error       00%     28082         -
#21  Short offline       Completed without error       00%     28058         -




########## SMART status report for ada2 drive (Intel 320 Series: BTPR251404F5040AGN) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  3 Spin_Up_Time            0x0020   100   100   000    Old_age   Offline      -       0
  4 Start_Stop_Count        0x0030   100   100   000    Old_age   Offline      -       0
  5 Reallocated_Sector_Ct   0x0032   100   100   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       19799
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       57
170 Reserve_Block_Count     0x0033   100   100   010    Pre-fail  Always       -       0
171 Program_Fail_Count      0x0032   100   100   000    Old_age   Always       -       0
172 Erase_Fail_Count        0x0032   100   100   000    Old_age   Always       -       0
183 SATA_Downshift_Count    0x0030   100   100   000    Old_age   Offline      -       15
184 End-to-End_Error        0x0032   100   100   090    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
192 Unsafe_Shutdown_Count   0x0032   100   100   000    Old_age   Always       -       34
199 CRC_Error_Count         0x0030   100   100   000    Old_age   Offline      -       0
225 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       51966
226 Workld_Media_Wear_Indic 0x0032   100   100   000    Old_age   Always       -       1972
227 Workld_Host_Reads_Perc  0x0032   100   100   000    Old_age   Always       -       16
228 Workload_Minutes        0x0032   100   100   000    Old_age   Always       -       1187946
232 Available_Reservd_Space 0x0033   100   100   010    Pre-fail  Always       -       0
233 Media_Wearout_Indicator 0x0032   099   099   000    Old_age   Always       -       0
241 Host_Writes_32MiB       0x0032   100   100   000    Old_age   Always       -       51966
242 Host_Reads_32MiB        0x0032   100   100   000    Old_age   Always       -       10395

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]




########## SMART status report for da0 drive (Western Digital AV-GP: WD-WMC4N0F63AAE) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   179   177   021    Pre-fail  Always       -       6050
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       115
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   100   253   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   087   087   000    Old_age   Always       -       9871
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       115
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       104
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       172
194 Temperature_Celsius     0x0022   123   105   000    Old_age   Always       -       27
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      9808         -
# 2  Short offline       Completed without error       00%      9786         -
# 3  Short offline       Completed without error       00%      9760         -
# 4  Extended offline    Completed without error       00%      9744         -
# 5  Short offline       Completed without error       00%      9736         -
# 6  Short offline       Completed without error       00%      9712         -
# 7  Short offline       Completed without error       00%      9688         -
# 8  Short offline       Completed without error       00%      9667         -
# 9  Short offline       Completed without error       00%      9640         -
#10  Short offline       Completed without error       00%      9624         -
#11  Short offline       Completed without error       00%      9606         -
#12  Extended offline    Completed without error       00%      9577         -
#13  Short offline       Completed without error       00%      9569         -
#14  Short offline       Completed without error       00%      9548         -
#15  Short offline       Completed without error       00%      9473         -
#16  Short offline       Completed without error       00%      9449         -
#17  Short offline       Completed without error       00%      9425         -
#18  Extended offline    Completed without error       00%      9409         -
#19  Short offline       Completed without error       00%      9401         -
#20  Short offline       Completed without error       00%      9377         -
#21  Short offline       Completed without error       00%      9353         -
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
HTML:
########## SMART status report for da1 drive (Western Digital AV-GP: WD-WCC4NNPTEN30) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   181   179   021    Pre-fail  Always       -       5950
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       147
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   100   253   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   082   082   000    Old_age   Always       -       13202
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       146
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       119
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       212
194 Temperature_Celsius     0x0022   123   105   000    Old_age   Always       -       27
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     13140         -
# 2  Short offline       Completed without error       00%     13117         -
# 3  Extended offline    Completed without error       00%     13101         -
# 4  Short offline       Completed without error       00%     13092         -
# 5  Short offline       Completed without error       00%     13068         -
# 6  Short offline       Completed without error       00%     13044         -
# 7  Short offline       Completed without error       00%     13020         -
# 8  Short offline       Completed without error       00%     12998         -
# 9  Short offline       Completed without error       00%     12972         -
#10  Short offline       Completed without error       00%     12956         -
#11  Short offline       Completed without error       00%     12938         -
#12  Short offline       Completed without error       00%     12900         -
#13  Short offline       Completed without error       00%     12879         -
#14  Short offline       Completed without error       00%     12852         -
#15  Short offline       Completed without error       00%     12804         -
#16  Short offline       Completed without error       00%     12780         -
#17  Extended offline    Completed without error       00%     12766         -
#18  Short offline       Completed without error       00%     12757         -
#19  Short offline       Completed without error       00%     12733         -
#20  Short offline       Completed without error       00%     12709         -
#21  Short offline       Completed without error       00%     12685         -




########## SMART status report for da2 drive (Western Digital AV-GP: WD-WCC4N0598278) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   177   176   021    Pre-fail  Always       -       6108
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       159
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   077   077   000    Old_age   Always       -       16828
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       158
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       126
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       32
194 Temperature_Celsius     0x0022   122   102   000    Old_age   Always       -       28
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     16765         -
# 2  Short offline       Completed without error       00%     16746         -
# 3  Short offline       Completed without error       00%     16717         -
# 4  Short offline       Completed without error       00%     16693         -
# 5  Short offline       Completed without error       00%     16669         -
# 6  Short offline       Completed without error       00%     16645         -
# 7  Short offline       Completed without error       00%     16624         -
# 8  Short offline       Completed without error       00%     16598         -
# 9  Short offline       Completed without error       00%     16581         -
#10  Short offline       Completed without error       00%     16550         -
#11  Short offline       Completed without error       00%     16526         -
#12  Short offline       Completed without error       00%     16519         -
#13  Short offline       Completed without error       00%     16481         -
#14  Short offline       Completed without error       00%     16461         -
#15  Short offline       Completed without error       00%     16430         -
#16  Extended offline    Completed without error       00%     16415         -
#17  Short offline       Completed without error       00%     16406         -
#18  Short offline       Completed without error       00%     16382         -
#19  Short offline       Completed without error       00%     16358         -
#20  Short offline       Completed without error       00%     16334         -
#21  Short offline       Completed without error       00%     16310         -




########## SMART status report for da3 drive (Western Digital AV-GP: WD-WCC4N0594308) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   177   176   021    Pre-fail  Always       -       6141
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       164
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   077   077   000    Old_age   Always       -       17005
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       163
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       129
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       34
194 Temperature_Celsius     0x0022   122   099   000    Old_age   Always       -       28
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Extended offline    Completed without error       00%     16951         -
# 2  Short offline       Completed without error       00%     16943         -
# 3  Short offline       Completed without error       00%     16924         -
# 4  Short offline       Completed without error       00%     16895         -
# 5  Short offline       Completed without error       00%     16871         -
# 6  Short offline       Completed without error       00%     16847         -
# 7  Short offline       Completed without error       00%     16823         -
# 8  Short offline       Completed without error       00%     16810         -
# 9  Extended offline    Completed without error       00%     16784         -
#10  Short offline       Completed without error       00%     16775         -
#11  Short offline       Completed without error       00%     16759         -
#12  Short offline       Completed without error       00%     16732         -
#13  Short offline       Completed without error       00%     16704         -
#14  Short offline       Completed without error       00%     16688         -
#15  Extended offline    Completed without error       00%     16616         -
#16  Short offline       Completed without error       00%     16607         -
#17  Short offline       Completed without error       00%     16583         -
#18  Short offline       Completed without error       00%     16560         -
#19  Short offline       Completed without error       00%     16536         -
#20  Short offline       Completed without error       00%     16512         -
#21  Short offline       Completed without error       00%     16488         -




########## SMART status report for da4 drive (Western Digital AV-GP: WD-WCC4N0345057) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   175   172   021    Pre-fail  Always       -       6250
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       41
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   092   092   000    Old_age   Always       -       6466
10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       41
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       38
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       2
194 Temperature_Celsius     0x0022   122   112   000    Old_age   Always       -       28
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      6451         -
# 2  Short offline       Completed without error       00%      6430         -
# 3  Short offline       Completed without error       00%      6403         -
# 4  Short offline       Completed without error       00%      6379         -
# 5  Short offline       Completed without error       00%      6355         -
# 6  Extended offline    Completed without error       00%      6340         -
# 7  Short offline       Completed without error       00%      6331         -
# 8  Short offline       Completed without error       00%      6307         -
# 9  Short offline       Completed without error       00%      6283         -
#10  Short offline       Completed without error       00%      6259         -
#11  Short offline       Completed without error       00%      6235         -
#12  Short offline       Completed without error       00%      6211         -
#13  Short offline       Completed without error       00%      6187         -
#14  Extended offline    Completed without error       00%      6173         -
#15  Short offline       Completed without error       00%      6164         -
#16  Short offline       Completed without error       00%      6140         -
#17  Short offline       Completed without error       00%      6116         -
#18  Short offline       Completed without error       00%      6096         -
#19  Short offline       Completed without error       00%      6068         -
#20  Short offline       Completed without error       00%      6044         -
#21  Short offline       Completed without error       00%      6020         -




########## SMART status report for da5 drive (Western Digital AV-GP: WD-WMC4N0256459) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   183   180   021    Pre-fail  Always       -       5816
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       41
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   093   093   000    Old_age   Always       -       5272
10 Spin_Retry_Count        0x0032   100   253   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   253   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       41
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       39
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       1
194 Temperature_Celsius     0x0022   123   113   000    Old_age   Always       -       27
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%      5257         -
# 2  Short offline       Completed without error       00%      5237         -
# 3  Short offline       Completed without error       00%      5209         -
# 4  Short offline       Completed without error       00%      5185         -
# 5  Extended offline    Completed without error       00%      5170         -
# 6  Short offline       Completed without error       00%      5161         -
# 7  Short offline       Completed without error       00%      5137         -
# 8  Short offline       Completed without error       00%      5113         -
# 9  Short offline       Completed without error       00%      5089         -
#10  Short offline       Completed without error       00%      5065         -
#11  Short offline       Completed without error       00%      5042         -
#12  Short offline       Completed without error       00%      5018         -
#13  Extended offline    Completed without error       00%      5003         -
#14  Short offline       Completed without error       00%      4994         -
#15  Short offline       Completed without error       00%      4970         -
#16  Short offline       Completed without error       00%      4946         -
#17  Short offline       Completed without error       00%      4922         -
#18  Short offline       Completed without error       00%      4902         -
#19  Short offline       Completed without error       00%      4874         -
#20  Short offline       Completed without error       00%      4850         -
#21  Extended offline    Completed without error       00%      4835         -




########## SMART status report for da6 drive (Western Digital AV-GP: WD-WMC4N1274437) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       0
  3 Spin_Up_Time            0x0027   178   177   021    Pre-fail  Always       -       6066
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       169
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   200   200   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   076   076   000    Old_age   Always       -       18057
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       166
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       131
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       37
194 Temperature_Celsius     0x0022   122   099   000    Old_age   Always       -       28
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     18044         -
# 2  Short offline       Completed without error       00%     18031         -
# 3  Short offline       Completed without error       00%     17994         -
# 4  Short offline       Completed without error       00%     17970         -
# 5  Short offline       Completed without error       00%     17946         -
# 6  Short offline       Completed without error       00%     17922         -
# 7  Short offline       Completed without error       00%     17898         -
# 8  Extended offline    Completed without error       00%     17882         -
# 9  Short offline       Completed without error       00%     17874         -
#10  Short offline       Completed without error       00%     17853         -
#11  Short offline       Completed without error       00%     17827         -
#12  Short offline       Completed without error       00%     17804         -
#13  Short offline       Completed without error       00%     17780         -
#14  Short offline       Completed without error       00%     17755         -
#15  Short offline       Completed without error       00%     17734         -
#16  Short offline       Completed without error       00%     17725         -
#17  Short offline       Completed without error       00%     17684         -
#18  Short offline       Completed without error       00%     17659         -
#19  Short offline       Completed without error       00%     17635         -
#20  Short offline       Completed without error       00%     17611         -
#21  Short offline       Completed without error       00%     17587         -




########## SMART status report for da7 drive (Western Digital AV-GP: WD-WCC4NLATJSJD) ##########
smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART overall-health self-assessment test result: PASSED

ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   200   200   051    Pre-fail  Always       -       2
  3 Spin_Up_Time            0x0027   180   180   021    Pre-fail  Always       -       5958
  4 Start_Stop_Count        0x0032   100   100   000    Old_age   Always       -       140
  5 Reallocated_Sector_Ct   0x0033   200   200   140    Pre-fail  Always       -       0
  7 Seek_Error_Rate         0x002e   100   253   000    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   083   083   000    Old_age   Always       -       13035
10 Spin_Retry_Count        0x0032   100   100   000    Old_age   Always       -       0
11 Calibration_Retry_Count 0x0032   100   100   000    Old_age   Always       -       0
12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       139
192 Power-Off_Retract_Count 0x0032   200   200   000    Old_age   Always       -       118
193 Load_Cycle_Count        0x0032   200   200   000    Old_age   Always       -       202
194 Temperature_Celsius     0x0022   122   104   000    Old_age   Always       -       28
196 Reallocated_Event_Count 0x0032   200   200   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   200   200   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   253   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   200   200   000    Old_age   Always       -       0
200 Multi_Zone_Error_Rate   0x0008   200   200   000    Old_age   Offline      -       0

No Errors Logged

smartctl 6.4 2015-06-04 r4109 [FreeBSD 10.3-RELEASE amd64] (local build)

SMART Self-test log structure revision number 1
Num  Test_Description    Status                  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline       Completed without error       00%     12973         -
# 2  Short offline       Completed without error       00%     12950         -
# 3  Short offline       Completed without error       00%     12925         -
# 4  Short offline       Completed without error       00%     12901         -
# 5  Extended offline    Completed without error       00%     12885         -
# 6  Short offline       Completed without error       00%     12877         -
# 7  Short offline       Completed without error       00%     12853         -
# 8  Short offline       Completed without error       00%     12832         -
# 9  Short offline       Completed without error       00%     12805         -
#10  Short offline       Completed without error       00%     12789         -
#11  Short offline       Completed without error       00%     12771         -
#12  Short offline       Completed without error       00%     12733         -
#13  Short offline       Completed without error       00%     12712         -
#14  Short offline       Completed without error       00%     12637         -
#15  Short offline       Completed without error       00%     12613         -
#16  Short offline       Completed without error       00%     12590         -
#17  Short offline       Completed without error       00%     12566         -
#18  Extended offline    Completed without error       00%     12550         -
#19  Short offline       Completed without error       00%     12542         -
#20  Short offline       Completed without error       00%     12518         -
#21  Short offline       Completed without error       00%     12501         -
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
all my hard drives have daily short tests and weekly long tests. all the tests have passed. there are no communication errors. there are no Reallocated_Sectors or Current_Pending_Sector or Offline_Uncorrectable or UDMA_CRC_Error_Count
da7 has 2 raw read error rate but i think this is okay

do i need to remove 1 drive at a time and run a scrub to try to find if the drives are or are not the problem?
 
Last edited:

Bidule0hm

Server Electronics Sorcerer
Joined
Aug 5, 2013
Messages
3,710
Your drives looks fine to me, the problem isn't here.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
i suppose that leaves the motherboard.
 

Robert Trevellyan

Pony Wrangler
Joined
May 16, 2014
Messages
3,778
I'm not ready to dismiss your 80% full pool being a factor. I can imagine fragmentation becoming much worse, much more quickly than in the past, leading to rapidly increasing scrub times.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
Code:
NAME           SIZE  ALLOC   FREE  EXPANDSZ   FRAG    CAP  DEDUP  HEALTH  ALTROOT
Storage       16.2T  12.8T  3.40T         -     9%    79%  1.00x  ONLINE  /mnt
Working       3.62T  2.24T  1.38T         -    24%    61%  1.00x  ONLINE  /mnt
freenas-boot  37.2G  1.34G  35.9G         -      -     3%  1.00x  ONLINE  -
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
Disc.png


These are 3 of my discs during the scrub - there is nothing else happening.
One of my recent scrubs took 67h47m. it ran almost constantly at 6 mbytes/s.
i ended up rebooting the server - after the reboot it was scrubbing at 60 mbytes/s and after about 4 or 5 hours
it was back to under 10 mbytes/s.
 
Last edited:

joeschmuck

Old Man
Moderator
Joined
May 28, 2011
Messages
10,994
do i need to remove 1 drive at a time and run a scrub to try to find if the drives are or are not the problem?
Your drives look fine and NO, do not pull a drive and run a scrub, you are asking for trouble. If you are willing to go to that extreme then maybe you should clean up your drives some by deleting content you do not need.
i ended up rebooting the server - after the reboot it was scrubbing at 60 mbytes/s and after about 4 or 5 hours
it was back to under 10 mbytes/s.
What does your RAM utilization look like?
Do you have any jails/plugins running and if so, have you turned those off while running a scrub? So here is an experiment if you said yes...
1) Turn off your jails and plugins (disable them from automatically starting)
2) Reboot
3) Run a scrub.
4) Is it faster?

It's just that you say it's fast after a reboot but gets slower. This could be a RAM limitation issue or it could be just a ton of small files.

Also, I don't think the problem is your motherboard, unless your CPU fan is dead and the thing is throttling. You could check for really hot areas and add some air flow (use a portable fan) to see if it's an overheated component. But my money right now it a RAM shortage or lots of small files.

Lastly, you need to thing about what you have changed, even if it's minor, to your FreeNAS system since the last time you knew it worked as you expected.
 

Bidule0hm

Server Electronics Sorcerer
Joined
Aug 5, 2013
Messages
3,710
it could be just a ton of small files.

Mhhh... IIRC the scrub is at the block level so it doesn't care about the number of files.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
Memory.png

This is my memory prior to the scrub
 

Arwen

MVP
Joined
May 17, 2014
Messages
3,611
Scrubs do care about the size of the files, and the number of files in directories.

So a pool with lots of small files, in lots of directories is likely going to run slower
than the opposite, large files in few directories. At least for spinning media with
head seeks.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
is there anyway to quantify this or is it subjective. what is a small file ? What is a lot of directories ? What are large files ? What are few directories ?
 
Last edited:

cyberjock

Inactive Account
Joined
Mar 25, 2012
Messages
19,526
Scrubs do care about the size of the files, and the number of files in directories.

So a pool with lots of small files, in lots of directories is likely going to run slower
than the opposite, large files in few directories. At least for spinning media with
head seeks.

That's not correct.

Scrubs don't care about small files. They care about small block sizes (which do have lots of head seeks, etc.). Now, if you are writing lots of small files, you are likely to end up with lots of small blocks. But, that is subjective as ethereal said. The technically correct answer is "scrubs care about small block sizes and fragmentation of the blocks".

@ethereal: Block sizes by default are up to 128KB in size.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
54,131 folders - 385,972 files
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Mhhh... IIRC the scrub is at the block level so it doesn't care about the number of files.
More files mean more metadata, which tends to mean more random accesses.
 

Arwen

MVP
Joined
May 17, 2014
Messages
3,611
That's not correct.

Scrubs don't care about small files. They care about small block sizes (which do have lots of head seeks, etc.). Now, if you are writing lots of small files, you are likely to end up with lots of small blocks. But, that is subjective as ethereal said. The technically correct answer is "scrubs care about small block sizes and fragmentation of the blocks".
...
Yep, that's better wording.

Even huge files, written slowly enough to have small blocks written, will have that issue.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
Storage_Scrub_at_26_percent.png
Scrub at 26%
Storage_Scrub_at_61_percent.png
Scrub at 61%
Storage_Scrub_at_64_percent.png
Scrub at 64%
Storage_Scrub_at_70_percent.png
Scrub at 70%
Storage_Scrub_at_81_percent.png
Scrub at 81%
Storage_Scrub_at_93_percent.png
Scrub at 93% - down to 8 mbytes/s

As you can see the scrub starts at 60 mbytes/s and ends up about 8 mbytes/s.
This is my first and only freenas server so i have no prior knowledge of scrubs or any other scrubs to campare.

is this a typical scrub when the pool gets to 80% full and 9% fragmented ?
 

jgreco

Resident Grinch
Joined
May 29, 2011
Messages
18,680
That's not correct.

Scrubs don't care about small files. They care about small block sizes (which do have lots of head seeks, etc.). Now, if you are writing lots of small files, you are likely to end up with lots of small blocks. But, that is subjective as ethereal said. The technically correct answer is "scrubs care about small block sizes and fragmentation of the blocks".

@ethereal: Block sizes by default are up to 128KB in size.

That's still kind of a poor explanation. For a scrub, ZFS has to traverse the pool by following all the metadata, which is how it is able to identify where blocks are stored. Each block that is stored may result in a seek needing to happen to retrieve it. As a pool fills, it becomes harder to allocate space for the larger blocks, and smaller blocks tend to get scattered about. This ultimately turns the process of traversing all the pool data into an ugly process of seeking all over the place, and this gets worse as fragmentation increases. Avoiding writing lots of small blocks is the pragmatic fix.
 

ethereal

Guru
Joined
Sep 10, 2012
Messages
762
@jgreco
As you can see the scrub starts at 60 mbytes/s and ends up about 8 mbytes/s.
This is my first and only freenas server so i have no prior knowledge of scrubs or any other scrubs to campare.

is this a typical scrub when the pool gets to 80% full and 9% fragmented ?
 
Status
Not open for further replies.
Top