nastest.local.nastest daily security run output error with log

[patrick sullivan]

errors toward the end....

nastest.local.nastest kernel log messages:
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 91 b8 00 01 00 00 length 131072 SMID 119 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 90 b8 00 01 00 00 length 131072 SMID 749 terminated ioc 804b loginfo 31120310 s(da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 91 b8 00 01 00 00
> csi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8f b8 00 01 00 00 length 131072 SMID 346 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2: (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8e b8 00 01 00 00 length 131072 SMID 86 terminated ioc 804b loginfo 31120310 scmps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 90 b8 00 01 00 00
> si 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8d b8 00 01 00 00 length 131072 SMID 159 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8f b8 00 01 00 00
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8c b8 00 01 00 00 length 131072 SMID 123 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8b b8 00 01 00 00 length 131072 SMID 1011 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2: (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8a b8 00 01 00 00 length 131072 SMID 745 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 89 b0 00 01 00 00 length 131072 SMID 968 terminated ioc 804b loginfo 31120310 smps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8e b8 00 01 00 00
> csi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 88 b0 00 01 00 00 length 131072 SMID 122 terminated ioc 804b loginfo 31120310 s(da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8d b8 00 01 00 00
> csi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 87 b0 00 01 00 00 length 131072 SMID 893 terminated ioc 804b loginfo 31120310 s(da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8c b8 00 01 00 00
> csi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 86 b0 00 01 00 00 length 131072 SMID 246 terminated ioc 804b loginfo 31120310 scsi 0 state c xfer 0
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 85 b0 00 01 00 00 length 131072 SMID 711 terminated ioc 804b loginfo 31120310 s(da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8b b8 00 01 00 00
> csi 0 state c xfer 0
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 8a b8 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 89 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 88 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 87 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 86 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 85 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: CCB request completed with an error
> (da2:mps0:0:10:0): Retrying command
> (da2:mps0:0:10:0): READ(10). CDB: 28 00 4f 27 86 b0 00 01 00 00
> (da2:mps0:0:10:0): CAM status: SCSI Status Error
> (da2:mps0:0:10:0): SCSI status: Check Condition
> (da2:mps0:0:10:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred)
> (da2:mps0:0:10:0): Retrying command (per sense data)

-- End of security output --

 

[DrKK]

You would appear to be having an extreme problem with da2.

Let us see the complete output of

Code:

smartctl -qnoserial -x /dev/da2

 

[DrKK]

I'm not reading that.

Sir, please cut-and-paste that textual information, and place in "code" tags.

 

[patrick sullivan]

smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.1-STABLE amd64] (local build)

Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===

Model Family: HGST Deskstar NAS

Device Model: HGST HDN724040ALE640

Firmware Version: MJAOA5E0

User Capacity: 4,000,787,030,016 bytes [4.00 TB]

Sector Sizes: 512 bytes logical, 4096 bytes physical

Rotation Rate: 7200 rpm

Form Factor: 3.5 inches

Device is: In smartctl database [for details use: -P show]

ATA Version is: ATA8-ACS T13/1699-D revision 4

SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s)

Local Time is: Wed Oct 17 22:20:55 2018 PDT

SMART support is: Available - device has SMART capability.

SMART support is: Enabled

AAM feature is: Unavailable

APM feature is: Disabled

Rd look-ahead is: Enabled

Write cache is: Enabled

DSN feature is: Unavailable

ATA Security is: Disabled, NOT FROZEN [SEC1]

Wt Cache Reorder: Enabled

:
=== START OF READ SMART DATA SECTION ===

SMART overall-health self-assessment test result: PASSED

General SMART Values:

Offline data collection status: (0x82) Offline data collection activity was completed without error.

Auto Offline Data Collection: Enabled.

Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run.
Total time to complete Offline data collection: ( 24) seconds.

Offline data collection capabilities: (0x5b) SMART execute Offline immediate.

Auto Offline data collection on/off support.

Suspend Offline collection upon new command.

Offline surface scan supported.

Self-test supported.

No Conveyance Self-test supported.

Selective Self-test supported.

SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode.
:
Supports SMART auto save timer.

Error logging capability: (0x01) Error logging supported.

General Purpose Logging supported.

Short self-test routine

recommended polling time: ( 1) minutes.

Extended self-test routine recommended polling time: ( 565) minutes.

SCT capabilities: (0x003d) SCT Status supported.

SCT Error Recovery Control supported.

SCT Feature Control supported.

SCT Data Table supported.
SMART Attributes Data Structure revision number: 16

Vendor Specific SMART Attributes with Thresholds:

ID# ATTRIBUTE_NAME FLAGS VALUE WORST THRESH FAIL RAW_VALUE

1 Raw_Read_Error_Rate PO-R-- 100 100 016 - 0

2 Throughput_Performance P-S--- 136 136 054 - 81

3 Spin_Up_Time POS--- 124 124 024 - 625 (Average 624)

4 Start_Stop_Count -O--C- 100 100 000 - 23

5 Reallocated_Sector_Ct PO--CK 100 100 005 - 0

7 Seek_Error_Rate PO-R-- 100 100 067 - 0

8 Seek_Time_Performance P-S--- 121 121 020 - 34

9 Power_On_Hours -O--C- 095 095 000 - 35276

10 Spin_Retry_Count PO--C- 100 100 060 - 0

:

12 Power_Cycle_Count -O--CK 100 100 000 - 23

192 Power-Off_Retract_Count -O--CK 100 100 000 - 1062

193 Load_Cycle_Count -O--C- 100 100 000 - 1062

194 Temperature_Celsius -O---- 176 176 000 - 34 (Min/Max 14/45)

196 Reallocated_Event_Count -O--CK 100 100 000 - 0

197 Current_Pending_Sector -O---K 100 100 000 - 0

198 Offline_Uncorrectable ---R-- 100 100 000 - 0

199 UDMA_CRC_Error_Count -O-R-- 200 200 000 - 0

||||||_ K auto-keep

|||||__ C event count

||||___ R error rate

|||____ S speed/performance

||_____ O updated online

|______ P prefailure warning



General Purpose Log Directory Version 1

SMART Log Directory Version 1 [multi-sector log support]

Address Access R/W Size Description

0x00 GPL,SL R/O 1 Log Directory

0x01 SL R/O 1 Summary SMART error log

0x03 GPL R/O 1 Ext. Comprehensive SMART error log

0x04 GPL R/O 7 Device Statistics log

0x06 SL R/O 1 SMART self-test log

0x07 GPL R/O 1 Extended self-test log

:



0x08 GPL R/O 2 Power Conditions log

0x09 SL R/W 1 Selective self-test log

0x10 GPL R/O 1 NCQ Command Error log

0x11 GPL R/O 1 SATA Phy Event Counters log

0x20 GPL R/O 1 Streaming performance log [OBS-8]

0x21 GPL R/O 1 Write stream error log

0x22 GPL R/O 1 Read stream error log

0x80-0x9f GPL,SL R/W 16 Host vendor specific log

0xe0 GPL,SL R/W 1 SCT Command/Status

0xe1 GPL,SL R/W 1 SCT Data Transfer
SMART Extended Comprehensive Error Log Version: 1 (1 sectors)

No Errors Logged


SMART Extended Self-test Log Version: 1 (1 sectors)

Num Test_Description Status Remaining LifeTime(hours) LBA_of_first_error

# 1 Extended offline Completed without error 00% 16112 -

# 2 Short offline Completed without error 00% 15786 -

# 3 Extended offline Completed without error 00% 15700 -

# 4 Short offline Completed without error 00% 15618 -

# 5 Short offline Completed without error 00% 15450 -

# 6 Extended offline Completed without error 00% 15364 -

# 7 Short offline Completed without error 00% 15282 -

# 8 Extended offline Completed without error 00% 15021 -

:



# 9 Extended offline Completed without error 00% 14685 -

#10 Extended offline Completed without error 00% 14277 -

#11 Extended offline Completed without error 00% 13941 -

#12 Short offline Completed without error 00% 13643 -

#13 Extended offline Completed without error 00% 13557 -

#14 Short offline Completed without error 00% 13475 -

#15 Short offline Completed without error 00% 13307 -

#16 Extended offline Completed without error 00% 13221 -

#17 Short offline Completed without error 00% 13139 -

#18 Extended offline Completed without error 00% 12813 -

#19 Extended offline Completed without error 00% 12478 -



SMART Selective self-test log data structure revision number 1

SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS

1 0 0 Not_testing

2 0 0 Not_testing

3 0 0 Not_testing

4 0 0 Not_testing

5 0 0 Not_testing

Selective self-test flags (0x0):

After scanning selected spans, do NOT read-scan remainder of disk.

If Selective self-test is pending on power-up, resume after 0 minute delay.



SCT Status Version: 3

:



SCT Version (vendor specific): 256 (0x0100)

SCT Support Level: 1

Device State: Active (0)

Current Temperature: 33 Celsius

Power Cycle Min/Max Temperature: 15/43 Celsius

Lifetime Min/Max Temperature: 14/45 Celsius

Under/Over Temperature Limit Count: 0/0



SCT Temperature History Version: 2

Temperature Sampling Period: 1 minute

Temperature Logging Interval: 1 minute

Min/Max recommended Temperature: 0/60 Celsius

Min/Max Temperature Limit: -40/70 Celsius

Temperature History Size (Index): 128 (98)



Index Estimated Time Temperature Celsius

99 2018-10-17 20:13 35 ****************

... ..( 57 skipped). .. ****************

29 2018-10-17 21:11 35 ****************

30 2018-10-17 21:12 34 ***************

31 2018-10-17 21:13 34 ***************

32 2018-10-17 21:14 35 ****************

33 2018-10-17 21:15 35 ****************

34 2018-10-17 21:16 34 ***************

:



... ..( 54 skipped). .. ***************

89 2018-10-17 22:11 34 ***************

90 2018-10-17 22:12 33 **************

91 2018-10-17 22:13 34 ***************

92 2018-10-17 22:14 34 ***************

93 2018-10-17 22:15 34 ***************

94 2018-10-17 22:16 33 **************

95 2018-10-17 22:17 34 ***************

96 2018-10-17 22:18 33 **************

97 2018-10-17 22:19 33 **************

98 2018-10-17 22:20 34 ***************



SCT Error Recovery Control:

Read: Disabled

Write: Disabled



Device Statistics (GP Log 0x04)

Page Offset Size Value Flags Description

0x01 ===== = = === == General Statistics (rev 2) ==

0x01 0x008 4 23 --- Lifetime Power-On Resets

0x01 0x018 6 26883468424 --- Logical Sectors Written

0x01 0x020 6 698167270 --- Number of Write Commands

0x01 0x028 6 282136907858 --- Logical Sectors Read

0x01 0x030 6 2389929531 --- Number of Read Commands

:

0x03 ===== = = === == Rotating Media Statistics (rev 1) ==

0x03 0x008 4 35271 --- Spindle Motor Power-on Hours

0x03 0x010 4 35271 --- Head Flying Hours

0x03 0x018 4 1062 --- Head Load Events

0x03 0x020 4 0 --- Number of Reallocated Logical Sectors

0x03 0x028 4 0 --- Read Recovery Attempts

0x03 0x030 4 0 --- Number of Mechanical Start Failures

0x04 ===== = = === == General Errors Statistics (rev 1) ==

0x04 0x008 4 0 --- Number of Reported Uncorrectable Errors

0x04 0x010 4 1 --- Resets Between Cmd Acceptance and Completion

0x05 ===== = = === == Temperature Statistics (rev 1) ==

0x05 0x008 1 34 --- Current Temperature

0x05 0x010 1 34 N-- Average Short Term Temperature

0x05 0x018 1 33 N-- Average Long Term Temperature

0x05 0x020 1 45 --- Highest Temperature

0x05 0x028 1 14 --- Lowest Temperature

0x05 0x030 1 42 N-- Highest Average Short Term Temperature

0x05 0x038 1 25 N-- Lowest Average Short Term Temperature

0x05 0x040 1 38 N-- Highest Average Long Term Temperature

0x05 0x048 1 25 N-- Lowest Average Long Term Temperature

0x05 0x050 4 0 --- Time in Over-Temperature

0x05 0x058 1 60 --- Specified Maximum Operating Temperature

0x05 0x060 4 0 --- Time in Under-Temperature

0x05 0x068 1 0 --- Specified Minimum Operating Temperature

:



0x06 ===== = = === == Transport Statistics (rev 1) ==

0x06 0x008 4 187 --- Number of Hardware Resets

0x06 0x010 4 184 --- Number of ASR Events

0x06 0x018 4 0 --- Number of Interface CRC Errors

|||_ C monitored condition met

||__ D supports DSN

|___ N normalized value



Pending Defects log (GP Log 0x0c) not supported



SATA Phy Event Counters (GP Log 0x11)

ID Size Value Description

0x0001 2 0 Command failed due to ICRC error

0x0002 2 0 R_ERR response for data FIS

0x0003 2 0 R_ERR response for device-to-host data FIS

0x0004 2 0 R_ERR response for host-to-device data FIS

0x0005 2 0 R_ERR response for non-data FIS

0x0006 2 0 R_ERR response for device-to-host non-data FIS

0x0007 2 0 R_ERR response for host-to-device non-data FIS

0x0009 2 17 Transition from drive PhyRdy to drive PhyNRdy

0x000a 2 17 Device-to-host register FISes sent due to a COMRESET

0x000b 2 0 CRC errors within host-to-device FIS

0x000d 2 0 Non-CRC errors within host-to-device FIS



END