Hello again,
Checking my email this morning, I found a new message from my server telling me the following;
So I did a search on the forums and found that previous posts required smartctl -a -q noserial /dev/da1 information as well as camcontrol devlist to help diagnose what was going on. So here's the smartctl output;
And here's the camcontrol output;
Any help diagnosing what components are failing would be greatly appreciated. In my signature is my system set-up (hardware and zpool config). I run scrubs regularly. I'm also getting a critical error when logging into the GUI on the same drive in regards to temperature (set up by me to warn me if any drives were potentially getting too hot);
I am currently running version FreeNAS-9.3-STABLE-201506042008. I do have an update available, but haven't gotten around to implementing.
Checking my email this morning, I found a new message from my server telling me the following;
Code:
trinity.WORKGROUP kernel log messages: (da1:mps0:0:1:0): READ(16). CDB: 88 00 00 00 00 01 05 ca 4a 28 00 00 00 e0 00 00 length 114688 SMID 677 command timeout cm 0xffffff8000b32368 ccb 0xfffffe0040dfa000 (noperiph:mps0:0:4294967295:0): SMID 1 Aborting command 0xffffff8000b32368 (da1:mps0:0:1:0): READ(16). CDB: 88 00 00 00 00 01 05 ca 4b 08 00 00 00 e0 00 00 length 114688 SMID 222 command timeout cm 0xffffff8000b0dc70 ccb 0xfffffe0040dea000 (da1:mps0:0:1:0): READ(16). CDB: 88 00 00 00 00 01 05 ca 4b 08 00 00 00 e0 00 00 length 114688 SMID 222 terminated ioc 804b scsi 0 state c xfer 0 (da1:mps0:0:1:0): READ(16). CDB: 88 00 00 00 00 01 05 ca 4a 28 00 00 00 e0 00 00 (da1:mps0:0:1:0): CAM status: Command timeout (da1:mps0:0:1:0): Retrying command (da1:mps0:0:1:0): READ(16). CDB: 88 00 00 00 00 01 05 ca 4a 28 00 00 00 e0 00 00 (da1:mps0:0:1:0): CAM status: SCSI Status Error (da1:mps0:0:1:0): SCSI status: Check Condition (da1:mps0:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da1:mps0:0:1:0): Retrying command (per sense data) (da1:mps0:0:1:0): WRITE(10). CDB: 2a 00 00 40 01 b0 00 00 08 00 (da1:mps0:0:1:0): CAM status: SCSI Status Error (da1:mps0:0:1:0): SCSI status: Check Condition (da1:mps0:0:1:0): SCSI sense: UNIT ATTENTION asc:29,0 (Power on, reset, or bus device reset occurred) (da1:mps0:0:1:0): Retrying command (per sense data) -- End of security output --
So I did a search on the forums and found that previous posts required smartctl -a -q noserial /dev/da1 information as well as camcontrol devlist to help diagnose what was going on. So here's the smartctl output;
Code:
smartctl 6.3 2014-07-26 r3976 [FreeBSD 9.3-RELEASE-p13 amd64] (local build) Copyright (C) 2002-14, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Seagate Barracuda 7200.14 (AF) Device Model: ST3000DM001-9YN166 Firmware Version: CC4H User Capacity: 3,000,592,982,016 bytes [3.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 7200 rpm Device is: In smartctl database [for details use: -P show] ATA Version is: ATA8-ACS T13/1699-D revision 4 SATA Version is: SATA 3.0, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Fri Jul 3 04:25:12 2015 MDT SMART support is: Available - device has SMART capability. SMART support is: Enabled === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED General SMART Values: Offline data collection status: (0x00) Offline data collection activity was never started. Auto Offline Data Collection: Disabled. Self-test execution status: ( 0) The previous self-test routine completed without error or no self-test has ever been run. Total time to complete Offline data collection: ( 584) seconds. Offline data collection capabilities: (0x73) SMART execute Offline immediate. Auto Offline data collection on/off supp ort. Suspend Offline collection upon new command. No Offline surface scan supported. Self-test supported. Conveyance Self-test supported. Selective Self-test supported. SMART capabilities: (0x0003) Saves SMART data before entering power-saving mode. Supports SMART auto save timer. Error logging capability: (0x01) Error logging supported. General Purpose Logging supported. Short self-test routine recommended polling time: ( 1) minutes. Extended self-test routine recommended polling time: ( 338) minutes. Conveyance self-test routine recommended polling time: ( 2) minutes. SCT capabilities: (0x3085) SCT Status supported. SMART Attributes Data Structure revision number: 10 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_ FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x000f 117 099 006 Pre-fail Always - 129540688 3 Spin_Up_Time 0x0003 092 092 000 Pre-fail Always - 0 4 Start_Stop_Count 0x0032 100 100 020 Old_age Always - 140 5 Reallocated_Sector_Ct 0x0033 100 100 036 Pre-fail Always - 0 7 Seek_Error_Rate 0x000f 079 060 030 Pre-fail Always - 94950705 9 Power_On_Hours 0x0032 084 084 000 Old_age Always - 14737 10 Spin_Retry_Count 0x0013 100 100 097 Pre-fail Always - 0 12 Power_Cycle_Count 0x0032 100 100 020 Old_age Always - 140 183 Runtime_Bad_Block 0x0032 100 100 000 Old_age Always - 0 184 End-to-End_Error 0x0032 100 100 099 Old_age Always - 0 187 Reported_Uncorrect 0x0032 100 100 000 Old_age Always - 0 188 Command_Timeout 0x0032 100 100 000 Old_age Always - 1 1 1 189 High_Fly_Writes 0x003a 098 098 000 Old_age Always - 2 190 Airflow_Temperature_Cel 0x0022 064 060 045 Old_age Always - 36 (Min/Max 29/39) 191 G-Sense_Error_Rate 0x0032 100 100 000 Old_age Always - 0 192 Power-Off_Retract_Count 0x0032 100 100 000 Old_age Always - 138 193 Load_Cycle_Count 0x0032 014 014 000 Old_age Always - 173788 194 Temperature_Celsius 0x0022 036 040 000 Old_age Always - 36 (0 23 0 0 0) 197 Current_Pending_Sector 0x0012 100 100 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0010 100 100 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x003e 200 200 000 Old_age Always - 0 240 Head_Flying_Hours 0x0000 100 253 000 Old_age Offline - 8413h+28m+22.461s 241 Total_LBAs_Written 0x0000 100 253 000 Old_age Offline - 191979086624575 242 Total_LBAs_Read 0x0000 100 253 000 Old_age Offline - 216679946591166 SMART Error Log Version: 1 No Errors Logged SMART Self-test log structure revision number 1 Num Test_Description Status Remaining LifeTime(hours) LBA _of_first_error # 1 Short offline Completed without error 00% 14599 - # 2 Extended offline Completed without error 00% 14581 - # 3 Short offline Completed without error 00% 14479 - # 4 Short offline Completed without error 00% 14385 - # 5 Short offline Completed without error 00% 14289 - # 6 Extended offline Completed without error 00% 14272 - # 7 Short offline Completed without error 00% 14170 - # 8 Short offline Completed without error 00% 14008 - # 9 Short offline Completed without error 00% 13887 - #10 Extended offline Completed without error 00% 13869 - #11 Short offline Completed without error 00% 13767 - #12 Short offline Completed without error 00% 13647 - #13 Short offline Completed without error 00% 13551 - #14 Extended offline Completed without error 00% 13533 - #15 Short offline Completed without error 00% 13431 - #16 Short offline Completed without error 00% 13287 - #17 Short offline Completed without error 00% 13167 - #18 Extended offline Completed without error 00% 13151 - #19 Short offline Completed without error 00% 13047 - #20 Short offline Completed without error 00% 12927 - #21 Short offline Completed without error 00% 12832 - SMART Selective self-test log data structure revision number 1 SPAN MIN_LBA MAX_LBA CURRENT_TEST_STATUS 1 0 0 Not_testing 2 0 0 Not_testing 3 0 0 Not_testing 4 0 0 Not_testing 5 0 0 Not_testing Selective self-test flags (0x0): After scanning selected spans, do NOT read-scan remainder of disk. If Selective self-test is pending on power-up, resume after 0 minute delay.
And here's the camcontrol output;
Code:
<ATA ST3000DM001-1CH1 CC24> at scbus0 target 0 lun 0 (pass0,da0) <ATA ST3000DM001-9YN1 CC4H> at scbus0 target 1 lun 0 (pass1,da1) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 2 lun 0 (pass2,da2) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 3 lun 0 (pass3,da3) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 4 lun 0 (pass4,da4) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 5 lun 0 (pass5,da5) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 6 lun 0 (pass6,da6) <ATA ST3000DM001-1CH1 CC24> at scbus0 target 7 lun 0 (pass7,da7) <ATA ST3000DM001-1CH1 CC24> at scbus1 target 0 lun 0 (pass8,da8) <ATA ST3000DM001-1CH1 CC24> at scbus1 target 1 lun 0 (pass9,da9) <ATA ST3000DM001-1CH1 CC27> at scbus1 target 3 lun 0 (pass10,da10) <ATA ST3000DM001-1CH1 CC24> at scbus1 target 4 lun 0 (pass11,da11) <ATA ST3000DM001-1CH1 CC24> at scbus1 target 5 lun 0 (pass12,da12) <ATA ST3000DM001-1CH1 CC24> at scbus1 target 7 lun 0 (pass13,da13) <ATA ST3000DM001-1ER1 CC43> at scbus1 target 8 lun 0 (pass14,da14) <ATA WDC WD30EFRX-68E 0A82> at scbus1 target 9 lun 0 (pass15,da15) <ATA ST3000DM001-1CH1 CC24> at scbus2 target 0 lun 0 (pass16,da16) <ATA ST3000DM001-1CH1 CC24> at scbus2 target 1 lun 0 (pass17,da17) <ATA ST3000DM001-1CH1 CC24> at scbus2 target 4 lun 0 (pass18,da18) <ATA ST3000DM001-1CH1 CC24> at scbus2 target 5 lun 0 (pass19,da19) <ATA ST3000DM001-1ER1 CC43> at scbus2 target 7 lun 0 (pass20,da20) <ATA WDC WD30EFRX-68E 0A82> at scbus2 target 8 lun 0 (pass21,da21) <ATA WDC WD30EFRX-68E 0A82> at scbus2 target 9 lun 0 (pass22,da22) <ATA WDC WD30EFRX-68E 0A82> at scbus2 target 10 lun 0 (pass23,da23) <Lexar USB Flash Drive 8.07> at scbus10 target 0 lun 0 (pass24,da24) <Lexar USB Flash Drive 8.07> at scbus11 target 0 lun 0 (pass25,da25)
Any help diagnosing what components are failing would be greatly appreciated. In my signature is my system set-up (hardware and zpool config). I run scrubs regularly. I'm also getting a critical error when logging into the GUI on the same drive in regards to temperature (set up by me to warn me if any drives were potentially getting too hot);
Code:
Device: /dev/da1 [SAT], Temperature 39 Celsius reached critical limit of 39 Celsius (Min/Max 35/39!)
I am currently running version FreeNAS-9.3-STABLE-201506042008. I do have an update available, but haven't gotten around to implementing.