9.3 to 9.10 upgrade broke one of my Arrays/Volumes

Status
Not open for further replies.
Scharbag

Scharbag

Guru
Joined
Feb 1, 2012
Messages
620
Code:
smartctl -a /dev/da20
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 Crucial/Micron RealSSD C300/M500
Device Model:	 Crucial_CT480M500SSD1
Serial Number:	14331D8B1F36
LU WWN Device Id: 5 00a075 10c2b1f36
Firmware Version: MU05
User Capacity:	480,103,981,056 bytes [480 GB]
Sector Sizes:	 512 bytes logical, 4096 bytes physical
Rotation Rate:	Solid State Device
Form Factor:	  2.5 inches
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 6
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:	Sun Jan 15 12:52:01 2017 CST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Enabled.
Self-test execution status:	  (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection:		 ( 2235) seconds.
Offline data collection
capabilities:			  (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:			(0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:		(0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time:	  (   2) minutes.
Extended self-test routine
recommended polling time:	  (  37) minutes.
Conveyance self-test routine
recommended polling time:	  (   3) minutes.
SCT capabilities:			(0x0035)	SCT Status supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAG	 VALUE WORST THRESH TYPE	  UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate	 0x002f   100   100   000	Pre-fail  Always	   -	   0
  5 Reallocated_Sector_Ct   0x0033   100   100   000	Pre-fail  Always	   -	   0
  9 Power_On_Hours		  0x0032   100   100   000	Old_age   Always	   -	   17848
12 Power_Cycle_Count	   0x0032   100   100   000	Old_age   Always	   -	   36
171 Program_Fail_Count	  0x0032   100   100   000	Old_age   Always	   -	   0
172 Erase_Fail_Count		0x0032   100   100   000	Old_age   Always	   -	   0
173 Wear_Leveling_Count	 0x0032   096   096   000	Old_age   Always	   -	   134
174 Unexpect_Power_Loss_Ct  0x0032   100   100   000	Old_age   Always	   -	   21
180 Unused_Rsvd_Blk_Cnt_Tot 0x0033   000   000   000	Pre-fail  Always	   -	   8219
183 SATA_Iface_Downshift	0x0032   100   100   000	Old_age   Always	   -	   0
184 End-to-End_Error		0x0032   100   100   000	Old_age   Always	   -	   0
187 Reported_Uncorrect	  0x0032   100   100   000	Old_age   Always	   -	   0
194 Temperature_Celsius	 0x0022   071   056   000	Old_age   Always	   -	   29 (Min/Max 0/44)
196 Reallocated_Event_Count 0x0032   100   100   000	Old_age   Always	   -	   0
197 Current_Pending_Sector  0x0032   100   100   000	Old_age   Always	   -	   0
198 Offline_Uncorrectable   0x0030   100   100   000	Old_age   Offline	  -	   0
199 UDMA_CRC_Error_Count	0x0032   100   100   000	Old_age   Always	   -	   0
202 Percent_Lifetime_Used   0x0031   096   096   000	Pre-fail  Offline	  -	   4
206 Write_Error_Rate		0x000e   100   100   000	Old_age   Always	   -	   0
210 Success_RAIN_Recov_Cnt  0x0032   100   100   000	Old_age   Always	   -	   0
246 Total_Host_Sector_Write 0x0032   100   100   ---	Old_age   Always	   -	   51911182937
247 Host_Program_Page_Count 0x0032   100   100   ---	Old_age   Always	   -	   1654105725
248 Bckgnd_Program_Page_Cnt 0x0032   100   100   ---	Old_age   Always	   -	   2649136468

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description	Status				  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline	   Completed without error	   00%	 17848		 -
# 2  Short offline	   Completed without error	   00%	 17842		 -
# 3  Short offline	   Completed without error	   00%	 17836		 -
# 4  Short offline	   Completed without error	   00%	 17830		 -
# 5  Short offline	   Completed without error	   00%	 17824		 -
# 6  Short offline	   Completed without error	   00%	 17818		 -
# 7  Short offline	   Completed without error	   00%	 17812		 -
# 8  Short offline	   Completed without error	   00%	 17806		 -
# 9  Short offline	   Completed without error	   00%	 17800		 -
#10  Short offline	   Completed without error	   00%	 17794		 -
#11  Short offline	   Completed without error	   00%	 17788		 -
#12  Short offline	   Completed without error	   00%	 17782		 -
#13  Short offline	   Completed without error	   00%	 17776		 -
#14  Short offline	   Completed without error	   00%	 17770		 -
#15  Short offline	   Completed without error	   00%	 17764		 -
#16  Short offline	   Completed without error	   00%	 17758		 -
#17  Short offline	   Completed without error	   00%	 17752		 -
#18  Short offline	   Completed without error	   00%	 17746		 -
#19  Short offline	   Completed without error	   00%	 17740		 -
#20  Short offline	   Completed without error	   00%	 17734		 -
#21  Short offline	   Completed without error	   00%	 17728		 -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


Unless you purposely truncated most of the useful data from your SMART results, you smartctl -a should return all of the above information if it has true physical access to your hard drives.

Using an eSATA enclosures may place another piece of hardware in between ZFS and your drives, effectively nullifying the benefit of ZFS. To properly house your drives in an external enclosure, you need to use an exclosure with a proper SATA/SAS expander.

There is a really nice section in the hardware guide that discusses eSATA and SATA port multipliers:

SATA Port Multipliers

These really deserve a category of their own. They’re universally crap. Beyond that, there are a few additional reasons why they would never be a good choice:

  •  Intel SATA, which is the only 100% reliable SATA solution out there, explicitly does not support port multipliers.

    o Even WD knows this. When they released a hybrid 120GB SSD/1TB HDD, they could not use a port multiplier to connect them both to a single SATA port. They were forced to use a custom controller that handled both spinning rust and NAND flash and mapped the first LBAs onto flash and the rest onto disk.

  •  The most common application for SATA port multipliers are eSATA chassis. Those are also universally crap in their own right, with issues from bad cooling to dodgy PSUs.

  •  They’re cheap alternatives to SAS expanders. They’re just a cash grab.

  •  Many also do even more horrible stuff, like hardware RAID for the enclosures mentioned

    above – yes, on tiny chips with essentially no resources. Yes, they’re a disaster.
Click to expand...

While FreeNAS is, well, free, their are certain hardware considerations that should be followed. If you choose not to follow clearly communicated requirements, then the risk is 100% yours.

Cheers,
 
J

James L

Dabbler
Joined
Jan 13, 2017
Messages
15
Scharbag said:
Code:
smartctl -a /dev/da20
smartctl 6.5 2016-05-07 r4318 [FreeBSD 10.3-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 Crucial/Micron RealSSD C300/M500
Device Model:	 Crucial_CT480M500SSD1
Serial Number:	14331D8B1F36
LU WWN Device Id: 5 00a075 10c2b1f36
Firmware Version: MU05
User Capacity:	480,103,981,056 bytes [480 GB]
Sector Sizes:	 512 bytes logical, 4096 bytes physical
Rotation Rate:	Solid State Device
Form Factor:	  2.5 inches
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ATA8-ACS T13/1699-D revision 6
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:	Sun Jan 15 12:52:01 2017 CST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Enabled.
Self-test execution status:	  (   0)	The previous self-test routine completed
					without error or no self-test has ever
					been run.
Total time to complete Offline
data collection:		 ( 2235) seconds.
Offline data collection
capabilities:			  (0x7b) SMART execute Offline immediate.
					Auto Offline data collection on/off support.
					Suspend Offline collection upon new
					command.
					Offline surface scan supported.
					Self-test supported.
					Conveyance Self-test supported.
					Selective Self-test supported.
SMART capabilities:			(0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:		(0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time:	  (   2) minutes.
Extended self-test routine
recommended polling time:	  (  37) minutes.
Conveyance self-test routine
recommended polling time:	  (   3) minutes.
SCT capabilities:			(0x0035)	SCT Status supported.
					SCT Feature Control supported.
					SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAG	 VALUE WORST THRESH TYPE	  UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate	 0x002f   100   100   000	Pre-fail  Always	   -	   0
  5 Reallocated_Sector_Ct   0x0033   100   100   000	Pre-fail  Always	   -	   0
  9 Power_On_Hours		  0x0032   100   100   000	Old_age   Always	   -	   17848
12 Power_Cycle_Count	   0x0032   100   100   000	Old_age   Always	   -	   36
171 Program_Fail_Count	  0x0032   100   100   000	Old_age   Always	   -	   0
172 Erase_Fail_Count		0x0032   100   100   000	Old_age   Always	   -	   0
173 Wear_Leveling_Count	 0x0032   096   096   000	Old_age   Always	   -	   134
174 Unexpect_Power_Loss_Ct  0x0032   100   100   000	Old_age   Always	   -	   21
180 Unused_Rsvd_Blk_Cnt_Tot 0x0033   000   000   000	Pre-fail  Always	   -	   8219
183 SATA_Iface_Downshift	0x0032   100   100   000	Old_age   Always	   -	   0
184 End-to-End_Error		0x0032   100   100   000	Old_age   Always	   -	   0
187 Reported_Uncorrect	  0x0032   100   100   000	Old_age   Always	   -	   0
194 Temperature_Celsius	 0x0022   071   056   000	Old_age   Always	   -	   29 (Min/Max 0/44)
196 Reallocated_Event_Count 0x0032   100   100   000	Old_age   Always	   -	   0
197 Current_Pending_Sector  0x0032   100   100   000	Old_age   Always	   -	   0
198 Offline_Uncorrectable   0x0030   100   100   000	Old_age   Offline	  -	   0
199 UDMA_CRC_Error_Count	0x0032   100   100   000	Old_age   Always	   -	   0
202 Percent_Lifetime_Used   0x0031   096   096   000	Pre-fail  Offline	  -	   4
206 Write_Error_Rate		0x000e   100   100   000	Old_age   Always	   -	   0
210 Success_RAIN_Recov_Cnt  0x0032   100   100   000	Old_age   Always	   -	   0
246 Total_Host_Sector_Write 0x0032   100   100   ---	Old_age   Always	   -	   51911182937
247 Host_Program_Page_Count 0x0032   100   100   ---	Old_age   Always	   -	   1654105725
248 Bckgnd_Program_Page_Cnt 0x0032   100   100   ---	Old_age   Always	   -	   2649136468

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
Num  Test_Description	Status				  Remaining  LifeTime(hours)  LBA_of_first_error
# 1  Short offline	   Completed without error	   00%	 17848		 -
# 2  Short offline	   Completed without error	   00%	 17842		 -
# 3  Short offline	   Completed without error	   00%	 17836		 -
# 4  Short offline	   Completed without error	   00%	 17830		 -
# 5  Short offline	   Completed without error	   00%	 17824		 -
# 6  Short offline	   Completed without error	   00%	 17818		 -
# 7  Short offline	   Completed without error	   00%	 17812		 -
# 8  Short offline	   Completed without error	   00%	 17806		 -
# 9  Short offline	   Completed without error	   00%	 17800		 -
#10  Short offline	   Completed without error	   00%	 17794		 -
#11  Short offline	   Completed without error	   00%	 17788		 -
#12  Short offline	   Completed without error	   00%	 17782		 -
#13  Short offline	   Completed without error	   00%	 17776		 -
#14  Short offline	   Completed without error	   00%	 17770		 -
#15  Short offline	   Completed without error	   00%	 17764		 -
#16  Short offline	   Completed without error	   00%	 17758		 -
#17  Short offline	   Completed without error	   00%	 17752		 -
#18  Short offline	   Completed without error	   00%	 17746		 -
#19  Short offline	   Completed without error	   00%	 17740		 -
#20  Short offline	   Completed without error	   00%	 17734		 -
#21  Short offline	   Completed without error	   00%	 17728		 -

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.


Unless you purposely truncated most of the useful data from your SMART results, you smartctl -a should return all of the above information if it has true physical access to your hard drives.

Using an eSATA enclosures may place another piece of hardware in between ZFS and your drives, effectively nullifying the benefit of ZFS. To properly house your drives in an external enclosure, you need to use an exclosure with a proper SATA/SAS expander.

There is a really nice section in the hardware guide that discusses eSATA and SATA port multipliers:



While FreeNAS is, well, free, their are certain hardware considerations that should be followed. If you choose not to follow clearly communicated requirements, then the risk is 100% yours.

Cheers,
Click to expand...

Thanks for the response. Yes I did truncate the results in the earlier file. Here is the complete detailed output. It certainly appears to me that the HDDs on the SATA Expander support SMART capability, but maybe I'm not reading it right.

James
 

Attachments

  • HWDiagsDetailed.txt
    76 KB · Views: 236
Scharbag

Scharbag

Guru
Joined
Feb 1, 2012
Messages
620
Probably going to have to chalk it up to something that 9.10.x does not like about the eSATA swarf then. Not a great technical answer but alas, there are some things that might be best to avoid with FreeNAS.
 
J

James L

Dabbler
Joined
Jan 13, 2017
Messages
15
Scharbag said:
Probably going to have to chalk it up to something that 9.10.x does not like about the eSATA swarf then. Not a great technical answer but alas, there are some things that might be best to avoid with FreeNAS.
Click to expand...

Alas, it was my only option for this machine to support 6 drives.
 
Status
Not open for further replies.

Similar threads

T
  • Locked
All my ZFS volumes crashed. Plse help.
Replies
4
Views
2K
cyberjock
C
P
  • Locked
Home user - should I upgrade my ancient version (9.3)?
Replies
4
Views
1K
danb35
danb35
hilton8r
  • Locked
SOLVED Error getting available space
Replies
5
Views
3K
Ericloewe
Ericloewe
R
  • Locked
FreeNas 9.3 GUI upgrade corrupted USB key
Replies
9
Views
2K
rbrookstx
R
cstanley
  • Locked
Upgrade from 9.10 to latest causing CCB errors
Replies
3
Views
1K
dlavigne
D
Top