Replacing mirrored USB to one SSD?

[Farfenkugell]

Hello,

At the moment I am running FreeNAS 11.1 on HP Microserver Gen10 x3216, with 16GB RAM and 4x4 HDD in ZFS1.
OS itself is running fine after some tweaks to make it work, but I am struggling with boot device.
At the moment it is set to run from 16GB Kingston dtse9 x2 (they are made from metal, thought this would give some needed cooling for longevity), yes size is a bit overkill, yet this config is driving me nuts.
Constantly I get that one drive is either "Degraded" or "ONLINE One or more devices has experienced an error resulting in data corruption. Applications may be affected.".

When that happens I cannot even detach it, page throws an exception and I have to force de-tach it via shell, I take USB out test it, check it and it is, in fact, running fine, I put it back and a few weeks later, the same issue. I replace it with different USB but the same model, a few weeks later, the same issue...

Now I bought SanDisk Cruzer FIT x2 in order to replace them, but apparently, I cannot mirror it, as Kingston is 15.7 GB and SanDisk is 15.5 GB...

So my question or rather inquiry for the recommendation. I know that "Best Practice" is kinda run it from two USB, but is it if I need it for just minimal use?

Should I just re-install to these SanDisk Cruzer cleanly or just buy cheap SSD and use it instead?
My FreeNAS is for home use only, mostly media storage (plex), that is practically it at the moment.

 

[wblock]

I know that "Best Practice" is kinda run it from two USB

No. It used to be, but things have changed. SSDs are cheap and far more reliable than USB sticks. Mirrored SSDs are fine, also.

Should I just re-install to these SanDisk Cruzer cleanly or just buy cheap SSD and use it instead?

Use an SSD.

 

[Farfenkugell]

No. It used to be, but things have changed. SSDs are cheap and far more reliable than USB sticks. Mirrored SSDs are fine, also.
Use an SSD.

Doubt there are enough free ports to have SSD mirrored, so it would be just one SSD, mostly Transcend SSD SSD370S 32GB SATA3 2,5'' 7mm which is cheap and small.

 

[wblock]

mostly Transcend SSD SSD370S 32GB SATA3 2,5'' 7mm which is cheap and small.

Don't aim for small, aim for reliable. A 120G is fine, and probably not much more expensive than a 32G.

 

[Farfenkugell]

I don't really need big SSD, yet not sure how to decide on reliable.
Bought 4TB x4 WD Red, got one out of box dead... and that is for NAS drives which should run for years without any issues...
Reading reviews does not help much either as that changes year by year.
I have two Kingston SSD on my desktop computer, so far no issues in 3 years..yet their USB are just a ***** of *****

Also speaking of best practice, is it still better to NOT use hardware raid and use FreeNAS software raid as that is how it is in my config now.
Or this has changed and I can use hardware raid and then provide access to it from FreeNAS?

 

[wblock]

A 120G SSD is not really very big, and the extra space does have some use. I have explained this so many times here that I just put it in the manual to save time. This will be in the next release:

SSDs (Solid State Disks) are fast and reliable, and make very good FreeNAS operating system devices. Their one disadvantage is that they require a disk connection which might be needed for storage disks.
Even a relatively large SSD (120 or 128 GB) is useful as a boot device. While it might appear that the unused space is wasted, that space is instead used internally by the SSD for wear leveling. This makes the SSD last longer and provides greater reliability.

Hardware RAID is a mistake with ZFS. ZFS has always needed direct access to the drives, and the boot device is no different.

 

[Farfenkugell]

Yea, now when you said that, it makes sense as how SSD works to have it bigger.
Ordered 120 GB WD Green.

 

[cobrakiller58]

just thought i'd add some info for anyone else considering the transcend TS32GSSD370S I've installed them and have been using for boot and system dataset for over 6 months I really have nothing to complain about i've posted the smart data for anyone interested.

Show : ADA0

Code:

smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 SiliconMotion based SSDs
Device Model:	 TS32GSSD370S
Serial Number:	D648240052
Firmware Version: O1225G
User Capacity:	32,017,047,552 bytes [32.0 GB]
Sector Size:	  512 bytes logical/physical
Rotation Rate:	Solid State Device
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:	Wed Jan 17 13:09:20 2018 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
										was never started.
										Auto Offline Data Collection: Disabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(	0) seconds.
Offline data collection
capabilities:					(0x71) SMART execute Offline immediate.
										No Auto Offline data collection support.
										Suspend Offline collection upon new
										command.
										No Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0002) Does not save SMART data before
										entering power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   1) minutes.
Extended self-test routine
recommended polling time:		(   1) minutes.
Conveyance self-test routine
recommended polling time:		(   1) minutes.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAG	 VALUE WORST THRESH TYPE	  UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate	 0x0000   100   100   000	Old_age   Offline	  -	   0
  5 Reallocated_Sector_Ct   0x0000   100   100   000	Old_age   Offline	  -	   0
  9 Power_On_Hours		  0x0000   100   100   000	Old_age   Offline	  -	   147
 12 Power_Cycle_Count	   0x0000   100   100   000	Old_age   Offline	  -	   45
160 Uncorrectable_Error_Cnt 0x0000   100   100   000	Old_age   Offline	  -	   0
161 Valid_Spare_Block_Cnt   0x0000   100   100   000	Old_age   Offline	  -	   155
163 Initial_Bad_Block_Count 0x0000   100   100   000	Old_age   Offline	  -	   9
164 Total_Erase_Count	   0x0000   100   100   000	Old_age   Offline	  -	   291238
165 Max_Erase_Count		 0x0000   100   100   000	Old_age   Offline	  -	   203
166 Min_Erase_Count		 0x0000   100   100   000	Old_age   Offline	  -	   101
167 Average_Erase_Count	 0x0000   100   100   000	Old_age   Offline	  -	   139
168 Max_Erase_Count_of_Spec 0x0000   100   100   000	Old_age   Offline	  -	   3000
169 Remaining_Lifetime_Perc 0x0000   100   100   000	Old_age   Offline	  -	   96
175 Program_Fail_Count_Chip 0x0000   100   100   000	Old_age   Offline	  -	   0
176 Erase_Fail_Count_Chip   0x0000   100   100   000	Old_age   Offline	  -	   0
177 Wear_Leveling_Count	 0x0000   100   100   050	Old_age   Offline	  -	   310
178 Runtime_Invalid_Blk_Cnt 0x0000   100   100   000	Old_age   Offline	  -	   0
181 Program_Fail_Cnt_Total  0x0000   100   100   000	Old_age   Offline	  -	   0
182 Erase_Fail_Count_Total  0x0000   100   100   000	Old_age   Offline	  -	   0
192 Power-Off_Retract_Count 0x0000   100   100   000	Old_age   Offline	  -	   27
194 Temperature_Celsius	 0x0000   100   100   000	Old_age   Offline	  -	   14
195 Hardware_ECC_Recovered  0x0000   100   100   000	Old_age   Offline	  -	   152
196 Reallocated_Event_Count 0x0000   100   100   016	Old_age   Offline	  -	   0
197 Current_Pending_Sector  0x0000   100   100   000	Old_age   Offline	  -	   0
198 Offline_Uncorrectable   0x0000   100   100   000	Old_age   Offline	  -	   0
199 UDMA_CRC_Error_Count	0x0000   100   100   050	Old_age   Offline	  -	   0
232 Available_Reservd_Space 0x0000   100   100   000	Old_age   Offline	  -	   100
241 Host_Writes_32MiB	   0x0000   100   100   000	Old_age   Offline	  -	   68662
242 Host_Reads_32MiB		0x0000   100   100   000	Old_age   Offline	  -	   2705
245 TLC_Writes_32MiB		0x0000   100   100   000	Old_age   Offline	  -	   145619

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
	6		0	65535  Read_scanning was never started
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Show : ADA1

Code:

smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 SiliconMotion based SSDs
Device Model:	 TS32GSSD370S
Serial Number:	D648240049
Firmware Version: O1225G
User Capacity:	32,017,047,552 bytes [32.0 GB]
Sector Size:	  512 bytes logical/physical
Rotation Rate:	Solid State Device
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 (minor revision not indicated)
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:	Wed Jan 17 13:10:42 2018 EST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
										was never started.
										Auto Offline Data Collection: Disabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(	0) seconds.
Offline data collection
capabilities:					(0x71) SMART execute Offline immediate.
										No Auto Offline data collection support.
										Suspend Offline collection upon new
										command.
										No Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0002) Does not save SMART data before
										entering power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   1) minutes.
Extended self-test routine
recommended polling time:		(   1) minutes.
Conveyance self-test routine
recommended polling time:		(   1) minutes.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAG	 VALUE WORST THRESH TYPE	  UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate	 0x0000   100   100   000	Old_age   Offline	  -	   0
  5 Reallocated_Sector_Ct   0x0000   100   100   000	Old_age   Offline	  -	   0
  9 Power_On_Hours		  0x0000   100   100   000	Old_age   Offline	  -	   147
 12 Power_Cycle_Count	   0x0000   100   100   000	Old_age   Offline	  -	   45
160 Uncorrectable_Error_Cnt 0x0000   100   100   000	Old_age   Offline	  -	   0
161 Valid_Spare_Block_Cnt   0x0000   100   100   000	Old_age   Offline	  -	   155
163 Initial_Bad_Block_Count 0x0000   100   100   000	Old_age   Offline	  -	   9
164 Total_Erase_Count	   0x0000   100   100   000	Old_age   Offline	  -	   292003
165 Max_Erase_Count		 0x0000   100   100   000	Old_age   Offline	  -	   201
166 Min_Erase_Count		 0x0000   100   100   000	Old_age   Offline	  -	   100
167 Average_Erase_Count	 0x0000   100   100   000	Old_age   Offline	  -	   139
168 Max_Erase_Count_of_Spec 0x0000   100   100   000	Old_age   Offline	  -	   3000
169 Remaining_Lifetime_Perc 0x0000   100   100   000	Old_age   Offline	  -	   96
175 Program_Fail_Count_Chip 0x0000   100   100   000	Old_age   Offline	  -	   0
176 Erase_Fail_Count_Chip   0x0000   100   100   000	Old_age   Offline	  -	   0
177 Wear_Leveling_Count	 0x0000   100   100   050	Old_age   Offline	  -	   313
178 Runtime_Invalid_Blk_Cnt 0x0000   100   100   000	Old_age   Offline	  -	   0
181 Program_Fail_Cnt_Total  0x0000   100   100   000	Old_age   Offline	  -	   0
182 Erase_Fail_Count_Total  0x0000   100   100   000	Old_age   Offline	  -	   0
192 Power-Off_Retract_Count 0x0000   100   100   000	Old_age   Offline	  -	   27
194 Temperature_Celsius	 0x0000   100   100   000	Old_age   Offline	  -	   14
195 Hardware_ECC_Recovered  0x0000   100   100   000	Old_age   Offline	  -	   161
196 Reallocated_Event_Count 0x0000   100   100   016	Old_age   Offline	  -	   0
197 Current_Pending_Sector  0x0000   100   100   000	Old_age   Offline	  -	   0
198 Offline_Uncorrectable   0x0000   100   100   000	Old_age   Offline	  -	   0
199 UDMA_CRC_Error_Count	0x0000   100   100   050	Old_age   Offline	  -	   0
232 Available_Reservd_Space 0x0000   100   100   000	Old_age   Offline	  -	   100
241 Host_Writes_32MiB	   0x0000   100   100   000	Old_age   Offline	  -	   68690
242 Host_Reads_32MiB		0x0000   100   100   000	Old_age   Offline	  -	   2671
245 TLC_Writes_32MiB		0x0000   100   100   000	Old_age   Offline	  -	   146001

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
	6		0	65535  Read_scanning was never started
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

 

[Farfenkugell]

Re-did my whole setup, two weeks later, my boot device, now from SSD, is shown as degraded.
This time it is after "Scrub Run".

Guessing that is normal due to high load at that time? So there is nothing to worry?

 

[MrToddsFriends]

[...] my boot device, now from SSD, is shown as degraded. This time it is after "Scrub Run". Guessing that is normal due to high load at that time?

No, a degraded state of any pool is anything but normal. Please show us the output (preferably in CODE tags please) of
zpool status -v freenas-boot (alternatively screenshot of System -> Boot -> Status)

and
smartctl -x boot-device (possibly requires some command line fiddling to transfer the whole output into a forum posting)

where in the 2nd command boot-device has to be replaced by the name of your boot device, for example /dev/ada0.

 

[Farfenkugell]

Status:

Issue right away after scrub run:

Code:

smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.1-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Device Model:	 WDC WDS120G2G0A-00JH30
Serial Number:	174781457404
LU WWN Device Id: 5 001b44 4a9eb706d
Firmware Version: UE300000
User Capacity:	120,040,980,480 bytes [120 GB]
Sector Size:	  512 bytes logical/physical
Rotation Rate:	Solid State Device
Form Factor:	  2.5 inches
Device is:		Not in smartctl database [for details use: -P showall]
ATA Version is:   ACS-2 T13/2015-D revision 3
SATA Version is:  SATA 3.2, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:	Sun Jan 28 23:55:24 2018 EET
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
DSN feature is:   Unavailable
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Unavailable

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x00)	Offline data collection activity
					was never started.
					Auto Offline Data Collection: Disabled.
Self-test execution status:	  (  32)	The self-test routine was interrupted
					by the host with a hard or soft reset.
Total time to complete Offline
data collection:		 (  120) seconds.
Offline data collection
capabilities:			 (0x15) SMART execute Offline immediate.
					No Auto Offline data collection support.
					Abort Offline collection upon new
					command.
					No Offline surface scan supported.
					Self-test supported.
					No Conveyance Self-test supported.
					No Selective Self-test supported.
SMART capabilities:			(0x0003)	Saves SMART data before entering
					power-saving mode.
					Supports SMART auto save timer.
Error logging capability:		(0x01)	Error logging supported.
					General Purpose Logging supported.
Short self-test routine
recommended polling time:	 (   2) minutes.
Extended self-test routine
recommended polling time:	 (  21) minutes.

SMART Attributes Data Structure revision number: 1
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAGS	VALUE WORST THRESH FAIL RAW_VALUE
  5 Reallocated_Sector_Ct   -O--CK   100   100   000	-	0
  9 Power_On_Hours		  -O--CK   100   100   000	-	204
 12 Power_Cycle_Count	   -O--CK   100   100   000	-	9
165 Unknown_Attribute	   -O--CK   100   100   000	-	19
166 Unknown_Attribute	   -O--CK   100   100   ---	-	1
167 Unknown_Attribute	   -O--CK   100   100   ---	-	0
168 Unknown_Attribute	   -O--CK   100   100   ---	-	3
169 Unknown_Attribute	   -O--CK   100   100   ---	-	255
170 Unknown_Attribute	   -O--CK   100   100   ---	-	0
171 Unknown_Attribute	   -O--CK   100   100   000	-	0
172 Unknown_Attribute	   -O--CK   100   100   000	-	0
173 Unknown_Attribute	   -O--CK   100   100   000	-	1
174 Unknown_Attribute	   -O--CK   100   100   000	-	4
184 End-to-End_Error		-O--CK   100   100   ---	-	0
187 Reported_Uncorrect	  -O--CK   100   100   000	-	0
188 Command_Timeout		 -O--CK   100   100   ---	-	0
194 Temperature_Celsius	 -O---K   072   031   000	-	28 (Min/Max 0/31)
199 UDMA_CRC_Error_Count	-O--CK   100   100   ---	-	0
230 Unknown_SSD_Attribute   -O--CK   100   100   000	-	21476147205
232 Available_Reservd_Space PO--CK   100   100   005	-	100
233 Media_Wearout_Indicator -O--CK   100   100   ---	-	38
234 Unknown_Attribute	   -O--CK   100   100   000	-	107
241 Total_LBAs_Written	  ----CK   100   100   000	-	45
242 Total_LBAs_Read		 ----CK   100   100   000	-	25
244 Unknown_Attribute	   -O--CK   000   100   ---	-	0
							||||||_ K auto-keep
							|||||__ C event count
							||||___ R error rate
							|||____ S speed/performance
							||_____ O updated online
							|______ P prefailure warning

General Purpose Log Directory Version 1
SMART		   Log Directory Version 1 [multi-sector log support]
Address	Access  R/W   Size  Description
0x00	   GPL,SL  R/O	  1  Log Directory
0x01		   SL  R/O	  1  Summary SMART error log
0x02		   SL  R/O	  1  Comprehensive SMART error log
0x03	   GPL	 R/O	 16  Ext. Comprehensive SMART error log
0x04	   GPL,SL  R/O	  8  Device Statistics log
0x06		   SL  R/O	  1  SMART self-test log
0x07	   GPL	 R/O	  1  Extended self-test log
0x10	   GPL	 R/O	  1  NCQ Command Error log
0x11	   GPL	 R/O	  1  SATA Phy Event Counters log
0x30	   GPL,SL  R/O	  9  IDENTIFY DEVICE data log
0x80-0x9f  GPL,SL  R/W	 16  Host vendor specific log
0xa1	   GPL,SL  VS	   1  Device vendor specific log
0xa2	   GPL,SL  VS	   2  Device vendor specific log
0xa3	   GPL,SL  VS	   1  Device vendor specific log
0xa7	   GPL,SL  VS	   1  Device vendor specific log
0xa9	   GPL,SL  VS	   3  Device vendor specific log

Warning! SMART Extended Comprehensive Error Log Structure error: invalid SMART checksum.
SMART Extended Comprehensive Error Log Version: 1 (16 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

Selective Self-tests/Logging not supported

SCT Commands not supported

Device Statistics (GP Log 0x04)
Page  Offset Size		Value Flags Description
0x01  =====  =			   =  ===  == General Statistics (rev 1) ==
0x01  0x008  4			   9  ---  Lifetime Power-On Resets
0x01  0x010  4			 204  ---  Power-on Hours
0x01  0x018  6		94835020  ---  Logical Sectors Written
0x01  0x028  6		52581197  ---  Logical Sectors Read
0x01  0x038  6			 205  ---  Date and Time TimeStamp
0x05  =====  =			   =  ===  == Temperature Statistics (rev 1) ==
0x05  0x008  1			  28  ---  Current Temperature
0x05  0x010  1			  27  ---  Average Short Term Temperature
0x05  0x018  1			   -  ---  Average Long Term Temperature
0x05  0x020  1			  30  ---  Highest Temperature
0x05  0x028  1			  18  ---  Lowest Temperature
0x05  0x030  1			  28  ---  Highest Average Short Term Temperature
0x05  0x038  1			  28  ---  Lowest Average Short Term Temperature
0x05  0x040  1			   -  ---  Highest Average Long Term Temperature
0x05  0x048  1			   -  ---  Lowest Average Long Term Temperature
0x05  0x050  4			   0  ---  Time in Over-Temperature
0x05  0x058  1			  95  ---  Specified Maximum Operating Temperature
0x05  0x060  4			   0  ---  Time in Under-Temperature
0x05  0x068  1			   0  ---  Specified Minimum Operating Temperature
0x07  =====  =			   =  ===  == Solid State Device Statistics (rev 1) ==
0x07  0x008  1			   0  N--  Percentage Used Endurance Indicator
								|||_ C monitored condition met
								||__ D supports DSN
								|___ N normalized value

Pending Defects log (GP Log 0x0c) not supported

SATA Phy Event Counters (GP Log 0x11)
ID	  Size	 Value  Description
0x0003  2			0  R_ERR response for device-to-host data FIS
0x0004  2			0  R_ERR response for host-to-device data FIS
0x0006  2			0  R_ERR response for device-to-host non-data FIS
0x0007  2			0  R_ERR response for host-to-device non-data FIS
0x0009  2			2  Transition from drive PhyRdy to drive PhyNRdy
0x000a  2			3  Device-to-host register FISes sent due to a COMRESET
0x000f  2			0  R_ERR response for host-to-device data FIS, CRC
0x0012  2			0  R_ERR response for host-to-device non-data FIS, CRC
0x0001  2			0  Command failed due to ICRC error

 

[MrToddsFriends]

Sorry, I'm not able to interpret the whole WD SSD smartctl output, maybe someone else can help here. What's the answer of FreeNAS to a Verify Install?
System -> Update -> Verify Install

Did you check the integrity of the WD boot SSD using "the vendor tool designed for that purpose" before putting it into use (being rather sure that such a thing exists)?
Is your system equipped with ECC RAM and capable of handling ECC?

 

[Farfenkugell]

I have Kingston 8GB 2400MHz DDR4 CL17 UDIMM KVR24E17S8/8 - x2 which is ECC compatible.
I have not verified the integrity of SSD, but practically the same was happening with dual USB, all seems to run fine, but degraded status is shown after the first scrub.
Install verification passes without any issues.
Could it be caused by autotunes? My hardware is a big rareMicroServer Gen10 X3216

 

[MrToddsFriends]

Could it be caused by autotunes? My hardware is a big rareMicroServer Gen10 X3216

All I can say about Autotune is that I never used it and that all I heard about it is that it should not be used under normal conditions. My list of Tunables is and ever was empty (for which the disuse of Autotune is at least partly responsible).

I can't say, though, if the boot pool degradation you are seeing has anything to do with your usage of Autotune.

 

[Farfenkugell]

Hmm... well... I need the top one for the system to boot.
Have no idea what the others do, guessing will have to find out now.

 

[Redcoat]

Looks to me like you should get and run this (copy downloaded from https://www.wdc.com/content/dam/wdc/website/downloadable_assets/eng/spec_data_sheet/2879-800083.pdf ):

"Free WD SSD Dashboard
The downloadable WD SSD
Dashboard provides a suite of tools
so you’re always able to check on
the health of your solid state drive.
Available for free, this WD SSD
Dashboard helps you track things
like disk model, firmware version,
S.M.A.R.T. attributes, or simply find
out how much space you have left
on your WD Green SSD."

and compare the output with what's coming from the FreeNAS version before you jump to judgement.

 

[Stux]

Post the results of running this command

zpool status freenas-boot

 

[Farfenkugell]

Code:

  pool: freenas-boot
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
	corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
	entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 14.5K in 0 days 00:00:06 with 97 errors on Sun Jan 28 03:45:07 2018
config:

	NAME		STATE	 READ WRITE CKSUM
	freenas-boot  DEGRADED	 0	 0	97
	  ada4p2	DEGRADED	 0	 0   207  too many errors

errors: 78 data errors, use '-v' for a list

Code:

  pool: freenas-boot
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
	corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
	entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 14.5K in 0 days 00:00:06 with 97 errors on Sun Jan 28 03:45:07 2018
config:

	NAME		STATE	 READ WRITE CKSUM
	freenas-boot  DEGRADED	 0	 0	97
	  ada4p2	DEGRADED	 0	 0   207  too many errors

errors: 78 data errors, use '-v' for a list
  pool: freenas-boot
 state: DEGRADED
status: One or more devices has experienced an error resulting in data
	corruption.  Applications may be affected.
action: Restore the file in question if possible.  Otherwise restore the
	entire pool from backup.
   see: http://illumos.org/msg/ZFS-8000-8A
  scan: scrub repaired 14.5K in 0 days 00:00:06 with 97 errors on Sun Jan 28 03:45:07 2018
config:

	NAME		STATE	 READ WRITE CKSUM
	freenas-boot  DEGRADED	 0	 0	97
	  ada4p2	DEGRADED	 0	 0   207  too many errors

errors: Permanent errors have been detected in the following files:

		<metadata>:<0x3b>
		<metadata>:<0x3d>
		<metadata>:<0x4a>
		<metadata>:<0x60>
		<metadata>:<0x6c>
		<metadata>:<0x7c>
		/boot/grub/fonts
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:<0x0>
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/ctypes/macholib
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/form/nls/id
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/ctypes/macholib/__pycache__
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/share/ctdb/tests/eventd/scripts
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/share/ctdb/tests/events.d
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/perl5/site_perl/mach/5.24/auto
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/share/ctdb/tests/eventscripts
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/perl5/5.24/Unicode/UCD.pm
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/freenasUI/static/lib/js/dstore/docs
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/botocore/vendored/requests/__pycache__/status_codes.cpython-36.opt-1.pyc
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/freenasUI/static/lib/js/dstore/extensions
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/freenasUI/static/lib/js/dstore/legacy
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/freenasUI/static/lib/js/freeadmin
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/pt
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/ro
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/paramiko
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/paramiko/__pycache__
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/ru
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/form/nls/fr
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/form/nls/he
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/sk
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/azure/storage/__pycache__/retry.cpython-36.opt-1.pyc
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/django/contrib/admin
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/django/contrib/admin/__pycache__
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/form/nls/hr
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/sl
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/Crypto/SelfTest/Signature/test_vectors/PKCS1-PSS
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/form/nls/hu
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/daemon/__pycache__/pidfile.cpython-36.opt-1.pyc
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/lib/python3.6/site-packages/django/core/management/__pycache__/color.cpython-36.opt-1.pyc
		freenas-boot/ROOT/11.1-U1@2018-01-20-15:40:24:/usr/local/www/dojo/dojox/atom/widget/nls/sr
		freenas-boot/ROOT/11.1-U1:<0x0>
		//usr/local/lib/migrate93/django/contrib/formtools/tests/wizard/wizardtests/templates
		//
		//usr/local/lib/python3.6/site-packages/botocore/docs/bcdoc/__pycache__/docevents.cpython-36.pyc
		//usr/local/www/freenasUI/templates/plugins
		//usr/local/lib/migrate93/django/contrib/gis/db/models/sql/__pycache__
		//usr/local/lib/python3.6/site-packages/south/db/__pycache__
		//usr/local/include/git2
		//usr/local/www/freenasUI/templates/registration
		//usr/local/lib/migrate93/django/contrib/gis/forms/__pycache__
		//usr/local/lib/python3.6/site-packages/south/db/sql_server/__pycache__
		//usr/local/lib/migrate93/django/contrib/gis/gdal/__pycache__
		//usr/local/lib/python3.6/site-packages/aiohttp/__pycache__/client_exceptions.cpython-36.opt-1.pyc
		//usr/local/lib/python3.6/site-packages/django/utils/__pycache__/deprecation.cpython-36.opt-1.pyc
		//usr/local/lib/python3.6/site-packages/south/hacks/__pycache__
		//usr/local/lib/python3.6/site-packages/botocore/data/xray
		//usr/local/lib/python3.6/site-packages/botocore/docs
		//usr/local/lib/python3.6/site-packages/south/introspection_plugins/__pycache__
		//usr/local/lib/python3.6/site-packages/raven/data/cacert.pem
		//usr/local/lib/python3.6/site-packages/pkg_resources/_vendor/__pycache__/__init__.cpython-36.opt-1.pyc
		//usr/local/lib/python3.6/site-packages/markupsafe/__pycache__/_compat.cpython-36.opt-1.pyc
		//usr/local/lib/python3.6/site-packages/botocore/docs/bcdoc
		//usr/local/lib/python3.6/site-packages/south/management/__pycache__
		//usr/local/www/dojo/dojox/editor/plugins/nls/kk
		//usr/local/www/dojo/dojox/form/nls/eu
		//usr/local/lib/python3.6/site-packages/south/management/commands/__pycache__
		//usr/local/www/dojo/dojox/editor/plugins/nls/pt-pt
		//usr/local/lib/python3.6/site-packages/django/templatetags/__pycache__/l10n.cpython-36.opt-1.pyc
		//usr/local/www/freenasUI/templates/documentation
		//usr/local/www/freenasUI/templates/freeadmin
		//usr/local/www/freenasUI/templates/jails
		//usr/local/lib/migrate93/django/contrib/formtools/tests/wizard/namedwizardtests/__pycache__
		//usr/local/lib/python3.6/site-packages/botocore/vendored
		//usr/local/www/dojo/dojox/editor/plugins/nls/nb
		//usr/local/lib/python3.6/site-packages/django/core/mail/backends/__pycache__
		//usr/local/lib/migrate93/django/contrib/formtools/tests/wizard/wizardtests/__pycache__
		//usr/local/lib/migrate93/django/contrib/gis/db/models/__pycache__
		//usr/local/lib/python3.6/site-packages/south/creator/__pycache__
		//usr/local/lib/python3.6/site-packages/botocore/vendored/requests

 

[Farfenkugell]

Disabled all tunables, except the one which I have created now cannot even get past grub "error compression algorithm inherit not supported"... yai...

 

[Farfenkugell]

Fresh install, volume/pool re-imported, smb shares re-created, ALL Settings left to default, except one autotune to be able to boot FreeNAS. Still re-creating Jails after messing their permissions.