New NAS box - how many CRC errors is "acceptable"?

[demon]

I've nearly finished a build of a new NAS box (decided to switch from a Coffee Lake Xeon E-2136 to a Coffee Lake-R E-2288G; running 8 Seagate Exos X16 drives), and was testing the drives with the sol.net test script. I had been testing over the course of about 10 days, and received 14 CRC errors (in both dmesg and SMART output, so I'm sure that they were real). I ordered new MiniSAS cables (the drives are connected to an LSI SAS 9211-8i HBA, and yes, running P20 IT firmware) and replaced the old ones, and have been testing for 3 days so far. In that period, it's received one more CRC error on a new run.

Would that be within acceptable margins? My existing NAS build has one CRC error in total over its current drives' entire operational lifetime, so hopefully this won't be a regular occurrence. The commands are reissued immediately and it seems to carry on fine, and I've verified no medium errors so far in testing.

 

[JaimieV]

UDMA_CRC_Error_Count is that? I've only ever got those from dodgy cables/interfaces. I'd suggest pulling the cables off and putting them on again a few times, break up any surface gunge on the connectors. Current build (new cables and SAS card) has zero.

If you're getting Raw_Read_Error_Rate as well, that would warrant further investigation. If not, keep an eye on them but no panic.

 

[demon]

That's correct, yes. Based on another post found elsewhere, it looks like for Seagates you have to do a little adjusting of the value. After doing that, it seems the value is 0 for all drives:

Code:

root@europa[~]# for dev in /dev/da[0-7] ; do smartctl -a -v 1,raw48:54 "${dev}" | awk '{ if ($2 == "Raw_Read_Error_Rate") print $0 }' ; done
  1 Raw_Read_Error_Rate     0x000f   081   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   080   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   077   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   084   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   082   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   081   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   082   064   044    Pre-fail  Always       -       0
  1 Raw_Read_Error_Rate     0x000f   083   064   044    Pre-fail  Always       -       0

Considering the amount of drive activity the script is generating, I'm not super concerned (going on 4 days now and just that one CRC error in this round of testing), just want to be careful.

 

[JaimieV]

Bloody Seagate and their daft SMART numbers

 

[Johnnie Black]

One or two CRC errors are OK from time to time, any more than that I would consider not normal, though the number you mention it's not that bad.

and yes, running P20 IT firmware

Make sure it's p20.00.07.00, earlier p20 releases have kownn issues, one of them is abnormal CRC errors.

 

[demon]

I am:

Code:

mps0: Firmware: 20.00.07.00, Driver: 21.02.00.00-fbsd

 

[demon]

Day 5 and no new CRC errors registered, so I think I’m safe to call this good to go. Thanks!

 

[powderMonkey]

Hello - first post here - I am looking for this sol.net test script. Every link I find to it is dead, most were posted in 2016. This seems to be the newest conversation about it. Can you point me in the right direction please? : ) Thanks!

 

[demon]

Hello - first post here - I am looking for this sol.net test script. Every link I find to it is dead, most were posted in 2016. This seems to be the newest conversation about it. Can you point me in the right direction please? : ) Thanks!

I downloaded it from:

ftp://ftp.sol.net/incoming/solnet-array-test-v2.sh

I just pulled it down a couple weeks ago, so I know that link works.

That link came from the following post:

solnet-array-test

Back in the late '90's, I was managing a bunch of large whitebox storage servers. For the largest of these, I had the pleasure of building and deploying a massive storage server, 8 shelves of 9 drives each, Seagate ST173404LW 73GB drives, a...

www.ixsystems.com

 

[Redcoat]

That link's dead this morning. Author @jgreco will likely advise status.

 

[demon]

I just downloaded it on my Linux machine with no issues.

Edit: If someone really can't download it from that FTP link, try this:

solnet-array-test-v2.sh

Nextcloud - a safe home for all your data

nextcloud.now.ai

 

[Redcoat]

Both links working now... Thx @demon

 

[powderMonkey]

Thanks for the replies guys! Yes that sol.net based link was dead for me earlier as well, but it is working now here also. Thanks for the Nextcloud link too! I grabbed both. ; )

 

[demon]

Just to cap this off, after the one ECC error early on, I observed no further ECC errors in the logs. The new box is up and running in the old one's stead, and everything is humming along nicely.