Scrub speeds

[Bhoot]

currently I’m sitting on about 15tb data which is mostly a bin for all devices in my family and I’m the safe keeper :p.
My scrubs last 5 days and their frequency has been reduced to once a month which again I would say I’m doing it at a risk. Any way (for e.g. upgrading cpu) I can speed this up? I’m planning large
hard
disks and theoretically if I double the capacity I’m guessing the scrub times will also go to double (assuming a linear trajectory). I think I shall get nightmares if the scrubs run for 10-12 days in a month.

 

[Chris Moore]

currently I’m sitting on about 15tb data which is mostly a bin for all devices in my family and I’m the safe keeper :p.
My scrubs last 5 days and their frequency has been reduced to once a month which again I would say I’m doing it at a risk. Any way (for e.g. upgrading cpu) I can speed this up? I’m planning large tracts disks and theoretically if I double the capacity I’m guessing the scrub times will also go to double (assuming a linear trajectory). I think I shall get nightmares if the scrubs run for 10-12 days in a month.

Looking at it on Tapatalk, I can't see if you have some information in the signature.
What hardware are you using?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Bhoot]

Looking at it on Tapatalk, I can't see if you have some information in the signature.
What hardware are you using?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

Thanks for the quick reply.
I’m I do have it in my signature
Here is a paste from there
ASUS Z10PA-U8
PROCESSOR: iNTEL Xeon E52609v3 + Intel Fan
RAM: CRUCIAL 32GB (16x2)DDR4-2133 1.2v RDIMM 288p (CT16G4RFD4213)
HDD: WD RED 4tbx8
OS USB: 2x Cruzer Fit 16gb (mirror)
PSU: Coolermaster 750 gold
FreeNAS 9.3 Stable

 

[Bhoot]

Also you might want to know all hard disks are connector directly to the board 6gbps no hba used.

 

[Chris Moore]

It looks like the 1.9 GHz CPU to me.
I have a system at work that is storing 150TB and the scrubs on it usually only take about 3.5 to 4 days.
My system at home will complete a scrub in 4 to 5 hours with about 8TB of data.

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Bhoot]

It looks like the 1.9 GHz CPU to me.
I have a system at work that is storing 150TB and the scrubs on it usually only take about 3.5 to 4 days.
My system at home will complete a scrub in 4 to 5 hours with about 8TB of data.

Sent from my SAMSUNG-SGH-I537 using Tapatalk

150tb in 4 days? That’s dream speeds for me. I should say there is fragmentation on my pool but I think it’s not the same as windows; also could the 75% of the pool filled cause issues?

 

[Chris Moore]

150tb in 4 days? That’s dream speeds for me. I should say there is fragmentation on my pool but I think it’s not the same as windows; also could the 75% of the pool filled cause issues?

Being 75% full should slow it down, yes, but not that much.
What were you planning on doing to expand your pool?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Bhoot]

Being 75% full should slow it down, yes, but not that much.
What were you planning on doing to expand your pool?

Sent from my SAMSUNG-SGH-I537 using Tapatalk

Replace hard disks one at a time. Remember the discussion we had about the golds on another thread?
Since it’s a home server I might choose not to expand ram unless it’s absolutely necessary.

 

[Arwen]

Note that FreeNAS 9.3 does not have the OpenZFS scrub speed improvement. I don't know when the change came to FreeNAS, but I'd guess it would be in the most recent 11.x stable series.

Here are some OpenZFS references:

http://open-zfs.org/w/images/8/8a/New_Scrub_Prefetcher.pdf
http://open-zfs.org/w/images/a/a0/Saso_-_resilver_update.pdf

 

[diskdiddler]

My scrub is about 27 hours for 30TB (90% full)
Weeny CPU though.

 

[sretalla]

My scrub takes about 9.5 hours for just over 20TB used in a 6TBx8 RAIDZ2 pool with just under 10TB free.

I'm running an 8-core Xeon E5-2620 v4, 64GB of ECC Registered RAM, 8 WD Red 6TB (5400 RPM) disks connected to the SATA III ports onboard an ASUS X99-M WS Mobo. FreeNAS-11.1-U1

 

[danb35]

I don't know when the change came to FreeNAS,

It came in with 11.1.

 

[Bhoot]

So will upgrading to 11.1 speed up my scrubs phenomenally? My usage includes mostly plex and Emby serving systems/tvs intranet and remotely to my family members. Would 11.1 cause any negative effects to my requirements?

 

[Chris Moore]

They just released 11.1-U2 and it fixed some bugs that were bothering some people. There is always a possibility that something will break with an update, but it looks great. Just don't try to use the new UI. I understand that it's giving people trouble.

Sent from my SAMSUNG-SGH-I537 using Tapatalk

 

[Chris Moore]

Would 11.1 cause any negative effects to my requirements?

I upgraded without any negative impact. I can't guarantee that you won't have any problem, but I don't understand the idea of not installing upgrades, even if a problem does crop up.

 

[Bhoot]

It's the common philosophy of "if it aint broke don't fix it". Even a few stables have had bugs. Just don't want to see a bug on something that I really need.

 

[Chris Moore]

It's the common philosophy of "if i aint broke don't fix it".

This philosophy is broken. There are things fixed or improved in every release. That is why they make new releases.

 

[Bidule0hm]

This philosophy is broken. There are things fixed or improved in every release. That is why they make new releases.

The problem is when they also break other things at the same time. If they improve a feature you don't use and break one you really need then updating will effectively do more harm than good. That's why I'm still on 9.3, all the features I need (except one but I solved that with a script) works perfectly fine and things like the FN 11 memory leak don't make me want to upgrade any time soon, I'll wait until a more stable version with something new that I want/need (like the scrub/resilver perf increase or the RAID-Z vdev expansion drive by drive).

 

[Bhoot]

-snip-

FreeNAS 11.1 seems to be dropping memory and rebooting without authority. Target solution in 11.2, so I guess I'm sticking to the fresh upgrade to 9.10.