My new 48 bay build.

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
Niiiiiiice! LOL, going to give backblaze a run for their money there, Chris?
I am seriously considering buying a second chassis because I like it so much.
 
Last edited:

Nick2253

Wizard
Joined
Apr 21, 2014
Messages
1,633
Like I've said, the Noctua NH-D9L should fit. It's not really cheap, but the quality is great, especially the quality of the fan.
The best part of the Noctuas is the installation, very clean and easy. A child could do the installation without a problem.

I'll second the Noctua recommendation. Their selling point is that they are silent, but the only way they can be silent is because they do such a good job with the heat exchange. You could easily replace the fan with a higher CFM model if that wasn't enough cooling for you.

However, I can't believe that your CPU is actually getting that hot if it's not under load. I wonder if you mounted the heatsink 90 degrees from how it needs to be mounted. I'm assuming you thoroughly cleaned both the CPU and the cooler, and installed quality thermal paste?
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I'll second the Noctua recommendation. Their selling point is that they are silent, but the only way they can be silent is because they do such a good job with the heat exchange.
I ordered the Noctua cooler. If I am lucky, it might be here in time for the weekend. I will update.
However, I can't believe that your CPU is actually getting that hot if it's not under load.
Sitting mostly idle, right now, the average core temp is 40c. The screen capture I posted a few days ago was under load and it maxed out at 73c. It is within the thermal limit for the CPU, but I don't like it. I don't know if you looked at all the posts, but I just changed the CPU cooler to try to get less sound under load. The old one kept it cool but at the cost of undesired sound, this one is quiet but at the cost of undesired heat.
Here it the photo of the new CPU cooler:
20180206_180940[1].jpg
And this is the thermal compound. I have been using this or Arctic Silver for the past 6 years:
20180206_181033[1].jpg
 
Joined
Apr 9, 2015
Messages
1,258
Wouldn't do me any good. Can't afford to fill it with disks!

No need to fill it with disks right away. Buy one disk per month or every other month and end up with a couple vDev's in the pool. Probably wouldn't want to go larger than 12 in a vDev but that is still a bunch of storage. Plus with that many drives you can buy cheapo 1 or 2 TB drives and still end up with a huge amount of space.

If I didn't need to do what I do for my truck and pick up the 10G switch I would have already put in an offer. But the injectors and O2 sensors are already on the way as is the LB6M.
 

Nick2253

Wizard
Joined
Apr 21, 2014
Messages
1,633
I don't know if you looked at all the posts, but I just changed the CPU cooler to try to get less sound under load.
Yeah, I saw that. That's why I was asking about the mounting angle. Some heatsinks are sensitive to orientation (their heat pipes align a certain way, and pretty much all CPUs have rectangular dies), and that was the first thought that popped into my head. I don't know anything about that particular heatsink, but it looks like it should do a better job than what it's doing.
 

loch_nas

Explorer
Joined
Jun 13, 2015
Messages
79
@Chris Moore: You would not need an extra thermal paste for the Noctua. It's always delivered with a small tube of good quality thermal paste. What's also nice of Noctua is the fact that they will send you a new retention kit (at least here in Europe) for free for future sockets if the sockets change.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
Wouldn't do me any good. Can't afford to fill it with disks!
Not all at once. Pace yourself. I only have 16 in mine right now. I am planning to do another pool of mirrored drives to use for iSCSI. It will take me a little time to get the drives together. It is a long term plan.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I don't know anything about that particular heatsink, but it looks like it should do a better job than what it's doing.
This is the second CPU cooler like this that I have used and the other one worked fine. I do have it oriented so the exhaust air blows toward the rear of the case, which is how it is intended to be used. It is really made for a 2U chassis and I am guessing it was designed to be just enough cooling to prevent the CPU from thermal throttling.
 
Last edited:

wraith

Contributor
Joined
Dec 21, 2015
Messages
102
You sound pleased with your Chenbro purchase! Given your experience with servers, and that Chenbro is easier to buy than Supermicro in W Australia, I might give these a closer look [emoji3]
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
There are some advantages to using a Supermicro chassis, I have three of them in addition to this at home and manage many more of them at work, however, I am very happy with this new chassis. The seller is trying to get them out of inventory because they are now discontinued. The hardware is not "latest generation" but I have a factory fresh system for a fraction of the new (original) price and it is working perfectly fine for me. I am happy with it, so happy that I am seriously considering buying a second one to replace the 24 bay Supermicro chassis I have.
This system is new production and the fans are very quiet, for a server, but if you find one of the older versions of this chassis, your fans might be loud.
I have this in my home office about six feet from my desk and it is great. My wife says it makes less noise than the Suppermicro chassis that it replaced and that is a win.
 
Last edited:
Joined
Apr 9, 2015
Messages
1,258
Well..... My zCash is up about 500 so I contacted the seller on ebay about this for local pickup and offered 350 cash at the same time. Save them a few bucks on fees and the work to ship it out. Who knows maybe.

Plus the wife said it would be ok. Will just have to get shorter coolers but I have twenty bucks in credit with Newegg waiting to be spent.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I had a minor emergency today. I deleted (overwrite) a file I needed with an older copy of the same file by mistake. I initially panicked.
Just for a second, because I remembered I have a snapshot schedule that keeps a snapshot every 15 minutes for the past hour and it was only 9 minutes after 2. I went to my 2 PM snapshot, grabbed the correct version of the file and it was like the weight of the world was lifted from me. I don't often make mistakes like that. Seriously, it has been years, but I love snapshots. It is one of the best things. Maybe better than ice-cream.
 
Joined
Apr 9, 2015
Messages
1,258

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I think I found the ultimate way to build those drives out. Pick up two of these and put backblaze out of business tonight. https://www.newegg.com/Product/Prod..._re=1tb_hard_drive-_-9SIAFCN6S84354-_-Product

I think 400TB worth of drives will have you sitting pretty.
I don't know, that works out to $922.75 ish per drive. I think I can find a better value, but I won't be needing that much storage any time soon. My plan was to create another pool for storing VMs and that will probably be smaller capacity drives in a pool of mirrors.
 
Joined
Apr 9, 2015
Messages
1,258
Yeah, it was just hilarious that they are packaging twenty together.

Anyway, sold off the zCash and bought the case. Going to hopefully pick it up tomorrow. It's a lot cheaper than a hundred bucks to drive to OKC plus I will stop and have something to eat while I am down there. Otherwise it will have to wait till Tuesday when I am on my way through town.

Have to get a pair of coolers since I doubt my Hyper 212 Evo's will fit since I had to give a little space in the 4U I am using now. I imagine I will have to pick up SAS cables as well so be next month sometime before I get things done.

If anyone is looking to pick one up between OKC and Branson, MO let me know, I have to drive out there on the 15th and head back on the 16th so I can save you some cash on one of them as far as shipping goes.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
I received my replacement CPU cooler on Thursday, so I will be installing it this weekend. I will try to get some good photos.
Yes, it needs two SAS cables (one per backplane) but you can use two for each backplane, I just didn't see the need.

PS. This is the email output with my drive temps:
Code:
+------+------------------+----+-----+-----+-----+-------+-------+--------+------+----------+------+-------+----+
|Device|Serial			|Temp|Power|Start|Spin |ReAlloc|Current|Offline |Seek  |Total	 |High  |Command|Last|
|	  |Number			|	|On   |Stop |Retry|Sectors|Pending|Uncorrec|Errors|Seeks	 |Fly   |Timeout|Test|
|	  |				  |	|Hours|Count|Count|	   |Sectors|Sectors |	  |		  |Writes|Count  |Age |
+------+------------------+----+-----+-----+-----+-------+-------+--------+------+----------+------+-------+----+
|da0   |Z4Z3xxxx		  | 29 |10726|   27|	0|	  0|	  0|	   0|	 1|  32350262|	 1|	  0|   0|
|da1   |Z305xxxx		  | 28 | 3942|   11|	0|	  0|	  0|	   0|	 0|  19391749|	 0|	  0|   0|
|da2   |Z305xxxx		  | 28 | 3957|   13|	0|	  0|	  0|	   0|	 0|  19954659|	 0|	  0|   0|
|da3   |Z4Z3xxxx		  | 28 |10520|   27|	0|	  0|	  0|	   0|	 1|  30853325|	 0|	  0|   0|
|da4   |Z4Z3xxxx		  | 28 |10518|   25|	0|	  0|	  0|	   0|	 0|  31348029|	 2|	  0|   0|
|da5   |W4Z2xxxx		  | 28 |10522|   29|	0|	  0|	  0|	   0|	 0|  29942034|	 3|	  0|   0|
|da6   |W4J1xxxx		  | 28 | 7486|   59|	0|	  0|	  0|	   0|	 0| 871291032|	 0|	  6|   0|
|da7   |W4J1xxxx		  | 29 | 7486|   55|	0|	  0|	  0|	   0|	 0| 880695001|	 0|	  6|   0|
|da8   |Z307xxxx		  | 28 | 4069|   42|	0|	  0|	  0|	   0|	 0|  15086013|	 0|	  0|   0|
|da9   |Z307xxxx		  | 28 | 6647|   85|	0|	  0|	  0|	   0|	 0|  16963190|	 0|	  0|   0|
|da10  |Z307xxxx		  | 27 | 6287|   44|	0|	  0|	  0|	   0|	 0|  16350404|	 0|	  0|   0|
|da11  |Z307xxxx		  | 28 | 7568|   77|	0|	  0|	  0|	   0|	 0|  18977799|	 0|	  0|   0|
|da12  |W4Z2xxxx		  | 28 |12703|   74|	0|	  0|	  0|	   0|	 0|  61060236|	 1|	  0|   0|
|da13  |Z4Z2xxxx		  | 28 | 7071|  101|	0|	  0|	  0|	   0|	 0|  55613043|	 3|	  0|   0|
|da14  |W4J1xxxx		  | 29 | 7486|   54|	0|	  0|	  0|	   0|	 0| 864333219|	 0|	  0|   0|
|da15  |W4J1xxxx		  | 28 | 7461|   55|	0|	  0|	  0|	   0|	 0| 868276935|	 0|	  0|   0|
|ada0  |PEPR3215005112xxxx|	| 6471|	0|	 |	  0|	   |		|   N/A|	   N/A|   N/A|	N/A|   0|
|ada1  |NZ05T772xxxx	  | 35 |14665|  119|	0|	  0|	  0|	   0|	 0|	  3825|   N/A|	N/A|   0|
|ada2  |NZ05T772xxxx	  | 35 |14664|  124|	0|	  0|	  0|	   0|	 0|	  2130|   N/A|	N/A|   0|
+------+------------------+----+-----+-----+-----+-------+-------+--------+------+----------+------+-------+----+
The drives are staying (to me) plenty cool, even ada1 and ada2 (the boot drives) that are at the very back of the chassis.

About those boxes of 20 drives, we have bought some like that at work. In fact, I have a box of the Western Digital Gold 6TB drives in my supply cabinet right now. I just can't see spending that kind of money at home (when it is my money) and I don't have that much data.
At work, we are looking at buying a 60 drive server loaded with 10TB drives to replace our 60 drive server that is loaded with 6TB drives. The 'old' server would move to a different network and keep being used, but that is just an example of why a box of 20 drives isn't so crazy, just not what I need at home.
 
Last edited:

LTCM

Dabbler
Joined
Jul 16, 2017
Messages
44
Yeah, it was just hilarious that they are packaging twenty together.

Anyway, sold off the zCash and bought the case. Going to hopefully pick it up tomorrow. It's a lot cheaper than a hundred bucks to drive to OKC plus I will stop and have something to eat while I am down there. Otherwise it will have to wait till Tuesday when I am on my way through town.

Have to get a pair of coolers since I doubt my Hyper 212 Evo's will fit since I had to give a little space in the 4U I am using now. I imagine I will have to pick up SAS cables as well so be next month sometime before I get things done.

If anyone is looking to pick one up between OKC and Branson, MO let me know, I have to drive out there on the 15th and head back on the 16th so I can save you some cash on one of them as far as shipping goes.

Wow. With no shipping cost you got an insane deal. I mean, I'm kinda jealous. If they had another one available I would probably make them an offer but it looks like they only have a three pack left.
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
Wow. With no shipping cost you got an insane deal. I mean, I'm kinda jealous. If they had another one available I would probably make them an offer but it looks like they only have a three pack left.
This same seller has had these listed off and on all year (last year) and I imagine they would make a deal if you send them a message.
 
Joined
Apr 9, 2015
Messages
1,258
Yeah since they are so close to me it's just a quick drive down and grab it. Picked it up about 1:15 today. Really nice guy. Looks like they are just moving into the building they have as they didn't even have desks all together. From what I was told they are going to have a good amount of stuff coming in. Said he will have a bunch of DDR3 ECC RAM soon in 16GB and 32GB sizes. Was also talking about some large SAN but those are gonna be high dollar and not really useful to me.
 
Top