Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.
10 Gig Networking Primer

10 Gig Networking Primer

Joined
Nov 15, 2016
Messages
28
Thanks
1
Hi,
this card is very cheap! (Chelsio 10GbE Dual SFP+ N320E T320):
is it asking for drama if used inside a Dell T320 to be connected to a 10GB switch?
What eventually the downsides?
Thanks!

EDIT: apparently the "SFN6122F" suggested in the 10Gig primer is cheap as well: I guess it makes a better choice ;)
 
Joined
Jan 6, 2016
Messages
31
Thanks
9
I can confirm that N320E is running very hot (maybe because very high power consumption). From what i read, SFN6122F doesn't have this issue. :)


I am also thinking to buy a Solarflare SFN6122F for using with pfSense running in ESXI 6.7. It's a good choice?

Regards!
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
11,656
Thanks
2,946
I can confirm that N320E is running very hot (maybe because very high power consumption). From what i read, SFN6122F doesn't have this issue. :)


I am also thinking to buy a Solarflare SFN6122F for using with pfSense running in ESXI 6.7. It's a good choice?

Regards!
I've slowly been swapping out Intel X520's for SFN6122's in our hypervisors over the last half year. I am *very* pleased with them, but I haven't been daring enough to install any in distant data centers (where smarthands cost is an issue and I prefer the proven track record of the Intels).
 

kdragon75

FreeNAS Expert
Joined
Aug 7, 2016
Messages
2,376
Thanks
552
I've slowly been swapping out Intel X520's for SFN6122's in our hypervisors over the last half year. I am *very* pleased with them, but I haven't been daring enough to install any in distant data centers (where smarthands cost is an issue and I prefer the proven track record of the Intels).
Have you taken any measurements on the power consumption? I wonder if it worth swapping mine out.
 

Mlovelace

FreeNAS Expert
Joined
Aug 19, 2014
Messages
1,043
Thanks
258
Have you taken any measurements on the power consumption? I wonder if it worth swapping mine out.
The power consumption for the Solarflare cards are rated for 5.9W-typical, while the Intel cards are listed as 14.4W-maximum and 4.8W-typical. Anecdotally I will say the Solarflare cards do seem to run a bit cooler, but I would also say the Intel cards don't run particularly hot either. At least when you compare them to the early versions of the Chelsio/Qlogic cards that is.
 
Joined
Oct 20, 2011
Messages
72
Thanks
2
I've slowly been swapping out Intel X520's for SFN6122's in our hypervisors over the last half year. I am *very* pleased with them, but I haven't been daring enough to install any in distant data centers (where smarthands cost is an issue and I prefer the proven track record of the Intels).
Re: smarthands -ain't that the truth???? In Australia, to plug in a USB external drive - over $200 (USD)!
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
11,656
Thanks
2,946
Re: smarthands -ain't that the truth???? In Australia, to plug in a USB external drive - over $200 (USD)!
I remember years ago having a client pay $175/hr for some acute issue to a "major player" where we needed a power cycle (not a reset) of a server. This was in the mid-2000's before IPMI was really popular and when the 24-in-4U layout was still brand new; the power and reset switches on the AIC RMC4E2-XP were on the back panel.

246.jpg

248.jpg

We knew that a failed disk could hard-wedge the 3Ware RAID controller. Smarthands had no problem pulling the correct disk. But sometimes it's the simple things that get you...

So if you look at the bottom right of the back panel you'll notice a red and a black button, plus symbols for power and reset. Spent over an hour trying multiple "power cycles" because that was the only way to clear the 3Ware RAID card. Turns out the dum-eff had been pressing the red button when he'd been told to "power cycle" the unit, and the other dum-eff on the other end of the phone line (i.e. me) hadn't picked up on this. We kept going through this long ~ten minute boot cycle and the 3Ware card would just hang (because the controller had crashed).

Needless to say I was not impressed that "smarthands" couldn't identify the symbol for power.
 
Joined
May 19, 2017
Messages
527
Thanks
158
"950W 3 + 1 hot-swap redundant power supply" :eek:

My NAS is feeling totally inadequate now. Only one 650W power supply (and that runs at <25% of capacity at peak, 13% during idle)
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
11,656
Thanks
2,946
Have you taken any measurements on the power consumption? I wonder if it worth swapping mine out.
Random bench server X is 174 watts with no 10G.

Same server is 191 watts with two X520's (that's two cards of two ports each) and SX optics.

Same server is 185 watts with two SFN6122's and SX optics.

To me that looks like each SFN6122 is taking about 6 watts and each X520 is taking about 9 watts.

Note that this is relatively unscientific. This is measuring the load at the plug, which is always jittery, and I only measured with two cards (even though we have a bunch of each of these).
 

jgreco

Resident Grinch
Moderator
Joined
May 29, 2011
Messages
11,656
Thanks
2,946
"950W 3 + 1 hot-swap redundant power supply" :eek:

My NAS is feeling totally inadequate now. Only one 650W power supply (and that runs at <25% of capacity at peak, 13% during idle)
Oh those effin' Zippy-Emacs things were the bane of my existence throughout the 20[04-12] era. That and the crap-grade backplanes AIC used.

The PSU modules were something like 325W each. The problem is that in a facility with redundant A+B power, the loss of a PSU on A meant that if the B rail failed, the other A PSU would be instantly overloaded, and would smoke itself. Then when the B would come back, the ~600W available was really not sufficient to restart the system and things would brownout. And the modules weren't real high quality, so modules blew with somewhat alarming regularity.

If anyone ever wondered why I go on such a tear when people under-size PSU's, ... ah, experience.

But that was what it was like in the early days of SATA. We were one of the earliest shops doing large scale SATA storage servers for FreeBSD.
 
Top