SOLVED Very slow 6 MB/sec read speeds vs 111 MB/sec writes on FreeNAS 11 stable

[entilza72]

Hi team, new FreeNAS user (FreeNAS 11-Stable) on new hardware for video editing needs. I am migrating from an ancient Thecus NAS. While I wait for the new disk order to arrive, I have built the system but am using retired but error free 3x 1TB disks and 1 x 2TB disk to experiment with.

I am having significant Read speed issues on FreeNAS. Write speeds are fantastic. The read speeds are 18 times slower than the writes.

A new and fast Windows 10 PC reports that between it (henceforth "the client") and the FreeNAS box ("the server"), 30 Gb of SMB file copies averages out as:

Writes to FreeNAS: 111 MB/sec. Very happy with that.
Reads from FreeNAS: Between 5 and 7 MB/sec. Unusable.

To be clear, this is not mbps. It is MB/sec.

As a comparison, a ~10 year old Thecus from the same fast PC (client) was giving me:
Writes: ~20 MB/sec.
Reads: ~40-60 MB/sec.

Obviously, something is very wrong with the SMB Read speed. I'm a FreeNAS noob and would appreciate suggestions. I cannot fathom how Reads could be 18 times slower than writes on anything.

Hardware:

• Motherboard: Gigabyte H270N-WIFI LGA 1151 Mini ITX (Has 2 GBE's on it)
• CPU: Intel Core i5 7600K Quad Core LGA 1151 3.8 GHz Unlocked
• RAM: Kingston 16GB 2133MHz DDR4 CL14 DIMMs (Kit of 2)
• Thermaltake Toughpower SFX 450W 80+ Gold Full Modular PSU
• Noctua NH-L9x65 Lower Profile Multi Socket CPU Cooler

I originally had LACP configured on FreeNAS and the Switch, and it was working great, but removed this (just using 1 interface for the time being now). I also had Jumbo frames configured on FreeNAS, the Switch and the PC (MTU 8000), but removed these too. No performance improvements. N.B. the 111MB/sec write test was conducted under the LACP/Jumbo config and has not been retested since they were stripped.

Switch is a Netgear GS724T, 24x Smart Gigabit Switch. The switch, FreeNAS server and client have all been powercycled.

I will admit I am struggling coming up to speed with ZFS and FreeNAS, so I stumbled for a while to get SMB acting with write access as I do not have a Domain Controller. Any pointers for where to look, or what to post here, are appreciated.

Kind regards,
Ent.

 

[Ericloewe]

That is extremely slow. Could it be the client holding things back with a bottlenecked write speed?

Other things to consider:

• You haven't told us what the pool is configured as. This is rather important.
• One of the disks might be close to failure, having trouble reading but apparently not with writing.
• This might be an obscure network issue, so use iperf to benchmark the networking side of things.
• You don't specify the workload. Better writes than reads are normal, but it would take a pathological case for such an insane difference. I'd expect a decent portion of the 30GB to end up in ARC with 16GB of RAM, too.

 

[entilza72]

Thanks for the direction Ericloewe.

I don't think the client is holding things back on the read, because that client reads 40MB/sec off the 10 year old Thecus NAS (that NAS is presently offline due to PSU issues, so I can't retest). I will borrow an older Win10 PC and test from it to be sure.

You haven't told us what the pool is configured as. This is rather important.

I'll round that up for you tonight and post here.

One of the disks might be close to failure, having trouble reading but apparently not with writing.

Re: a pending disk failure, should SMART report if one of the disks are in decline? SMART is not reporting anything.

This might be an obscure network issue, so use iperf to benchmark the networking side of things

I'll post that tonight too.

You don't specify the workload. Better writes than reads are normal, but it would take a pathological case for such an insane difference. I'd expect a decent portion of the 30GB to end up in ARC with 16GB of RAM, too.

Oh! I thought reads were quicker than writes. Re: Workload, are you meaning "what is being copied and how"? It is a folder with 2 sub folders, each with around 20-40 video (4K mp4) and metadata (text) files. Some files are a few K, while some of the videos go up to 1 or 2 GB, but the majority are somewhere in between these two extremes. Copy process is just straight a Win10 copy/paste from the desktop.

Thanks again for the direction. More info coming when I collect it tonight.

Ent.

 

[Ericloewe]

Re: a pending disk failure, should SMART report if one of the disks are in decline? SMART is not reporting anything.

smartctl -x /dev/adaX should enlighten us. Please use CODE tags when pasting the output on the forum

 

[entilza72]

Hi again,

The initial error appears resolved.

I reran the read test using the same test data I placed on the NAS yesterday. I now get 112 MB/sec reads instead of 6. The only thing that changed was:
1. Its 18 hours later
2. I power cycled all equipment (switch, nas, client PC) at the same time before leaving (but did not retest at that point).

I am satisfied there is no longer a network issue. However my attempt to use iperf resulted in nothing after ten mins, so I broke the client:

Server:

Code:

# iperf -s -w 128k
------------------------------------------------------------
Server listening on TCP port 5001
TCP window size:  128 KByte
------------------------------------------------------------
[  4] local 10.0.2.251 port 5001 connected with 10.0.2.145 port 58310
[ ID] Interval	   Transfer	 Bandwidth
[  4]  0.0-476.9 sec  14.0 Bytes  0.23 bits/sec

Client (win10):

Code:

>iperf3 -c 10.0.2.251 -p 5001 -f m -w 128k
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval		   Transfer	 Bandwidth
iperf3: interrupt - the client has terminated

I'm curious as to why this test gives me nothing (as do other iperf tests) yet I run the same tests as other people in the forum. I do note I am using iperf3 as a client and wonder if this is the cause?

The Pool was previously configured as ZFS1, 3x 1TB disks. However since then, I have removed it and played with creating mirrors etc and found one of my test disks began causing the following middleware error whenever creating a volume in volume manager:
MiddlewareError: b'Unable to GPT format the disk "ada1": gpart: Input/output error

Trying to wipe the same disk causes another middleware error:
MiddlewareError: b'Failed to wipe ada1: dd: /dev/ada1: Operation not permitted

Smartctl tests (below) show ada1 is expected to fail in 24 hours. I guess this is the cause for the formatting errors?

 

[entilza72]

smartctl tests (probably not needed now):

Disks 0 & 1:
(nb disk ada1 is giving me the middleware error on wiping or adding it into the pool - SMART is reporting a failure is expected in 24 hours.)

ada0:

Code:

root@prd-nas-01:~ # smartctl -x /dev/ada0
smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 Western Digital Caviar Black
Device Model:	 WDC WD1002FAEX-00Y9A0
Serial Number:	WD-WCAW30442981
LU WWN Device Id: 5 0014ee 2055dc8b3
Firmware Version: 05.01D05
User Capacity:	1,000,204,886,016 bytes [1.00 TB]
Sector Size:	  512 bytes logical/physical
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 2.6, 6.0 Gb/s
Local Time is:	Mon Oct  9 23:47:29 2017 AEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Disabled
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x84) Offline data collection activity
										was suspended by an interrupting command from host.
										Auto Offline Data Collection: Enabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(16500) seconds.
Offline data collection
capabilities:					(0x7b) SMART execute Offline immediate.
										Auto Offline data collection on/off support.
										Suspend Offline collection upon new
										command.
										Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0003) Saves SMART data before entering
										power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   2) minutes.
Extended self-test routine
recommended polling time:		( 170) minutes.
Conveyance self-test routine
recommended polling time:		(   5) minutes.
SCT capabilities:			  (0x3035) SCT Status supported.
										SCT Feature Control supported.
										SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAGS	VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate	 POSR-K   200   200   051	-	0
  3 Spin_Up_Time			POS--K   175   171   021	-	4225
  4 Start_Stop_Count		-O--CK   099   099   000	-	1014
  5 Reallocated_Sector_Ct   PO--CK   200   200   140	-	0
  7 Seek_Error_Rate		 -OSR-K   200   200   000	-	0
  9 Power_On_Hours		  -O--CK   069   069   000	-	22835
10 Spin_Retry_Count		-O--CK   100   100   000	-	0
11 Calibration_Retry_Count -O--CK   100   253   000	-	0
12 Power_Cycle_Count	   -O--CK   100   100   000	-	57
192 Power-Off_Retract_Count -O--CK   200   200   000	-	53
193 Load_Cycle_Count		-O--CK   200   200   000	-	962
194 Temperature_Celsius	 -O---K   103   095   000	-	44
196 Reallocated_Event_Count -O--CK   200   200   000	-	0
197 Current_Pending_Sector  -O--CK   200   200   000	-	0
198 Offline_Uncorrectable   ----CK   200   200   000	-	0
199 UDMA_CRC_Error_Count	-O--CK   200   200   000	-	0
200 Multi_Zone_Error_Rate   ---R--   200   200   000	-	0
							||||||_ K auto-keep
							|||||__ C event count
							||||___ R error rate
							|||____ S speed/performance
							||_____ O updated online
							|______ P prefailure warning

General Purpose Log Directory Version 1
SMART		   Log Directory Version 1 [multi-sector log support]
Address	Access  R/W   Size  Description
0x00	   GPL,SL  R/O	  1  Log Directory
0x01		   SL  R/O	  1  Summary SMART error log
0x02		   SL  R/O	  5  Comprehensive SMART error log
0x03	   GPL	 R/O	  6  Ext. Comprehensive SMART error log
0x06		   SL  R/O	  1  SMART self-test log
0x07	   GPL	 R/O	  1  Extended self-test log
0x09		   SL  R/W	  1  Selective self-test log
0x10	   GPL	 R/O	  1  SATA NCQ Queued Error log
0x11	   GPL	 R/O	  1  SATA Phy Event Counters log
0x80-0x9f  GPL,SL  R/W	 16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS	  16  Device vendor specific log
0xa8-0xb5  GPL,SL  VS	   1  Device vendor specific log
0xb6	   GPL	 VS	   1  Device vendor specific log
0xb7	   GPL,SL  VS	   1  Device vendor specific log
0xbd	   GPL,SL  VS	   1  Device vendor specific log
0xc0	   GPL,SL  VS	   1  Device vendor specific log
0xc1	   GPL	 VS	  24  Device vendor specific log
0xe0	   GPL,SL  R/W	  1  SCT Command/Status
0xe1	   GPL,SL  R/W	  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:				  3
SCT Version (vendor specific):	   258 (0x0102)
SCT Support Level:				   1
Device State:						Active (0)
Current Temperature:					44 Celsius
Power Cycle Min/Max Temperature:	 44/45 Celsius
Lifetime	Min/Max Temperature:	 26/52 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:	 2
Temperature Sampling Period:		 1 minute
Temperature Logging Interval:		1 minute
Min/Max recommended Temperature:	  0/60 Celsius
Min/Max Temperature Limit:		   -41/85 Celsius
Temperature History Size (Index):	478 (409)

Index	Estimated Time   Temperature Celsius
410	2017-10-09 15:50	45  **************************
411	2017-10-09 15:51	45  **************************
412	2017-10-09 15:52	46  ***************************
...	..(  6 skipped).	..  ***************************
419	2017-10-09 15:59	46  ***************************
420	2017-10-09 16:00	47  ****************************
...	..(  8 skipped).	..  ****************************
429	2017-10-09 16:09	47  ****************************
430	2017-10-09 16:10	46  ***************************
...	..(  6 skipped).	..  ***************************
437	2017-10-09 16:17	46  ***************************
438	2017-10-09 16:18	45  **************************
...	..(  2 skipped).	..  **************************
441	2017-10-09 16:21	45  **************************
442	2017-10-09 16:22	 ?  -
443	2017-10-09 16:23	45  **************************
...	..(  3 skipped).	..  **************************
447	2017-10-09 16:27	45  **************************
448	2017-10-09 16:28	44  *************************
...	..(  4 skipped).	..  *************************
453	2017-10-09 16:33	44  *************************
454	2017-10-09 16:34	43  ************************
...	..( 59 skipped).	..  ************************
  36	2017-10-09 17:34	43  ************************
  37	2017-10-09 17:35	44  *************************
...	..( 21 skipped).	..  *************************
  59	2017-10-09 17:57	44  *************************
  60	2017-10-09 17:58	45  **************************
...	..( 49 skipped).	..  **************************
110	2017-10-09 18:48	45  **************************
111	2017-10-09 18:49	46  ***************************
...	..(214 skipped).	..  ***************************
326	2017-10-09 22:24	46  ***************************
327	2017-10-09 22:25	47  ****************************
...	..( 23 skipped).	..  ****************************
351	2017-10-09 22:49	47  ****************************
352	2017-10-09 22:50	46  ***************************
...	..( 32 skipped).	..  ***************************
385	2017-10-09 23:23	46  ***************************
386	2017-10-09 23:24	45  **************************
...	..( 22 skipped).	..  **************************
409	2017-10-09 23:47	45  **************************

SCT Error Recovery Control command not supported

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID	  Size	 Value  Description
0x0001  2			0  Command failed due to ICRC error
0x0002  2			0  R_ERR response for data FIS
0x0003  2			0  R_ERR response for device-to-host data FIS
0x0004  2			0  R_ERR response for host-to-device data FIS
0x0005  2			0  R_ERR response for non-data FIS
0x0006  2			0  R_ERR response for device-to-host non-data FIS
0x0007  2			0  R_ERR response for host-to-device non-data FIS
0x000a  2			2  Device-to-host register FISes sent due to a COMRESET
0x000b  2			0  CRC errors within host-to-device FIS
0x8000  4		  638  Vendor specific

ada1:

Code:

smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 SAMSUNG SpinPoint F1 DT
Device Model:	 SAMSUNG HD103UJ
Serial Number:	S13PJDWS698702
LU WWN Device Id: 5 0024e9 001afa4cc
Firmware Version: 1AA01118
User Capacity:	1,000,204,886,016 bytes [1.00 TB]
Sector Size:	  512 bytes logical/physical
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ATA/ATAPI-7, ATA8-ACS T13/1699-D revision 3b
Local Time is:	Mon Oct  9 23:49:06 2017 AEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM level is:	 0 (vendor specific), recommended: 254
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, NOT FROZEN [SEC1]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: FAILED!
Drive failure expected in less than 24 hours. SAVE ALL DATA.
See vendor-specific Attribute list for failed Attributes.

General SMART Values:
Offline data collection status:  (0x00) Offline data collection activity
										was never started.
										Auto Offline Data Collection: Disabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(13616) seconds.
Offline data collection
capabilities:					(0x7b) SMART execute Offline immediate.
										Auto Offline data collection on/off support.
										Suspend Offline collection upon new
										command.
										Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0003) Saves SMART data before entering
										power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   2) minutes.
Extended self-test routine
recommended polling time:		( 228) minutes.
Conveyance self-test routine
recommended polling time:		(  24) minutes.
SCT capabilities:			  (0x003f) SCT Status supported.
										SCT Error Recovery Control supported.
										SCT Feature Control supported.
										SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAGS	VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate	 POSR--   099   099   051	-	332
  3 Spin_Up_Time			POS---   005   005   011	NOW  28900
  4 Start_Stop_Count		-O--CK   100   100   000	-	444
  5 Reallocated_Sector_Ct   PO--CK   100   100   010	-	0
  7 Seek_Error_Rate		 POSR--   100   100   051	-	0
  8 Seek_Time_Performance   P-S--K   100   100   015	-	0
  9 Power_On_Hours		  -O--CK   094   094   000	-	32041
10 Spin_Retry_Count		PO--CK   100   100   051	-	0
11 Calibration_Retry_Count -O--C-   100   100   000	-	0
12 Power_Cycle_Count	   -O--CK   100   100   000	-	121
13 Read_Soft_Error_Rate	-OSR--   100   100   000	-	6
183 Runtime_Bad_Block	   -O--CK   100   100   000	-	0
184 End-to-End_Error		PO--CK   100   100   000	-	0
187 Reported_Uncorrect	  -O--CK   100   100   000	-	6
188 Command_Timeout		 -O--CK   100   100   000	-	0
190 Airflow_Temperature_Cel -O---K   065   063   000	-	35 (Min/Max 35/35)
194 Temperature_Celsius	 -O---K   065   057   000	-	35 (Min/Max 35/35)
195 Hardware_ECC_Recovered  -O-RC-   100   100   000	-	10672
196 Reallocated_Event_Count -O--CK   100   100   000	-	0
197 Current_Pending_Sector  -O--C-   100   100   000	-	4
198 Offline_Uncorrectable   ----CK   100   100   000	-	0
199 UDMA_CRC_Error_Count	-OSRCK   100   100   000	-	0
200 Multi_Zone_Error_Rate   -O-R--   100   100   000	-	43
201 Soft_Read_Error_Rate	-O-R--   253   253   000	-	163
							||||||_ K auto-keep
							|||||__ C event count
							||||___ R error rate
							|||____ S speed/performance
							||_____ O updated online
							|______ P prefailure warning

General Purpose Log Directory Version 1
SMART		   Log Directory Version 1 [multi-sector log support]
Address	Access  R/W   Size  Description
0x00	   GPL,SL  R/O	  1  Log Directory
0x01		   SL  R/O	  1  Summary SMART error log
0x02		   SL  R/O	  2  Comprehensive SMART error log
0x03	   GPL	 R/O	  2  Ext. Comprehensive SMART error log
0x04	   GPL	 R/O	  2  Device Statistics log
0x06		   SL  R/O	  1  SMART self-test log
0x07	   GPL	 R/O	  2  Extended self-test log
0x09		   SL  R/W	  1  Selective self-test log
0x10	   GPL	 R/O	  1  SATA NCQ Queued Error log
0x11	   GPL	 R/O	  1  SATA Phy Event Counters log
0x20	   GPL	 R/O	  2  Streaming performance log [OBS-8]
0x21	   GPL	 R/O	  1  Write stream error log
0x22	   GPL	 R/O	  1  Read stream error log
0x80-0x9f  GPL,SL  R/W	 16  Host vendor specific log
0xe0	   GPL,SL  R/W	  1  SCT Command/Status
0xe1	   GPL,SL  R/W	  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (2 sectors)
Device Error Count: 157 (device log contains only the most recent 8 errors)
		CR	 = Command Register
		FEATR  = Features Register
		COUNT  = Count (was: Sector Count) Register
		LBA_48 = Upper bytes of LBA High/Mid/Low Registers ]  ATA-8
		LH	 = LBA High (was: Cylinder High) Register	]   LBA
		LM	 = LBA Mid (was: Cylinder Low) Register	  ] Register
		LL	 = LBA Low (was: Sector Number) Register	 ]
		DV	 = Device (was: Device/Head) Register
		DC	 = Device Control Register
		ER	 = Error register
		ST	 = Status register
Powered_Up_Time is measured from power on, and printed as
DDd+hh:mm:SS.sss where DD=days, hh=hours, mm=minutes,
SS=sec, and sss=millisec. It "wraps" after 49.710 days.

Error 157 [4] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:33.740  READ DMA

Error 156 [3] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:31.830  READ DMA

Error 155 [2] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:29.900  READ DMA

Error 154 [1] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:28.010  READ DMA

Error 153 [0] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:26.100  READ DMA

Error 152 [7] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:24.170  READ DMA

Error 151 [6] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:22.280  READ DMA

Error 150 [5] occurred at disk power-on lifetime: 32041 hours (1335 days + 1 hours)
  When the command that caused the error occurred, the device was active or idle.

  After command completion occurred, registers were:
  ER -- ST COUNT  LBA_48  LH LM LL DV DC
  -- -- -- == -- == == == -- -- -- -- --
  40 -- 51 00 00 00 00 00 40 00 80 40 00  Error: UNC at LBA = 0x00400080 = 4194432

  Commands leading to the command that caused the error were:
  CR FEATR COUNT  LBA_48  LH LM LL DV DC  Powered_Up_Time  Command/Feature_Name
  -- == -- == -- == == == -- -- -- -- --  ---------------  --------------------
  c8 00 00 00 01 00 00 00 40 00 80 40 08	 00:03:20.370  READ DMA

SMART Extended Self-test Log Version: 1 (2 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:				  2
SCT Version (vendor specific):	   256 (0x0100)
SCT Support Level:				   1
Device State:						Active (0)
Current Temperature:				 35 Celsius
Power Cycle Max Temperature:		 35 Celsius
Lifetime	Max Temperature:		 43 Celsius

SCT Temperature History Version:	 2
Temperature Sampling Period:		 1 minute
Temperature Logging Interval:		1 minute
Min/Max recommended Temperature:	 -4/72 Celsius
Min/Max Temperature Limit:		   -9/77 Celsius
Temperature History Size (Index):	128 (100)

Index	Estimated Time   Temperature Celsius
101	2017-10-09 21:42	38  *******************
...	..(  3 skipped).	..  *******************
105	2017-10-09 21:46	38  *******************
106	2017-10-09 21:47	37  ******************
107	2017-10-09 21:48	37  ******************
108	2017-10-09 21:49	37  ******************
109	2017-10-09 21:50	38  *******************
110	2017-10-09 21:51	37  ******************
111	2017-10-09 21:52	38  *******************
...	..( 58 skipped).	..  *******************
  42	2017-10-09 22:51	38  *******************
  43	2017-10-09 22:52	37  ******************
...	..( 46 skipped).	..  ******************
  90	2017-10-09 23:39	37  ******************
  91	2017-10-09 23:40	36  *****************
  92	2017-10-09 23:41	36  *****************
  93	2017-10-09 23:42	35  ****************
...	..(  6 skipped).	..  ****************
100	2017-10-09 23:49	35  ****************

SCT Error Recovery Control:
		   Read: Disabled
		  Write: Disabled

ATA_READ_LOG_EXT (addr=0x04:0x00, page=0, n=1) failed: Input/output error
Read Device Statistics page 0x00 failed

SATA Phy Event Counters (GP Log 0x11)
ID	  Size	 Value  Description
0x000a  2			0  Device-to-host register FISes sent due to a COMRESET
0x0001  2			0  Command failed due to ICRC error
0x0002  2			0  R_ERR response for data FIS
0x0003  2			0  R_ERR response for device-to-host data FIS
0x0004  2			0  R_ERR response for host-to-device data FIS
0x0005  2			0  R_ERR response for non-data FIS
0x0006  2			0  R_ERR response for device-to-host non-data FIS
0x0007  2			0  R_ERR response for host-to-device non-data FIS
0x0008  2			0  Device-to-host non-data FIS retries
0x0009  2			0  Transition from drive PhyRdy to drive PhyNRdy
0x000b  2			0  CRC errors within host-to-device FIS
0x000d  2			0  Non-CRC errors within host-to-device FIS
0x000f  2			0  R_ERR response for host-to-device data FIS, CRC
0x0010  2			0  R_ERR response for host-to-device data FIS, non-CRC
0x0012  2			0  R_ERR response for host-to-device non-data FIS, CRC
0x0013  2			0  R_ERR response for host-to-device non-data FIS, non-CRC

 

[entilza72]

Disks 2 & 3

ada2:

Code:

smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 Western Digital Caviar Black
Device Model:	 WDC WD1001FALS-00J7B1
Serial Number:	WD-WMATV2244685
LU WWN Device Id: 5 0014ee 0ac0f10d9
Firmware Version: 05.00K05
User Capacity:	1,000,204,886,016 bytes [1.00 TB]
Sector Size:	  512 bytes logical/physical
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ATA8-ACS (minor revision not indicated)
SATA Version is:  SATA 2.5, 3.0 Gb/s
Local Time is:	Mon Oct  9 23:50:53 2017 AEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Disabled
APM feature is:   Unavailable
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x84) Offline data collection activity
										was suspended by an interrupting command from host.
										Auto Offline Data Collection: Enabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(19200) seconds.
Offline data collection
capabilities:					(0x7b) SMART execute Offline immediate.
										Auto Offline data collection on/off support.
										Suspend Offline collection upon new
										command.
										Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0003) Saves SMART data before entering
										power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   2) minutes.
Extended self-test routine
recommended polling time:		( 221) minutes.
Conveyance self-test routine
recommended polling time:		(   5) minutes.
SCT capabilities:			  (0x303f) SCT Status supported.
										SCT Error Recovery Control supported.
										SCT Feature Control supported.
										SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAGS	VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate	 POSR-K   200   200   051	-	0
  3 Spin_Up_Time			POS--K   234   227   021	-	8283
  4 Start_Stop_Count		-O--CK   099   099   000	-	1002
  5 Reallocated_Sector_Ct   PO--CK   200   200   140	-	0
  7 Seek_Error_Rate		 -OSR-K   200   200   000	-	0
  9 Power_On_Hours		  -O--CK   056   056   000	-	32801
 10 Spin_Retry_Count		-O--CK   100   100   000	-	0
 11 Calibration_Retry_Count -O--CK   100   100   000	-	0
 12 Power_Cycle_Count	   -O--CK   100   100   000	-	115
192 Power-Off_Retract_Count -O--CK   200   200   000	-	110
193 Load_Cycle_Count		-O--CK   200   200   000	-	1002
194 Temperature_Celsius	 -O---K   107   098   000	-	43
196 Reallocated_Event_Count -O--CK   200   200   000	-	0
197 Current_Pending_Sector  -O--CK   200   200   000	-	0
198 Offline_Uncorrectable   ----CK   200   200   000	-	0
199 UDMA_CRC_Error_Count	-O--CK   200   200   000	-	0
200 Multi_Zone_Error_Rate   ---R--   200   200   000	-	0
							||||||_ K auto-keep
							|||||__ C event count
							||||___ R error rate
							|||____ S speed/performance
							||_____ O updated online
							|______ P prefailure warning

General Purpose Log Directory Version 1
SMART		   Log Directory Version 1 [multi-sector log support]
Address	Access  R/W   Size  Description
0x00	   GPL,SL  R/O	  1  Log Directory
0x01		   SL  R/O	  1  Summary SMART error log
0x02		   SL  R/O	  5  Comprehensive SMART error log
0x03	   GPL	 R/O	  6  Ext. Comprehensive SMART error log
0x06		   SL  R/O	  1  SMART self-test log
0x07	   GPL	 R/O	  1  Extended self-test log
0x09		   SL  R/W	  1  Selective self-test log
0x10	   GPL	 R/O	  1  SATA NCQ Queued Error log
0x11	   GPL	 R/O	  1  SATA Phy Event Counters log
0x80-0x9f  GPL,SL  R/W	 16  Host vendor specific log
0xa0-0xa7  GPL,SL  VS	  16  Device vendor specific log
0xa8-0xb7  GPL,SL  VS	   1  Device vendor specific log
0xc0	   GPL,SL  VS	   1  Device vendor specific log
0xc1	   GPL	 VS	  24  Device vendor specific log
0xe0	   GPL,SL  R/W	  1  SCT Command/Status
0xe1	   GPL,SL  R/W	  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (6 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:				  2
SCT Version (vendor specific):	   258 (0x0102)
SCT Support Level:				   1
Device State:						SMART Off-line Data Collection executing in background (4)
Current Temperature:					43 Celsius
Power Cycle Min/Max Temperature:	 43/43 Celsius
Lifetime	Min/Max Temperature:	 43/52 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Temperature History Version:	 2
Temperature Sampling Period:		 1 minute
Temperature Logging Interval:		1 minute
Min/Max recommended Temperature:	  0/60 Celsius
Min/Max Temperature Limit:		   -41/85 Celsius
Temperature History Size (Index):	128 (57)

Index	Estimated Time   Temperature Celsius
  58	2017-10-09 21:43	44  *************************
 ...	..(  2 skipped).	..  *************************
  61	2017-10-09 21:46	44  *************************
  62	2017-10-09 21:47	45  **************************
 ...	..(  5 skipped).	..  **************************
  68	2017-10-09 21:53	45  **************************
  69	2017-10-09 21:54	44  *************************
 ...	..( 27 skipped).	..  *************************
  97	2017-10-09 22:22	44  *************************
  98	2017-10-09 22:23	43  ************************
 ...	..( 45 skipped).	..  ************************
  16	2017-10-09 23:09	43  ************************
  17	2017-10-09 23:10	44  *************************
 ...	..( 12 skipped).	..  *************************
  30	2017-10-09 23:23	44  *************************
  31	2017-10-09 23:24	43  ************************
 ...	..( 10 skipped).	..  ************************
  42	2017-10-09 23:35	43  ************************
  43	2017-10-09 23:36	 ?  -
  44	2017-10-09 23:37	43  ************************
 ...	..( 12 skipped).	..  ************************
  57	2017-10-09 23:50	43  ************************

SCT Error Recovery Control:
		   Read: Disabled
		  Write: Disabled

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID	  Size	 Value  Description
0x0001  2			0  Command failed due to ICRC error
0x0002  2			0  R_ERR response for data FIS
0x0003  2			0  R_ERR response for device-to-host data FIS
0x0004  2			0  R_ERR response for host-to-device data FIS
0x0005  2			0  R_ERR response for non-data FIS
0x0006  2			0  R_ERR response for device-to-host non-data FIS
0x0007  2			0  R_ERR response for host-to-device non-data FIS
0x000a  2			1  Device-to-host register FISes sent due to a COMRESET
0x8000  4		  847  Vendor specific

ada3:

Code:

smartctl 6.5 2016-05-07 r4318 [FreeBSD 11.0-STABLE amd64] (local build)
Copyright (C) 2002-16, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:	 Seagate Barracuda 7200.14 (AF)
Device Model:	 ST2000DM001-1CH164
Serial Number:	Z2F0XDHL
LU WWN Device Id: 5 000c50 064799627
Firmware Version: CC27
User Capacity:	2,000,398,934,016 bytes [2.00 TB]
Sector Sizes:	 512 bytes logical, 4096 bytes physical
Rotation Rate:	7200 rpm
Form Factor:	  3.5 inches
Device is:		In smartctl database [for details use: -P show]
ATA Version is:   ACS-2, ACS-3 T13/2161-D revision 3b
SATA Version is:  SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:	Mon Oct  9 23:52:03 2017 AEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled
AAM feature is:   Unavailable
APM feature is:   Disabled
Rd look-ahead is: Enabled
Write cache is:   Enabled
ATA Security is:  Disabled, frozen [SEC2]
Wt Cache Reorder: Unavailable

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x82) Offline data collection activity
										was completed without error.
										Auto Offline Data Collection: Enabled.
Self-test execution status:	  (   0) The previous self-test routine completed
										without error or no self-test has ever
										been run.
Total time to complete Offline
data collection:				(  609) seconds.
Offline data collection
capabilities:					(0x7b) SMART execute Offline immediate.
										Auto Offline data collection on/off support.
										Suspend Offline collection upon new
										command.
										Offline surface scan supported.
										Self-test supported.
										Conveyance Self-test supported.
										Selective Self-test supported.
SMART capabilities:			(0x0003) Saves SMART data before entering
										power-saving mode.
										Supports SMART auto save timer.
Error logging capability:		(0x01) Error logging supported.
										General Purpose Logging supported.
Short self-test routine
recommended polling time:		(   1) minutes.
Extended self-test routine
recommended polling time:		( 271) minutes.
Conveyance self-test routine
recommended polling time:		(   2) minutes.
SCT capabilities:			  (0x3085) SCT Status supported.

SMART Attributes Data Structure revision number: 10
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME		  FLAGS	VALUE WORST THRESH FAIL RAW_VALUE
  1 Raw_Read_Error_Rate	 POSR--   108   099   006	-	18775928
  3 Spin_Up_Time			PO----   095   094   000	-	0
  4 Start_Stop_Count		-O--CK   100   100   020	-	34
  5 Reallocated_Sector_Ct   PO--CK   100   100   010	-	0
  7 Seek_Error_Rate		 POSR--   060   054   030	-	1211462169862
  9 Power_On_Hours		  -O--CK   087   087   000	-	11827
 10 Spin_Retry_Count		PO--C-   100   100   097	-	0
 12 Power_Cycle_Count	   -O--CK   100   100   020	-	34
183 Runtime_Bad_Block	   -O--CK   100   100   000	-	0
184 End-to-End_Error		-O--CK   100   100   099	-	0
187 Reported_Uncorrect	  -O--CK   100   100   000	-	0
188 Command_Timeout		 -O--CK   100   100   000	-	0 0 0
189 High_Fly_Writes		 -O-RCK   098   098   000	-	2
190 Airflow_Temperature_Cel -O---K   062   051   045	-	38 (Min/Max 38/39)
191 G-Sense_Error_Rate	  -O--CK   100   100   000	-	0
192 Power-Off_Retract_Count -O--CK   100   100   000	-	32
193 Load_Cycle_Count		-O--CK   051   051   000	-	98105
194 Temperature_Celsius	 -O---K   038   049   000	-	38 (0 20 0 0 0)
197 Current_Pending_Sector  -O--C-   100   100   000	-	0
198 Offline_Uncorrectable   ----C-   100   100   000	-	0
199 UDMA_CRC_Error_Count	-OSRCK   200   200   000	-	0
240 Head_Flying_Hours	   ------   100   253   000	-	3854h+52m+25.482s
241 Total_LBAs_Written	  ------   100   253   000	-	23143415549
242 Total_LBAs_Read		 ------   100   253   000	-	36122813232
							||||||_ K auto-keep
							|||||__ C event count
							||||___ R error rate
							|||____ S speed/performance
							||_____ O updated online
							|______ P prefailure warning

General Purpose Log Directory Version 1
SMART		   Log Directory Version 1 [multi-sector log support]
Address	Access  R/W   Size  Description
0x00	   GPL,SL  R/O	  1  Log Directory
0x01		   SL  R/O	  1  Summary SMART error log
0x02		   SL  R/O	  5  Comprehensive SMART error log
0x03	   GPL	 R/O	  5  Ext. Comprehensive SMART error log
0x06		   SL  R/O	  1  SMART self-test log
0x07	   GPL	 R/O	  1  Extended self-test log
0x09		   SL  R/W	  1  Selective self-test log
0x10	   GPL	 R/O	  1  SATA NCQ Queued Error log
0x11	   GPL	 R/O	  1  SATA Phy Event Counters log
0x21	   GPL	 R/O	  1  Write stream error log
0x22	   GPL	 R/O	  1  Read stream error log
0x80-0x9f  GPL,SL  R/W	 16  Host vendor specific log
0xa1	   GPL,SL  VS	  20  Device vendor specific log
0xa2	   GPL	 VS	4496  Device vendor specific log
0xa8	   GPL,SL  VS	 129  Device vendor specific log
0xa9	   GPL,SL  VS	   1  Device vendor specific log
0xab	   GPL	 VS	   1  Device vendor specific log
0xb0	   GPL	 VS	5176  Device vendor specific log
0xbe-0xbf  GPL	 VS   65535  Device vendor specific log
0xc0	   GPL,SL  VS	   1  Device vendor specific log
0xc1	   GPL,SL  VS	  10  Device vendor specific log
0xc4	   GPL,SL  VS	   5  Device vendor specific log
0xe0	   GPL,SL  R/W	  1  SCT Command/Status
0xe1	   GPL,SL  R/W	  1  SCT Data Transfer

SMART Extended Comprehensive Error Log Version: 1 (5 sectors)
No Errors Logged

SMART Extended Self-test Log Version: 1 (1 sectors)
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
	1		0		0  Not_testing
	2		0		0  Not_testing
	3		0		0  Not_testing
	4		0		0  Not_testing
	5		0		0  Not_testing
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

SCT Status Version:				  3
SCT Version (vendor specific):	   522 (0x020a)
SCT Support Level:				   1
Device State:						Active (0)
Current Temperature:					38 Celsius
Power Cycle Min/Max Temperature:	 38/39 Celsius
Lifetime	Min/Max Temperature:	 20/49 Celsius
Under/Over Temperature Limit Count:   0/0

SCT Data Table command not supported

SCT Error Recovery Control command not supported

Device Statistics (GP/SMART Log 0x04) not supported

SATA Phy Event Counters (GP Log 0x11)
ID	  Size	 Value  Description
0x000a  2			3  Device-to-host register FISes sent due to a COMRESET
0x0001  2			0  Command failed due to ICRC error
0x0003  2			0  R_ERR response for device-to-host data FIS
0x0004  2			0  R_ERR response for host-to-device data FIS
0x0006  2			0  R_ERR response for device-to-host non-data FIS
0x0007  2			0  R_ERR response for host-to-device non-data FIS

 

[entilza72]

I resolved the ada1 middleware errors by replacing the disk with another 1Tb test disk. All works smoothly now.

I still have no idea what was causing the hickup with the read speed. But I'd love a pointer for what I am doing wrong with iperf.

Sorry for the series of posts here. And thanks for the input.

Ent.

 

[Ericloewe]

curious as to why this test gives me nothing (as do other iperf tests) yet I run the same tests as other people in the forum. I do note I am using iperf3 as a client and wonder if this is the cause?

Yes iperf 2 and 3 are incompatible.

 

[Jailer]

I still have no idea what was causing the hickup with the read speed.

Likely the fact that you had a failing drive.

 

[entilza72]

Yes! I guess it probably was the failing drive! As per Ericloewe's suggestion. I somehow overlooked that obvious conclusion.

Thanks folks! I'm excited with the results, I'm getting near gigabit network speed on reads and writes now, couldn't ask for more! Thanks for the pointers to the newbie!

Ent.