SecCon
Contributor
- Joined
- Dec 16, 2017
- Messages
- 175
This is a test setup, no data can be compromised.
SMB. Windows environment. 11.2.
Doing occasional filecopies to and from FreeNAS to test. The way I copy the files are using Windows Explorer (which frankly HAS to work), the files are on my WSRV FS and I copy them via my Desktop to my NAS (which frankly also HAS to work), so three physical machines are involved over a GB network.
Had like 40 media files, from 1-3GB each in size, and started copying as above and after seconds I started to get warnings from FreeNAS via NetData and also via system notifications. The copy stalled at about 50%, transfer rates also stalled, from an average of 60-80Mbit/s to 7 and even down to 300KBit/s and also 0.
A few hours after the filecopy I got this as part of my preconfigured daily report:
The messages from NetData are , in order of reception:
Now, I get that some of this is related to heavy disk, ram and net activity while copying these about 100GB of files, but frankly, other from the most obvious stuff related to that, WHAT IS THE FREENAS TRYING TO TELL ME?
The daily output is 70% incomprehensible jibberish, to me.
I hope someone can tell me, based on given info, why the filecopy stalled. My hardware is listed in the signature and I can post additional info as requested, of course.
SMB. Windows environment. 11.2.
Doing occasional filecopies to and from FreeNAS to test. The way I copy the files are using Windows Explorer (which frankly HAS to work), the files are on my WSRV FS and I copy them via my Desktop to my NAS (which frankly also HAS to work), so three physical machines are involved over a GB network.
Had like 40 media files, from 1-3GB each in size, and started copying as above and after seconds I started to get warnings from FreeNAS via NetData and also via system notifications. The copy stalled at about 50%, transfer rates also stalled, from an average of 60-80Mbit/s to 7 and even down to 300KBit/s and also 0.
A few hours after the filecopy I got this as part of my preconfigured daily report:
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 d8 f4 58 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 d8 f4 58 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 e0 bb 8b 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 e0 bb 8b 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 e0 d1 8b 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 e0 d1 8b 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 60 ee 8b 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 60 ee 8b 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 e0 fd 8b 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 e0 fd 8b 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
(ada2:ahcich3:0:0:0): RES: 51 04 28 9e e7 47 00 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
(ada2:ahcich3:0:0:0): RES: 51 04 28 9e e7 47 00 00 00 00 00
(ada2:ahcich3:0:0:0): Error 5, Retries exhausted
(ada2:ahcich3:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
(ada2:ahcich3:0:0:0): RES: 51 04 28 9e e7 47 00 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): FLUSHCACHE48. ACB: ea 00 00 00 00 40 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 04 (ABRT )
(ada2:ahcich3:0:0:0): RES: 51 04 28 9e e7 47 00 00 00 00 00
(ada2:ahcich3:0:0:0): Error 5, Retries exhausted
ahcich3: Timeout on slot 23 port 0
ahcich3: is 00000000 cs 00000000 ss ff8001ff rs ff8001ff tfd 40 serr 00000000 cmd 0004c817
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 88 34 8c 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: Command timeout
(ada2:ahcich3:0:0:0): Retrying command
ahcich3: AHCI reset: device not ready after 31000ms (tfd = 00000080)
ahcich3: Timeout on slot 9 port 0
ahcich3: is 00000000 cs 00000000 ss 00000000 rs 00000200 tfd 150 serr 00000000 cmd 0004c917
(aprobe0:ahcich3:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich3:0:0:0): CAM status: Command timeout
(aprobe0:ahcich3:0:0:0): Retrying command
ahcich3: Timeout on slot 2 port 0
ahcich3: is 00000000 cs 00000000 ss 0000003c rs 0000003c tfd 40 serr 00000000 cmd 0004c517
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 88 78 8c 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: Command timeout
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 88 94 8c 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 88 94 8c 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 88 b1 8c 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 88 b1 8c 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 88 cd 8c 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 88 cd 8c 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 08 ed 8c 48 00 00 00 00 80 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 08 ed 8c 48 08 00 00 80 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 88 09 8d 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 88 09 8d 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
ahcich3: Timeout on slot 20 port 0
ahcich3: is 00000000 cs 00000000 ss 7ff00000 rs 7ff00000 tfd 40 serr 00000000 cmd 0004de17
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 08 48 8d 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: Command timeout
(ada2:ahcich3:0:0:0): Retrying command
ahcich3: AHCI reset: device not ready after 31000ms (tfd = 00000080)
ahcich3: Timeout on slot 31 port 0
ahcich3: is 00000000 cs 00000000 ss 00000000 rs 80000000 tfd 150 serr 00000000 cmd 0004df17
(aprobe0:ahcich3:0:0:0): ATA_IDENTIFY. ACB: ec 00 00 00 00 40 00 00 00 00 00 00
(aprobe0:ahcich3:0:0:0): CAM status: Command timeout
(aprobe0:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 88 60 8d 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 88 60 8d 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
ahcich3: Timeout on slot 5 port 0
ahcich3: is 00000000 cs 00000000 ss 0000ffe0 rs 0000ffe0 tfd 40 serr 00000000 cmd 0004cf17
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 48 a0 8d 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: Command timeout
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 48 b9 8d 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 48 b9 8d 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 c8 d5 8d 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 c8 d5 8d 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 48 f3 8d 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 48 f3 8d 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 c8 12 8e 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 c8 12 8e 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_DMA. ACB: ca 00 c8 30 8e 48 00 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 51 (DRDY SERV ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 51 10 c8 30 8e 48 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 48 5f 8e 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 48 5f 8e 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 80 c8 91 8e 40 08 00 00 00 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 c8 91 8e 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
(ada2:ahcich3:0:0:0): WRITE_FPDMA_QUEUED. ACB: 61 00 48 aa 8e 40 08 00 00 01 00 00
(ada2:ahcich3:0:0:0): CAM status: ATA Status Error
(ada2:ahcich3:0:0:0): ATA status: 41 (DRDY ERR), error: 10 (IDNF )
(ada2:ahcich3:0:0:0): RES: 41 10 48 aa 8e 40 08 00 00 00 00
(ada2:ahcich3:0:0:0): Retrying command
ahcich3: Timeout on slot 1 port 0
ahcich3: is 00000000 cs 00000002 ss 00000000 rs 00000002 tfd c0 serr 00000000 cmd 0004c117
The messages from NetData are , in order of reception:
system.ram Chart ram in use = 90.8%
system RAM usage Alarm ram Family WARNING Severity
pv4.tcphandshake Chart ipv4 tcphandshake last collected secs = 00:00:11 ago
number of seconds since the last successful data collection Alarm tcp Family WARNING Severity
ipv4.udperrors Chart ipv4 udperrors last collected secs = 00:00:11 ago
number of seconds since the last successful data collection Alarm udp Family WARNING Severity
system.ram Chart ram in use (was warning for 10 seconds)
system RAM usage Alarm ram Family Recovered from WARNING Severity
disk_util.ada2 Chart 10min disk utilization = 98.4%
the percentage of time the disk was busy, during the last 10 minutes Alarm ada2 Family CRITICAL Severity
ipv4.tcphandshake Chart ipv4 tcphandshake last collected secs (was warning for 12 minutes and 47 seconds)
number of seconds since the last successful data collection Alarm tcp Family Recovered from WARNING Severity
ipv4.udperrors Chart ipv4 udperrors last collected secs (was warning for 12 minutes and 47 seconds)
number of seconds since the last successful data collection Alarm udp Family Recovered from WARNING Severity
system.ram Chart ram in use = 90.3%
system RAM usage Alarm ram Family WARNING Severity
system.ram Chart ram in use (was warning for 10 seconds)
system RAM usage Alarm ram Family Recovered from WARNING Severity
disk_util.ada2 Chart 10min disk utilization (alarm was raised for 18 minutes and 2 seconds)
the percentage of time the disk was busy, during the last 10 minutes Alarm ada2 Family Recovered from WARNING Severity
Now, I get that some of this is related to heavy disk, ram and net activity while copying these about 100GB of files, but frankly, other from the most obvious stuff related to that, WHAT IS THE FREENAS TRYING TO TELL ME?
The daily output is 70% incomprehensible jibberish, to me.
I hope someone can tell me, based on given info, why the filecopy stalled. My hardware is listed in the signature and I can post additional info as requested, of course.
Last edited: