ZPool Checksum Errors w/ Win8.1 search

[MDKAOD]

I've had my FreeNAS box up and running for about 6 months now and I've recently added a Windows 8.1 machine to my network. I've noticed, with moderate repeat-ability, that whenever I use Win8's search on a mapped drive to a CIFS share with hundreds of folders and thousands of files I almost always come in the next day to a FreeNAS report of checksum errors on random drives. Typically only one or two error counts.

Is this typical or have I misconfigured something? Is there a better way to search the box without using the "Locate" feature from the command line?

 

[danb35]

Do your ZFS scrubs indicate any errors?

 

[MDKAOD]

Only Checksum,
Previous two occasions:

Code:

  scan: scrub repaired 4K in 0h47m with 0 errors on Tue Jul 15 02:47:23 2014
config:

    NAME                                            STATE     READ WRITE CKSUM
    Volume0                                         ONLINE       0     0     0
      raidz2-0                                      ONLINE       0     0     0
        gptid/2f8c3926-a49b-11e3-a93a-002590d51b96  ONLINE       0     0     0
        gptid/6645ec77-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/66ccabfa-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/21ce8486-a49b-11e3-a93a-002590d51b96  ONLINE       0     0     1
      raidz2-1                                      ONLINE       0     0     0
        gptid/67d800e6-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/685df10c-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/68e190a4-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/6963e59e-a487-11e3-800e-002590d51b96  ONLINE       0     0     0

errors: No known data errors

Code:

  scan: scrub repaired 12K in 0h58m with 0 errors on Fri Aug  1 02:58:19 2014
config:

    NAME                                            STATE     READ WRITE CKSUM
    Volume0                                         ONLINE       0     0     0
      raidz2-0                                      ONLINE       0     0     0
        gptid/2f8c3926-a49b-11e3-a93a-002590d51b96  ONLINE       0     0     0
        gptid/6645ec77-a487-11e3-800e-002590d51b96  ONLINE       0     0     3
        gptid/66ccabfa-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/21ce8486-a49b-11e3-a93a-002590d51b96  ONLINE       0     0     0
      raidz2-1                                      ONLINE       0     0     0
        gptid/67d800e6-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/685df10c-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/68e190a4-a487-11e3-800e-002590d51b96  ONLINE       0     0     0
        gptid/6963e59e-a487-11e3-800e-002590d51b96  ONLINE       0     0     0

errors: No known data errors

 

[danb35]

My guess is that the connection with the Windows search is just that it's scanning through your storage, which is what's triggering the errors. You appear to be having some trouble with your pool, though the fact that it's inconsistent is going to make it hard to track down.

 

[MDKAOD]

Understandable. I don't believe there's any real problem here, just more of a verification that I didn't misconfigure something along the way. Operationally, everything is working great. This is just a hiccup that I don't usually see, but can trigger reliably if needed.

 

[cyberjock]

Then what it looks like is happening is you're having corruption just from regular use. Windows' search is probably causing significant pool usage on the disks which is identifying these problems.

You should probably stop and figure out why your pool is suffering from random bits of corruption. Statistically you should get them from time to time, but not in the quantities you have them in. Somewhere something is wrong with your build and you should fix it before continuing to use it. Since you included none of the stuff the forum rules request when creating a new thread I can't help you any farther than that.

 

[MDKAOD]

You're absolutely correct, my apologies. What I can tell you, I do not see these checksum errors or scrub corrections when Win Search is avoided. I can go weeks with successful scrubs, but as soon as I throw a search in there, I see this.

FreeNAS 9.2.1.5-RELEASE 64 bit
SuperMicro MBD-X9SCL+-F-O, E3-1230V2, 32 GB RAM
3xM1015 RAID cards flashed to IT mode
2x Intel 82574L GbE Controllers

DMESG

Code:

Last login: Mon Jun  2 08:57:51 2014 from 192.168.1.22
FreeBSD 9.2-RELEASE-p4 (FREENAS.amd64) #0 r262572+17a4d3d: Wed Apr 23 10:09:38 P                                   DT 2014

        FreeNAS (c) 2009-2014, The FreeNAS Development Team
        All rights reserved.
        FreeNAS is released under the modified BSD license.

        For more information, documentation, help or support, go here:
        http://freenas.org
Welcome to FreeNAS
Could not chdir to home directory /nonexistent: No such file or directory
[MStafford@library] /% dmesg
Copyright (c) 1992-2013 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
        The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 9.2-RELEASE-p4 #0 r262572+17a4d3d: Wed Apr 23 10:09:38 PDT 2014
    root@build3.ixsystems.com:/tank/home/jkh/build/9.2.1/freenas/os-base/amd64/f                                   usion/jkh/9.2.1/freenas/FreeBSD/src/sys/FREENAS.amd64 amd64
gcc version 4.2.1 20070831 patched [FreeBSD]
CPU: Intel(R) Xeon(R) CPU E3-1230 V2 @ 3.30GHz (3300.09-MHz K8-class CPU)
  Origin = "GenuineIntel"  Id = 0x306a9  Family = 0x6  Model = 0x3a  Stepping =                                    9
  Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,C                                   MOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
  Features2=0x7fbae3ff<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,SMX,EST,TM2,SSSE3,CX                                   16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,x2APIC,POPCNT,TSCDLT,AESNI,XSAVE,OSXSAVE,AVX,F16                                   C,RDRAND>
  AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
  AMD Features2=0x1<LAHF>
  Standard Extended Features=0x281<GSFSBASE,SMEP,ENHMOVSB>
  TSC: P-state invariant, performance statistics
real memory  = 34368126976 (32776 MB)
avail memory = 33135218688 (31600 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <SUPERM SMCI--MB>
FreeBSD/SMP: Multiprocessor System Detected: 8 CPUs
FreeBSD/SMP: 1 package(s) x 4 core(s) x 2 SMT threads
cpu0 (BSP): APIC ID:  0
cpu1 (AP): APIC ID:  1
cpu2 (AP): APIC ID:  2
cpu3 (AP): APIC ID:  3
cpu4 (AP): APIC ID:  4
cpu5 (AP): APIC ID:  5
cpu6 (AP): APIC ID:  6
cpu7 (AP): APIC ID:  7
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
ACPI Warning: FADT (revision 5) is longer than ACPI 2.0 version, truncating leng                                   th 268 to 244 (20110527/tbfadt-320)
ioapic0 <Version 2.0> irqs 0-23 on motherboard
kbd1 at kbdmux0
cryptosoft0: <software crypto> on motherboard
aesni0: <AES-CBC,AES-XTS> on motherboard
padlock0: No ACE support.
acpi0: <SUPERM SMCI--MB> on motherboard
acpi0: Power Button (fixed)
acpi0: reservation of 67, 1 (4) failed
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
cpu2: <ACPI CPU> on acpi0
cpu3: <ACPI CPU> on acpi0
cpu4: <ACPI CPU> on acpi0
cpu5: <ACPI CPU> on acpi0
cpu6: <ACPI CPU> on acpi0
cpu7: <ACPI CPU> on acpi0
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
atrtc0: <AT realtime clock> port 0x70-0x77 irq 8 on acpi0
atrtc0: Warning: Couldn't map I/O.
Event timer "RTC" frequency 32768 Hz quality 0
attimer0: <AT timer> port 0x40-0x43,0x50-0x53 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x408-0x40b on acpi0
pcib0: <ACPI Host-PCI bridge> port 0xcf8-0xcff on acpi0
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> irq 16 at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
mps0: <LSI SAS2008> port 0xe000-0xe0ff mem 0xdfa00000-0xdfa03fff,0xdf980000-0xdf                                   9bffff irq 16 at device 0.0 on pci1
mps0: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd
mps0: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,Even                                   tReplay,HostDisc>
pcib2: <ACPI PCI-PCI bridge> irq 16 at device 1.1 on pci0
pci2: <ACPI PCI bus> on pcib2
mps1: <LSI SAS2008> port 0xd000-0xd0ff mem 0xdf400000-0xdf403fff,0xdf380000-0xdf                                   3bffff irq 17 at device 0.0 on pci2
mps1: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd
mps1: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,Even                                   tReplay,HostDisc>
ehci0: <EHCI (generic) USB 2.0 controller> mem 0xdfd04000-0xdfd043ff irq 16 at d                                   evice 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
pcib3: <ACPI PCI-PCI bridge> irq 16 at device 28.0 on pci0
pci3: <ACPI PCI bus> on pcib3
mps2: <LSI SAS2008> port 0xc000-0xc0ff mem 0xdee00000-0xdee03fff,0xded80000-0xde                                   dbffff irq 16 at device 0.0 on pci3
mps2: Firmware: 15.00.00.00, Driver: 16.00.00.00-fbsd
mps2: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,Even                                   tReplay,HostDisc>
pcib4: <ACPI PCI-PCI bridge> irq 16 at device 28.4 on pci0
pci4: <ACPI PCI bus> on pcib4
em0: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xb000-0xb01f mem 0xdfc00                                   000-0xdfc1ffff,0xdfc20000-0xdfc23fff irq 16 at device 0.0 on pci4
em0: Using MSIX interrupts with 3 vectors
em0: Ethernet address: 00:25:90:d5:1b:96
pcib5: <ACPI PCI-PCI bridge> irq 18 at device 28.6 on pci0
pci5: <ACPI PCI bus> on pcib5
em1: <Intel(R) PRO/1000 Network Connection 7.3.8> port 0xa000-0xa01f mem 0xdfb00                                   000-0xdfb1ffff,0xdfb20000-0xdfb23fff irq 18 at device 0.0 on pci5
em1: Using MSIX interrupts with 3 vectors
em1: Ethernet address: 00:25:90:d5:1b:97
ehci1: <EHCI (generic) USB 2.0 controller> mem 0xdfd03000-0xdfd033ff irq 23 at d                                   evice 29.0 on pci0
usbus1: EHCI version 1.0
usbus1 on ehci1
pcib6: <ACPI PCI-PCI bridge> at device 30.0 on pci0
pci6: <ACPI PCI bus> on pcib6
vgapci0: <VGA-compatible display> mem 0xdd000000-0xddffffff,0xde800000-0xde803ff                                   f,0xde000000-0xde7fffff irq 23 at device 3.0 on pci6
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Cougar Point AHCI SATA controller> port 0xf050-0xf057,0xf040-0xf04                                   3,0xf030-0xf037,0xf020-0xf023,0xf000-0xf01f mem 0xdfd02000-0xdfd027ff irq 19 at                                    device 31.2 on pci0
ahci0: AHCI v1.30 with 6 3Gbps ports, Port Multiplier not supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
pci0: <serial bus, SMBus> at device 31.3 (no driver attached)
acpi_button0: <Power Button> on acpi0
acpi_tz0: <Thermal Zone> on acpi0
acpi_tz1: <Thermal Zone> on acpi0
uart0: <16550 or compatible> port 0x3f8-0x3ff irq 4 flags 0x10 on acpi0
uart1: <16550 or compatible> port 0x2f8-0x2ff irq 3 on acpi0
uart2: <16550 or compatible> port 0x3e8-0x3ef irq 10 on acpi0
ichwd0 on isa0
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xc8fff on isa0
sc0: <System console> at flags 0x100 on isa0
sc0: VGA <16 virtual consoles, flags=0x300>
vga0: <Generic ISA VGA> at port 0x3c0-0x3df iomem 0xa0000-0xbffff on isa0
atkbdc0: <Keyboard controller (i8042)> at port 0x60,0x64 on isa0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
wbwd0: DevID 0xc3 DevRev 0x33, will not attach, please report this.
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
p4tcc0: <CPU Frequency Thermal Control> on cpu0
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
p4tcc1: <CPU Frequency Thermal Control> on cpu1
coretemp2: <CPU On-Die Thermal Sensors> on cpu2
est2: <Enhanced SpeedStep Frequency Control> on cpu2
p4tcc2: <CPU Frequency Thermal Control> on cpu2
coretemp3: <CPU On-Die Thermal Sensors> on cpu3
est3: <Enhanced SpeedStep Frequency Control> on cpu3
p4tcc3: <CPU Frequency Thermal Control> on cpu3
coretemp4: <CPU On-Die Thermal Sensors> on cpu4
est4: <Enhanced SpeedStep Frequency Control> on cpu4
p4tcc4: <CPU Frequency Thermal Control> on cpu4
coretemp5: <CPU On-Die Thermal Sensors> on cpu5
est5: <Enhanced SpeedStep Frequency Control> on cpu5
p4tcc5: <CPU Frequency Thermal Control> on cpu5
coretemp6: <CPU On-Die Thermal Sensors> on cpu6
est6: <Enhanced SpeedStep Frequency Control> on cpu6
p4tcc6: <CPU Frequency Thermal Control> on cpu6
coretemp7: <CPU On-Die Thermal Sensors> on cpu7
est7: <Enhanced SpeedStep Frequency Control> on cpu7
p4tcc7: <CPU Frequency Thermal Control> on cpu7
Timecounters tick every 1.000 msec
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, loggi                                   ng disabled
DUMMYNET 0xfffffe0009300cc0 with IPv6 initialized (100409)
load_dn_sched dn_sched RR loaded
load_dn_sched dn_sched WF2Q+ loaded
load_dn_sched dn_sched FIFO loaded
load_dn_sched dn_sched PRIO loaded
load_dn_sched dn_sched QFQ loaded
usbus0: 480Mbps High Speed USB v2.0
usbus1: 480Mbps High Speed USB v2.0
ugen0.1: <Intel> at usbus0
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
ugen1.1: <Intel> at usbus1
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus1
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen0.2: <vendor 0x8087> at usbus0
uhub2: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus                                   0
ugen1.2: <vendor 0x8087> at usbus1
uhub3: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus                                   1
uhub2: 6 ports with 6 removable, self powered
uhub3: 6 ports with 6 removable, self powered
ugen0.3: <Winbond Electronics Corp> at usbus0
ums0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10/                                   0.01, addr 3> on usbus0
ums0: 3 buttons and [Z] coordinates ID=0
ukbd0: <Winbond Electronics Corp Hermon USB hidmouse Device, class 0/0, rev 1.10                                   /0.01, addr 3> on usbus0
kbd2 at ukbd0
ugen1.3: <ATEN> at usbus1
ugen0.4: <vendor 0x0930> at usbus0
umass0: <vendor 0x0930 USB Flash Memory, class 0/0, rev 2.00/1.00, addr 4> on us                                   bus0
umass0:  SCSI over Bulk-Only; quirks = 0x4000
umass0:10:0:-1: Attached to scbus10
ukbd1: <ATEN UC-10KM V1.3.124, class 0/0, rev 1.10/1.00, addr 3> on usbus1
kbd3 at ukbd1
ums1: <HID Mouse> on usbus1
ums1: 5 buttons and [XYZ] coordinates ID=0
da0 at mps0 bus 0 scbus0 target 0 lun 0
da0: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da0: Serial Number      WD-WCC1S5951987
da0: 600.000MB/s transfers
da0: Command Queueing enabled
da0: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da4 at mps1 bus 0 scbus1 target 0 lun 0
da4: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da4: Serial Number      WD-WCC1S5959761
da4: 600.000MB/s transfers
da4: Command Queueing enabled
da4: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da5 at mps1 bus 0 scbus1 target 1 lun 0
da5: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da5: Serial Number      WD-WCC1S5959154
da5: 600.000MB/s transfers
da5: Command Queueing enabled
da5: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da1 at mps0 bus 0 scbus0 target 1 lun 0
da1: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da1: Serial Number      WD-WCC1S5957370
da1: 600.000MB/s transfers
da1: Command Queueing enabled
da1: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da2 at mps0 bus 0 scbus0 target 2 lun 0
da2: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da2: Serial Number      WD-WCC1S5956806
da2: 600.000MB/s transfers
da2: Command Queueing enabled
da2: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da3 at mps0 bus 0 scbus0 target 3 lun 0
da3: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da3: Serial Number      WD-WCC1S5956948
da3: 600.000MB/s transfers
da3: Command Queueing enabled
da3: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da6 at mps1 bus 0 scbus1 target 2 lun 0
da6: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da6: Serial Number      WD-WCC1S7329586
da6: 600.000MB/s transfers
da6: Command Queueing enabled
da6: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da8 at mps2 bus 0 scbus2 target 8 lun 0
da8: <ATA WDC WD10EZEX-00B 1A01> Fixed Direct Access SCSI-6 device
da8: Serial Number      WD-WCC3F1444848
da8: 600.000MB/s transfers
da8: Command Queueing enabled
da8: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da9 at mps2 bus 0 scbus2 target 9 lun 0
da9: <ATA WDC WD10EZEX-00B 1A01> Fixed Direct Access SCSI-6 device
da9: Serial Number      WD-WCC3F1435759
da9: 600.000MB/s transfers
da9: Command Queueing enabled
da9: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da7 at mps1 bus 0 scbus1 target 3 lun 0
da7: <ATA WDC WD10EZEX-00K 1H15> Fixed Direct Access SCSI-6 device
da7: Serial Number      WD-WCC1S7514748
da7: 600.000MB/s transfers
da7: Command Queueing enabled
da7: 953869MB (1953525168 512 byte sectors: 255H 63S/T 121601C)
da10 at umass-sim0 bus 0 scbus10 target 0 lun 0
da10: < USB Flash Memory PMAP> Removable Direct Access SCSI-4 device
da10: Serial Number 00D0C9CE66AAED8170004BEE
da10: 40.000MB/s transfers
da10: 14887MB (30489408 512 byte sectors: 255H 63S/T 1897C)
da10: quirks=0x2<NO_6_BYTE>
SMP: AP CPU #1 Launched!
SMP: AP CPU #5 Launched!
SMP: AP CPU #4 Launched!
SMP: AP CPU #2 Launched!
SMP: AP CPU #6 Launched!
SMP: AP CPU #3 Launched!
SMP: AP CPU #7 Launched!
Timecounter "TSC-low" frequency 1650047040 Hz quality 1000
Trying to mount root from ufs:/dev/ufs/FreeNASs2a [ro]...
WARNING: /data was not properly dismounted
GEOM_RAID5: Module loaded, version 1.1.20130907.44 (rev 5c6d2a159411)
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
GEOM_ELI: Device da1p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da2p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da3p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da4p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da5p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da7p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da6p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
GEOM_ELI: Device da0p1.eli created.
GEOM_ELI: Encryption: AES-XTS 256
GEOM_ELI:     Crypto: hardware
pid 6150 (smbd), uid 65534: exited on signal 10

PCICONF -lv

Code:

hostb0@pci0:0:0:0:      class=0x060000 card=0x062415d9 chip=0x01588086 rev=0x09 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'Ivy Bridge DRAM Controller'
    class      = bridge
    subclass   = HOST-PCI
pcib1@pci0:0:1:0:       class=0x060400 card=0x062415d9 chip=0x01518086 rev=0x09 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'Ivy Bridge PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
pcib2@pci0:0:1:1:       class=0x060400 card=0x062415d9 chip=0x01558086 rev=0x09 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = 'Ivy Bridge PCI Express Root Port'
    class      = bridge
    subclass   = PCI-PCI
ehci0@pci0:0:26:0:      class=0x0c0320 card=0x062415d9 chip=0x1c2d8086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family USB Enhanced Host Controller'
    class      = serial bus
    subclass   = USB
pcib3@pci0:0:28:0:      class=0x060400 card=0x062415d9 chip=0x1c108086 rev=0xb5 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family PCI Express Root Port 1'
    class      = bridge
    subclass   = PCI-PCI
pcib4@pci0:0:28:4:      class=0x060400 card=0x062415d9 chip=0x1c188086 rev=0xb5 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family PCI Express Root Port 5'
    class      = bridge
    subclass   = PCI-PCI
pcib5@pci0:0:28:6:      class=0x060400 card=0x062415d9 chip=0x1c1c8086 rev=0xb5 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family PCI Express Root Port 7'
    class      = bridge
    subclass   = PCI-PCI
ehci1@pci0:0:29:0:      class=0x0c0320 card=0x062415d9 chip=0x1c268086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family USB Enhanced Host Controller'
    class      = serial bus
    subclass   = USB
pcib6@pci0:0:30:0:      class=0x060401 card=0x062415d9 chip=0x244e8086 rev=0xa5 hdr=0x01
    vendor     = 'Intel Corporation'
    device     = '82801 PCI Bridge'
    class      = bridge
    subclass   = PCI-PCI
isab0@pci0:0:31:0:      class=0x060100 card=0x062415d9 chip=0x1c528086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = 'C202 Chipset Family LPC Controller'
    class      = bridge
    subclass   = PCI-ISA
ahci0@pci0:0:31:2:      class=0x010601 card=0x062415d9 chip=0x1c028086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family 6 port SATA AHCI Controller'
    class      = mass storage
    subclass   = SATA
none0@pci0:0:31:3:      class=0x0c0500 card=0x062415d9 chip=0x1c228086 rev=0x05 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '6 Series/C200 Series Chipset Family SMBus Controller'
    class      = serial bus
    subclass   = SMBus
mps0@pci0:1:0:0:        class=0x010700 card=0x30201000 chip=0x00721000 rev=0x02 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
mps1@pci0:2:0:0:        class=0x010700 card=0x30201000 chip=0x00721000 rev=0x03 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
mps2@pci0:3:0:0:        class=0x010700 card=0x30201000 chip=0x00721000 rev=0x02 hdr=0x00
    vendor     = 'LSI Logic / Symbios Logic'
    device     = 'SAS2008 PCI-Express Fusion-MPT SAS-2 [Falcon]'
    class      = mass storage
    subclass   = SAS
em0@pci0:4:0:0: class=0x020000 card=0x000015d9 chip=0x10d38086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82574L Gigabit Network Connection'
    class      = network
    subclass   = ethernet
em1@pci0:5:0:0: class=0x020000 card=0x000015d9 chip=0x10d38086 rev=0x00 hdr=0x00
    vendor     = 'Intel Corporation'
    device     = '82574L Gigabit Network Connection'
    class      = network
    subclass   = ethernet
vgapci0@pci0:6:3:0:     class=0x030000 card=0x062415d9 chip=0x0532102b rev=0x0a hdr=0x00
    vendor     = 'Matrox Graphics, Inc.'
    device     = 'MGA G200eW WPCM450'
    class      = display
    subclass   = VGA

I'm not sure what other information might be relevant, but can provide anything that might be required.

 

[cyberjock]

The "exit on signal 10" at the end of the dmesg makes me thing something is wrong, but other than that nothing there "looks" wrong. :/

Sorry. You're going to have to dig deeper. Maybe try a BIOS update, make sure your M1015 is using the correct firmware (firmware and driver should match... 9.2.1.6 is on P16).

Other than that I don't have any other good advice off the top of my head.

 

[MDKAOD]

I will follow your suggestions. Thank you for check it out for me.

 

[rs225]

I'll assume you have ECC RAM... but have you run a memory test to see if this problem turns up there?

Is there any cable, card, etc in common with the devices that show checksum errors?

Might you be able to rearrange your I/O cards? Is your power supply rated for the total load?

 

[MDKAOD]

I do have ECC memory. Haven't run a memory test. Nothing in common, I've seen these checksum errors across all drives, all in low numbers, and only after Windows search. I did find out that I'm on P18 firmware and am scheduling the P16 flash, we'll see if that has any effect. Power supply is rated correctly for the number of devices.

 

[rs225]

Is anything overclocked or running non-default? If it is true that your scrubs come up clean, but you can pretty consistently see this problem with a win8.1 search(plus that signal 10 on smbd), it implies that you may have a borderline piece of hardware that corrupts data only under certain load patterns. This could be your mobo, CPU, memory, PCI bus, basically anything. That is why I suggest the possibility of re-arranging your I/O cards to see if the problem disappears.

 

[MDKAOD]

Nothing overclocked, but I will look into the HBA I/O a bit further and see if I can isolate whether the checksum errors are indeed occurring on a single HBA. Thanks for the tip.

 

[MDKAOD]

Just to report back, I flashed my M1015's back to P16 and updated to 9.2.1.6 and have not been able to reproduce the Checksum errors, or the Exit on Signal 10. Everything seems to be working properly now, but I've only had a couple of days of load on it, so it's possible that my "All Clear" report here might be a bit premature.

Thank you guys for your insight.

 

[Ericloewe]

Just to report back, I flashed my M1015's back to P16 and updated to 9.2.1.6 and have not been able to reproduce the Checksum errors, or the Exit on Signal 10. Everything seems to be working properly now, but I've only had a couple of days of load on it, so it's possible that my "All Clear" report here might be a bit premature.

Thank you guys for your insight.

What firmware were you running?

 

[MDKAOD]

P18 I believe.

 

[Ericloewe]

P18 I believe.

Ok, thanks for the information.