-fun-
Contributor
- Joined
- Oct 27, 2015
- Messages
- 171
Hi Guys,
I need some advice on how to deal with a "removed disk".
Short story: FreeNAS reports disk "removed by administrator" and a degraded pool (with sufficient replicas). Recent SMART test of this disk gave no indication of an upcoming problem. Another failure would destroy my pool, I have therefore shut down my FreeNAS. I can survive without it some time.
What should I do next?
1. Should I and if so how can I test the disk independent from FreeNAS?
Long Story:
My Setup: ProLiant Microserver Gen 8, 16GB RAM, 2 redundant boot thumb drives. My pool consists of 2 vdevs, each a mirror of 2 each of 6TB WD Red and 3TB Red. The removed disk is one of the 3TB disks. These are little over 2 years old with 9 months of warranty remaining.
Today 03:39 I got an alert:
I checked this in FreeNAS. The pool was degraded but functional. The disk is shown "Unused". The removed disk is ada0. Yesterday the disk looked just fine in my daily SMART report from 08:03, see below. Today there was no SMART report for this disk (possibly due to the fact that the drive was removed / detached).
I then checked dmesg (also see below). In the end I found some "detached" message and "ATA Status Error" for ada0. How to interpret this is beyond my capabilities however.
dmesg results
I need some advice on how to deal with a "removed disk".
Short story: FreeNAS reports disk "removed by administrator" and a degraded pool (with sufficient replicas). Recent SMART test of this disk gave no indication of an upcoming problem. Another failure would destroy my pool, I have therefore shut down my FreeNAS. I can survive without it some time.
What should I do next?
1. Should I and if so how can I test the disk independent from FreeNAS?
- Is there an easy way to test this without any other PC in my home? I have only MacBooks and MacBook Pros here. I do have a USB drive enclosure if this helps.
- I never bothered to have another OS available to boot on my FreeNAS machine. Maybe I can remove the other disks and the boot thumb drives and boot another system? If this is a good idea: What OS should I use? Something suitable for disk burn in would be best in case I actually need to replace with a new disk.
- The Server is a ProLiant Microserver Gen 8. ILO reports a perfectly healthy system. (Whatever this is worth I can't tell though.)
- Cables? The drive sits in a drive bay which connects directly to the disk.
- Controller? Shouldn't this then affect other drives as well?
Long Story:
My Setup: ProLiant Microserver Gen 8, 16GB RAM, 2 redundant boot thumb drives. My pool consists of 2 vdevs, each a mirror of 2 each of 6TB WD Red and 3TB Red. The removed disk is one of the 3TB disks. These are little over 2 years old with 9 months of warranty remaining.
Today 03:39 I got an alert:
Code:
New alerts: * Pool flospool state is DEGRADED: One or more devices has been removed by the administrator. Sufficient replicas exist for the pool to continue functioning in a degraded state.
I checked this in FreeNAS. The pool was degraded but functional. The disk is shown "Unused". The removed disk is ada0. Yesterday the disk looked just fine in my daily SMART report from 08:03, see below. Today there was no SMART report for this disk (possibly due to the fact that the drive was removed / detached).
I then checked dmesg (also see below). In the end I found some "detached" message and "ATA Status Error" for ada0. How to interpret this is beyond my capabilities however.
Code:
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build) Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org === START OF INFORMATION SECTION === Model Family: Western Digital Red Device Model: WDC WD30EFRX-68N32N0 Serial Number: WD-WCC7K5FAKRRV LU WWN Device Id: 5 0014ee 2b9a1d150 Firmware Version: 82.00A82 User Capacity: 3,000,592,982,016 bytes [3.00 TB] Sector Sizes: 512 bytes logical, 4096 bytes physical Rotation Rate: 5400 rpm Form Factor: 3.5 inches Device is: In smartctl database [for details use: -P show] ATA Version is: ACS-3 T13/2161-D revision 5 SATA Version is: SATA 3.1, 6.0 Gb/s (current: 6.0 Gb/s) Local Time is: Fri Apr 17 07:55:00 2020 CEST SMART support is: Available - device has SMART capability. SMART support is: Enabled Power mode is: ACTIVE or IDLE === START OF READ SMART DATA SECTION === SMART overall-health self-assessment test result: PASSED SMART Error Log Version: 1 No Errors Logged smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build) Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org === START OF READ SMART DATA SECTION === SMART Attributes Data Structure revision number: 16 Vendor Specific SMART Attributes with Thresholds: ID# ATTRIBUTE_NAME FLAG VALUE WORST THRESH TYPE UPDATED WHEN_FAILED RAW_VALUE 1 Raw_Read_Error_Rate 0x002f 200 200 051 Pre-fail Always - 0 3 Spin_Up_Time 0x0027 191 176 021 Pre-fail Always - 5433 4 Start_Stop_Count 0x0032 100 100 000 Old_age Always - 14 5 Reallocated_Sector_Ct 0x0033 200 200 140 Pre-fail Always - 0 7 Seek_Error_Rate 0x002e 200 200 000 Old_age Always - 0 9 Power_On_Hours 0x0032 074 074 000 Old_age Always - 19306 10 Spin_Retry_Count 0x0032 100 253 000 Old_age Always - 0 11 Calibration_Retry_Count 0x0032 100 253 000 Old_age Always - 0 12 Power_Cycle_Count 0x0032 100 100 000 Old_age Always - 14 192 Power-Off_Retract_Count 0x0032 200 200 000 Old_age Always - 4 193 Load_Cycle_Count 0x0032 200 200 000 Old_age Always - 59 194 Temperature_Celsius 0x0022 120 112 000 Old_age Always - 30 196 Reallocated_Event_Count 0x0032 200 200 000 Old_age Always - 0 197 Current_Pending_Sector 0x0032 200 200 000 Old_age Always - 0 198 Offline_Uncorrectable 0x0030 100 253 000 Old_age Offline - 0 199 UDMA_CRC_Error_Count 0x0032 200 200 000 Old_age Always - 0 200 Multi_Zone_Error_Rate 0x0008 200 200 000 Old_age Offline - 0
dmesg results
Code:
Copyright (c) 1992-2018 The FreeBSD Project.
Copyright (c) 1979, 1980, 1983, 1986, 1988, 1989, 1991, 1992, 1993, 1994
The Regents of the University of California. All rights reserved.
FreeBSD is a registered trademark of The FreeBSD Foundation.
FreeBSD 11.2-STABLE #0 r325575+c9231c7d6bd(HEAD): Mon Nov 18 22:46:47 UTC 2019
root@nemesis:/freenas-releng/freenas/_BE/objs/freenas-releng/freenas/_BE/os/sys/FreeNAS.amd64 amd64
FreeBSD clang version 6.0.0 (tags/RELEASE_600/final 326565) (based on LLVM 6.0.0)
VT(vga): resolution 640x480
CPU: Intel(R) Celeron(R) CPU G1610T @ 2.30GHz (2294.83-MHz K8-class CPU)
Origin="GenuineIntel" Id=0x306a9 Family=0x6 Model=0x3a Stepping=9
Features=0xbfebfbff<FPU,VME,DE,PSE,TSC,MSR,PAE,MCE,CX8,APIC,SEP,MTRR,PGE,MCA,CMOV,PAT,PSE36,CLFLUSH,DTS,ACPI,MMX,FXSR,SSE,SSE2,SS,HTT,TM,PBE>
Features2=0xd9ae3bf<SSE3,PCLMULQDQ,DTES64,MON,DS_CPL,VMX,EST,TM2,SSSE3,CX16,xTPR,PDCM,PCID,SSE4.1,SSE4.2,POPCNT,TSCDLT,XSAVE,OSXSAVE>
AMD Features=0x28100800<SYSCALL,NX,RDTSCP,LM>
AMD Features2=0x1<LAHF>
Structured Extended Features=0x281<FSGSBASE,SMEP,ERMS>
XSAVE Features=0x1<XSAVEOPT>
VT-x: PAT,HLT,MTF,PAUSE,EPT,UG,VPID
TSC: P-state invariant, performance statistics
real memory = 17179869184 (16384 MB)
avail memory = 16563920896 (15796 MB)
Event timer "LAPIC" quality 600
ACPI APIC Table: <HP ProLiant>
FreeBSD/SMP: Multiprocessor System Detected: 2 CPUs
FreeBSD/SMP: 1 package(s) x 2 core(s)
WARNING: VIMAGE (virtualized network stack) is a highly experimental feature.
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Pm1aControlBlock: 16/32 (20171214/tbfadt-748)
Firmware Warning (ACPI): 32/64X length mismatch in FADT/Pm2ControlBlock: 8/32 (20171214/tbfadt-748)
Firmware Warning (ACPI): Invalid length for FADT/Pm1aControlBlock: 32, using default 16 (20171214/tbfadt-850)
Firmware Warning (ACPI): Invalid length for FADT/Pm2ControlBlock: 32, using default 8 (20171214/tbfadt-850)
ioapic0: Changing APIC ID to 8
ioapic0 <Version 2.0> irqs 0-23 on motherboard
SMP: AP CPU #1 Launched!
Timecounter "TSC-low" frequency 1147416930 Hz quality 1000
random: entropy device external interface
kbd1 at kbdmux0
nexus0
vtvga0: <VT VGA driver> on motherboard
cryptosoft0: <software crypto> on motherboard
aesni0: No AESNI support.
padlock0: No ACE support.
acpi0: <HP ProLiant> on motherboard
acpi0: Power Button (fixed)
cpu0: <ACPI CPU> on acpi0
cpu1: <ACPI CPU> on acpi0
attimer0: <AT timer> port 0x40-0x43 irq 0 on acpi0
Timecounter "i8254" frequency 1193182 Hz quality 0
Event timer "i8254" frequency 1193182 Hz quality 100
hpet0: <High Precision Event Timer> iomem 0xfed00000-0xfed003ff on acpi0
Timecounter "HPET" frequency 14318180 Hz quality 950
Event timer "HPET" frequency 14318180 Hz quality 550
Event timer "HPET1" frequency 14318180 Hz quality 440
Event timer "HPET2" frequency 14318180 Hz quality 440
Event timer "HPET3" frequency 14318180 Hz quality 440
Event timer "HPET4" frequency 14318180 Hz quality 440
Event timer "HPET5" frequency 14318180 Hz quality 440
Event timer "HPET6" frequency 14318180 Hz quality 440
atrtc0: <AT realtime clock> port 0x70-0x71 on acpi0
atrtc0: registered as a time-of-day clock, resolution 1.000000s
Event timer "RTC" frequency 32768 Hz quality 0
Timecounter "ACPI-fast" frequency 3579545 Hz quality 900
acpi_timer0: <24-bit timer at 3.579545MHz> port 0x908-0x90b on acpi0
pcib0: <ACPI Host-PCI bridge> on acpi0
pcib0: _OSC returned error 0x10
pci0: <ACPI PCI bus> on pcib0
pcib1: <ACPI PCI-PCI bridge> at device 1.0 on pci0
pci1: <ACPI PCI bus> on pcib1
pcib2: <ACPI PCI-PCI bridge> at device 6.0 on pci0
pci2: <ACPI PCI bus> on pcib2
ehci0: <Intel Cougar Point USB 2.0 controller> mem 0xfacf0000-0xfacf03ff irq 21 at device 26.0 on pci0
usbus0: EHCI version 1.0
usbus0 on ehci0
usbus0: 480Mbps High Speed USB v2.0
pcib3: <ACPI PCI-PCI bridge> at device 28.0 on pci0
pci3: <ACPI PCI bus> on pcib3
pcib4: <ACPI PCI-PCI bridge> at device 28.4 on pci0
pci4: <ACPI PCI bus> on pcib4
bge0: <HP Ethernet 1Gb 2-port 332i Adapter, ASIC rev. 0x5720000> mem 0xfabf0000-0xfabfffff,0xfabe0000-0xfabeffff,0xfabd0000-0xfabdffff irq 16 at device 0.0 on pci4
bge0: APE FW version: NCSI v1.2.46.0
bge0: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus0: <MII bus> on bge0
brgphy0: <BCM5720C 1000BASE-T media interface> PHY 1 on miibus0
brgphy0: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge0: Using defaults for TSO: 65518/35/2048
bge0: Ethernet address: 34:64:a9:9a:31:28
bge1: <HP Ethernet 1Gb 2-port 332i Adapter, ASIC rev. 0x5720000> mem 0xfabc0000-0xfabcffff,0xfabb0000-0xfabbffff,0xfaba0000-0xfabaffff irq 17 at device 0.1 on pci4
bge1: APE FW version: NCSI v1.2.46.0
bge1: CHIP ID 0x05720000; ASIC REV 0x5720; CHIP REV 0x57200; PCI-E
miibus1: <MII bus> on bge1
brgphy1: <BCM5720C 1000BASE-T media interface> PHY 2 on miibus1
brgphy1: 10baseT, 10baseT-FDX, 100baseTX, 100baseTX-FDX, 1000baseT, 1000baseT-master, 1000baseT-FDX, 1000baseT-FDX-master, auto, auto-flow
bge1: Using defaults for TSO: 65518/35/2048
bge1: Ethernet address: 34:64:a9:9a:31:29
pcib5: <ACPI PCI-PCI bridge> at device 28.6 on pci0
pci5: <ACPI PCI bus> on pcib5
xhci0: <XHCI (generic) USB 3.0 controller> mem 0xfbff0000-0xfbff1fff irq 18 at device 0.0 on pci5
xhci0: 64 bytes context size, 32-bit DMA
xhci0: Unable to map MSI-X table
usbus1 on xhci0
usbus1: 5.0Gbps Super Speed USB v3.0
pcib6: <ACPI PCI-PCI bridge> at device 28.7 on pci0
pci6: <ACPI PCI bus> on pcib6
vgapci0: <VGA-compatible display> mem 0xf9000000-0xf9ffffff,0xfbee0000-0xfbee3fff,0xfb000000-0xfb7fffff irq 16 at device 0.1 on pci6
vgapci0: Boot video device
uhci0: <HP iLO Standard Virtual USB controller> port 0x4000-0x401f irq 16 at device 0.4 on pci6
usbus2 on uhci0
usbus2: 12Mbps Full Speed USB v1.0
ehci1: <Intel Cougar Point USB 2.0 controller> mem 0xface0000-0xface03ff irq 20 at device 29.0 on pci0
usbus3: EHCI version 1.0
usbus3 on ehci1
usbus3: 480Mbps High Speed USB v2.0
pcib7: <PCI-PCI bridge> at device 30.0 on pci0
pci7: <PCI bus> on pcib7
isab0: <PCI-ISA bridge> at device 31.0 on pci0
isa0: <ISA bus> on isab0
ahci0: <Intel Cougar Point AHCI SATA controller> port 0x1000-0x1007,0x1008-0x100b,0x1010-0x1017,0x1018-0x101b,0x1020-0x103f mem 0xfacd0000-0xfacd07ff irq 17 at device 31.2 on pci0
ahci0: AHCI v1.30 with 6 6Gbps ports, Port Multiplier supported
ahcich0: <AHCI channel> at channel 0 on ahci0
ahcich1: <AHCI channel> at channel 1 on ahci0
ahcich2: <AHCI channel> at channel 2 on ahci0
ahcich3: <AHCI channel> at channel 3 on ahci0
ahcich4: <AHCI channel> at channel 4 on ahci0
ahcich5: <AHCI channel> at channel 5 on ahci0
acpi_tz0: <Thermal Zone> on acpi0
ipmi0: <IPMI System Interface> port 0xca2-0xca3 on acpi0
ipmi0: KCS mode found at io 0xca2 on acpi
acpi_syscontainer0: <System Container> port 0x2e-0x2f on acpi0
atkbdc0: <Keyboard controller (i8042)> port 0x60,0x64 irq 1 on acpi0
atkbd0: <AT Keyboard> irq 1 on atkbdc0
kbd0 at atkbd0
atkbd0: [GIANT-LOCKED]
ichwd0: <Intel Cougar Point watchdog timer> on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
ichwd0: <Intel Cougar Point watchdog timer> at port 0x930-0x937,0x960-0x97f on isa0
ichwd0: ICH WDT present but disabled in BIOS or hardware
device_attach: ichwd0 attach returned 6
orm0: <ISA Option ROMs> at iomem 0xc0000-0xc7fff,0xc8000-0xcbfff on isa0
uart1: <Non-standard ns8250 class UART with FIFOs> at port 0x2f8 irq 3 on isa0
coretemp0: <CPU On-Die Thermal Sensors> on cpu0
est0: <Enhanced SpeedStep Frequency Control> on cpu0
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1d2400001700
device_attach: est0 attach returned 6
coretemp1: <CPU On-Die Thermal Sensors> on cpu1
est1: <Enhanced SpeedStep Frequency Control> on cpu1
est: CPU supports Enhanced Speedstep, but is not recognized.
est: cpu_vendor GenuineIntel, msr 1d2400001700
device_attach: est1 attach returned 6
ZFS filesystem version: 5
ZFS storage pool version: features support (5000)
Timecounters tick every 1.000 msec
freenas_sysctl: adding account.
freenas_sysctl: adding directoryservice.
freenas_sysctl: adding middlewared.
freenas_sysctl: adding network.
freenas_sysctl: adding services.
ipfw2 (+ipv6) initialized, divert enabled, nat enabled, default to accept, logging disabled
ipmi0: IPMI device rev. 2, firmware rev. 2.70, version 2.0
ipmi0: Number of channels 1
ipmi0: Attached watchdog
ugen0.1: <Intel EHCI root HUB> at usbus0
ugen3.1: <Intel EHCI root HUB> at usbus3
uhub0: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus0
uhub1: <Intel EHCI root HUB, class 9/0, rev 2.00/1.00, addr 1> on usbus3
ugen1.1: <0x1912 XHCI root HUB> at usbus1
ugen2.1: <HP UHCI root HUB> at usbus2
uhub2: <0x1912 XHCI root HUB, class 9/0, rev 3.00/1.00, addr 1> on usbus1
uhub3: <HP UHCI root HUB, class 9/0, rev 1.00/1.00, addr 1> on usbus2
uhub3: 2 ports with 2 removable, self powered
uhub2: 6 ports with 6 removable, self powered
uhub0: 2 ports with 2 removable, self powered
uhub1: 2 ports with 2 removable, self powered
ugen2.2: <BMC Virtual Keyboard> at usbus2
ukbd0 on uhub3
ukbd0: <Virtual Keyboard > on usbus2
kbd2 at ukbd0
ugen3.2: <vendor 0x8087 product 0x0024> at usbus3
uhub4 on uhub1
uhub4: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus3
ugen0.2: <vendor 0x8087 product 0x0024> at usbus0
uhub5 on uhub0
uhub5: <vendor 0x8087 product 0x0024, class 9/0, rev 2.00/0.00, addr 2> on usbus0
uhub5: 6 ports with 6 removable, self powered
uhub4: 6 ports with 6 removable, self powered
ugen3.3: <vendor 0x0424 product 0x2660> at usbus3
uhub6 on uhub4
uhub6: <vendor 0x0424 product 0x2660, class 9/0, rev 2.00/8.01, addr 3> on usbus3
uhub6: 2 ports with 1 removable, self powered
ugen0.3: <SanDisk Cruzer Fit> at usbus0
umass0 on uhub5
umass0: <SanDisk Cruzer Fit, class 0/0, rev 2.00/1.27, addr 3> on usbus0
umass0: SCSI over Bulk-Only; quirks = 0x8100
umass0:7:0: Attached to scbus7
ugen0.4: <SanDisk Cruzer Fit> at usbus0
umass1 on uhub5
umass1: <SanDisk Cruzer Fit, class 0/0, rev 2.00/1.27, addr 4> on usbus0
umass1: SCSI over Bulk-Only; quirks = 0x8100
umass1:8:1: Attached to scbus8
ugen0.5: <APC Back-UPS ES 700G FW871.O4 .I USB FWO4> at usbus0
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD30EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada0: Serial Number WD-WCC7K5FAKRRV
ada0: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada0: Command Queueing enabled
ada0: 2861588MB (5860533168 512 byte sectors)
ada0: quirks=0x1<4K>
ada1 at ahcich1 bus 0 scbus1 target 0 lun 0
ada1: <WDC WD30EFRX-68N32N0 82.00A82> ACS-3 ATA SATA 3.x device
ada1: Serial Number WD-WCC7K6KL24ZS
ada1: 600.000MB/s transfers (SATA 3.x, UDMA6, PIO 8192bytes)
ada1: Command Queueing enabled
ada1: 2861588MB (5860533168 512 byte sectors)
ada1: quirks=0x1<4K>
ada2 at ahcich2 bus 0 scbus2 target 0 lun 0
ada2: <WDC WD60EFAX-68JH4N0 82.00A82> ACS-3 ATA SATA 3.x device
ada2: Serial Number WD-WX61DC9CC3E7
ada2: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada2: Command Queueing enabled
ada2: 5723166MB (11721045168 512 byte sectors)
ada3 at ahcich3 bus 0 scbus3 target 0 lun 0
ada3: <WDC WD60EFAX-68JH4N0 82.00A82> ACS-3 ATA SATA 3.x device
ada3: Serial Number WD-WX61DC947N10
ada3: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada3: Command Queueing enabled
ada3: 5723166MB (11721045168 512 byte sectors)
ada4 at ahcich4 bus 0 scbus4 target 0 lun 0
ada4: <HGST HTS541010A9E680 JA0OA560> ATA8-ACS SATA 3.x device
ada4: Serial Number JD100ADM16ZAEK
ada4: 300.000MB/s transfers (SATA 2.x, UDMA6, PIO 8192bytes)
ada4: Command Queueing enabled
ada4: 953869MB (1953525168 512 byte sectors)
da0 at umass-sim0 bus 0 scbus7 target 0 lun 0
da0: <SanDisk Cruzer Fit 1.27> Removable Direct Access SPC-4 SCSI device
da0: Serial Number 4C530006010822116464
da0: 40.000MB/s transfers
da0: 15267MB (31266816 512 byte sectors)
da0: quirks=0x2<NO_6_BYTE>
da1 at umass-sim1 bus 1 scbus8 target 0 lun 0
da1: <SanDisk Cruzer Fit 1.27> Removable Direct Access SPC-4 SCSI device
da1: Serial Number 4C530006070822112014
da1: 40.000MB/s transfers
random: unblocking device.
Trying to mount root from zfs:freenas-boot/ROOT/11.2-U7 []...
da1: 15267MB (31266816 512 byte sectors)
da1: quirks=0x2<NO_6_BYTE>
ugen2.2: <BMC Virtual Keyboard> at usbus2 (disconnected)
ukbd0: at uhub3, port 1, addr 2 (disconnected)
ukbd0: detached
ugen2.2: <BMC Virtual Keyboard> at usbus2
ukbd0 on uhub3
ukbd0: <Virtual Keyboard > on usbus2
kbd2 at ukbd0
GEOM_MIRROR: Device mirror/swap0 launched (2/2).
GEOM_ELI: Device mirror/swap0.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: software
ugen2.2: <BMC Virtual Keyboard> at usbus2 (disconnected)
ukbd0: at uhub3, port 1, addr 2 (disconnected)
ukbd0: detached
ugen2.2: <BMC Virtual Keyboard> at usbus2
ukbd0 on uhub3
ukbd0: <Virtual Keyboard > on usbus2
kbd2 at ukbd0
hwpmc: SOFT/16/64/0x67<INT,USR,SYS,REA,WRI> TSC/1/64/0x20<REA> IAP/8/48/0x3ff<INT,USR,SYS,EDG,THR,REA,WRI,INV,QUA,PRC> IAF/3/48/0x67<INT,USR,SYS,REA,WRI>
bge0: link state changed to DOWN
ums0 on uhub3
ums0: <Virtual Mouse> on usbus2
bge0: link state changed to UP
nfsd: can't register svc name
bridge0: Ethernet address: 02:a5:f1:d5:98:00
bge0: promiscuous mode enabled
bridge0: link state changed to UP
epair0a: Ethernet address: 02:e7:d0:00:05:0a
epair0b: Ethernet address: 02:e7:d0:00:06:0b
epair0a: link state changed to UP
epair0b: link state changed to UP
epair0a: changing name to 'vnet0:1'
vnet0:1: promiscuous mode enabled
epair1a: Ethernet address: 02:e7:d0:00:06:0a
epair1b: Ethernet address: 02:e7:d0:00:07:0b
epair1a: link state changed to UP
epair1b: link state changed to UP
epair1a: changing name to 'vnet0:2'
epair1b: changing name to 'epair0b'
vnet0:2: promiscuous mode enabled
epair2a: Ethernet address: 02:e7:d0:00:07:0a
epair2b: Ethernet address: 02:e7:d0:00:08:0b
epair2a: link state changed to UP
epair2b: link state changed to UP
epair2a: changing name to 'vnet0:3'
epair2b: changing name to 'epair0b'
vnet0:3: promiscuous mode enabled
ugen2.2: <BMC Virtual Keyboard> at usbus2 (disconnected)
ukbd0: at uhub3, port 1, addr 2 (disconnected)
ukbd0: detached
ums0: at uhub3, port 1, addr 2 (disconnected)
ums0: detached
GEOM_MIRROR: Device mirror/swap1 launched (2/2).
GEOM_ELI: Device mirror/swap1.eli created.
GEOM_ELI: Encryption: AES-XTS 128
GEOM_ELI: Crypto: software
Failed to fully fault in a core file segment at VA 0x8014de000 with size 0xd000 to be written at offset 0x310000 for process winbindd
pid 3365 (winbindd), uid 0: exited on signal 6 (core dumped)
ada0 at ahcich0 bus 0 scbus0 target 0 lun 0
ada0: <WDC WD30EFRX-68N32N0 82.00A82> s/n WD-WCC7K5FAKRRV detached
(ada0:ahcich0:0:0:0): Periph destroyed
(aprobe0:ahcich0:0:0:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: ATA Status Error
(aprobe0:ahcich0:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
(aprobe0:ahcich0:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
(aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted
(aprobe1:ahcich0:0:15:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe1:ahcich0:0:15:0): CAM status: ATA Status Error
(aprobe1:ahcich0:0:15:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
(aprobe1:ahcich0:0:15:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
(aprobe1:ahcich0:0:15:0): Error 5, Retries exhausted
(aprobe1:ahcich0:0:15:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe1:ahcich0:0:15:0): CAM status: ATA Status Error
(aprobe1:ahcich0:0:15:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
(aprobe1:ahcich0:0:15:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
(aprobe1:ahcich0:0:15:0): Error 5, Retries exhausted
(aprobe0:ahcich0:0:0:0): NOP FLUSHQUEUE. ACB: 00 00 00 00 00 00 00 00 00 00 00 00
(aprobe0:ahcich0:0:0:0): CAM status: ATA Status Error
(aprobe0:ahcich0:0:0:0): ATA status: d1 (BSY DRDY SERV ERR), error: 04 (ABRT )
(aprobe0:ahcich0:0:0:0): RES: d1 04 ff ff ff ff ff ff ff ff ff
(aprobe0:ahcich0:0:0:0): Error 5, Retries exhausted
