Brentnall
Dabbler
- Joined
- May 24, 2015
- Messages
- 16
FreeNAS 11.1-U4
Thought I would post this here in the hope that someone might make greater sense of it than me.
I just received an email from one of my FreeNAS boxes advising that an "Unauthorized system reboot" had taken place.
This is a fairly long running system (years) without previous incidents.
Looking at the messages log below it clearly seems to be some issue with one of the LSI 9211-8i HBA Cards in the box, of which there are 3.
Updating the firmware to the latest version is of course the first port of call and will be doing that as soon as possible.
Any ideas if that'll likely prevent it happening again or could this be hardware that is on it's way out and needs replacing?
Hardware wise this is a VM running on ESXi 6.7 with the three LSI cards passed through using VT-d.
There are three RAIDZ2 pools in the box each comprising of 8 drives (one vdev per pool), one pool per HBA. All WD Red drives.
Full specs are in my signature. 20gb RAM assigned to FreeNAS VM which is fully reserved. No dedupe or any other crazy config.
I have a copy of the /var/log directory within 15 mins of the reboot taking place in case it's helpful.
Many thanks for any insight you can share!
Thought I would post this here in the hope that someone might make greater sense of it than me.
I just received an email from one of my FreeNAS boxes advising that an "Unauthorized system reboot" had taken place.
This is a fairly long running system (years) without previous incidents.
Looking at the messages log below it clearly seems to be some issue with one of the LSI 9211-8i HBA Cards in the box, of which there are 3.
Updating the firmware to the latest version is of course the first port of call and will be doing that as soon as possible.
Any ideas if that'll likely prevent it happening again or could this be hardware that is on it's way out and needs replacing?
Jun 23 21:50:51 roflnas syslog-ng[1918]: syslog-ng starting up; version='3.7.3'
Jun 23 21:50:51 roflnas mps2: IOC Fault 0x40002651, Resetting
Jun 23 21:50:51 roflnas mps2: Reinitializing controller,
Jun 23 21:50:51 roflnas mps2: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
Jun 23 21:50:51 roflnas mps2: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas mps2: Calling Reinit from mps_wait_command, timeout=60, elapsed=61
Jun 23 21:50:51 roflnas mps2: Reinitializing controller,
Jun 23 21:50:51 roflnas mps2: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
Jun 23 21:50:51 roflnas mps2: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas mps2: Calling Reinit from mps_wait_command, timeout=60, elapsed=61
Jun 23 21:50:51 roflnas mps2: Reinitializing controller,
Jun 23 21:50:51 roflnas mps2: Firmware: 20.00.04.00, Driver: 21.02.00.00-fbsd
Jun 23 21:50:51 roflnas mps2: IOCCapabilities: 1285c<ScsiTaskFull,DiagTrace,SnapBuf,EEDP,TransRetry,EventReplay,HostDisc>
Jun 23 21:50:51 roflnas swap_pager: indefinite wait buffer: bufobj: 0, blkno: 1577258, size: 24576
Jun 23 21:50:51 roflnas panic: solaris assert: illumos_nvlist_pack(nvl, &packed, sizep, 0, 0x0002) == 0 (0xe == 0x0), file: /freenas-11-releng/freenas/_BE/os/sys/cddl/contrib/opensolaris/common/nvpair/opensolaris_fnvpair.c, line: 84
Jun 23 21:50:51 roflnas cpuid = 2
Jun 23 21:50:51 roflnas KDB: stack backtrace:
Jun 23 21:50:51 roflnas db_trace_self_wrapper() at db_trace_self_wrapper+0x2b/frame 0xfffffe0566ec65e0
Jun 23 21:50:51 roflnas vpanic() at vpanic+0x186/frame 0xfffffe0566ec6660
Jun 23 21:50:51 roflnas panic() at panic+0x43/frame 0xfffffe0566ec66c0
Jun 23 21:50:51 roflnas assfail3() at assfail3+0x2c/frame 0xfffffe0566ec66e0
Jun 23 21:50:51 roflnas fnvlist_pack() at fnvlist_pack+0x50/frame 0xfffffe0566ec6700
Jun 23 21:50:51 roflnas zfs_ioc_pool_stats() at zfs_ioc_pool_stats+0x52/frame 0xfffffe0566ec6740
Jun 23 21:50:51 roflnas zfsdev_ioctl() at zfsdev_ioctl+0x6d5/frame 0xfffffe0566ec67e0
Jun 23 21:50:51 roflnas devfs_ioctl_f() at devfs_ioctl_f+0x128/frame 0xfffffe0566ec6840
Jun 23 21:50:51 roflnas kern_ioctl() at kern_ioctl+0x281/frame 0xfffffe0566ec68b0
Jun 23 21:50:51 roflnas sys_ioctl() at sys_ioctl+0x15c/frame 0xfffffe0566ec6980
Jun 23 21:50:51 roflnas amd64_syscall() at amd64_syscall+0xa4a/frame 0xfffffe0566ec6ab0
Jun 23 21:50:51 roflnas Xfast_syscall() at Xfast_syscall+0xfb/frame 0xfffffe0566ec6ab0
Jun 23 21:50:51 roflnas --- syscall (54, FreeBSD ELF64, sys_ioctl), rip = 0x80196722a, rsp = 0x7fffdd7e6278, rbp = 0x7fffdd7e62f0 ---
Jun 23 21:50:51 roflnas KDB: enter: panic
Hardware wise this is a VM running on ESXi 6.7 with the three LSI cards passed through using VT-d.
There are three RAIDZ2 pools in the box each comprising of 8 drives (one vdev per pool), one pool per HBA. All WD Red drives.
Full specs are in my signature. 20gb RAM assigned to FreeNAS VM which is fully reserved. No dedupe or any other crazy config.
I have a copy of the /var/log directory within 15 mins of the reboot taking place in case it's helpful.
Many thanks for any insight you can share!
Last edited: