Please help! Started up FreeNAS, suddenly voluime storage (ZFS) status unknown?!

Status
Not open for further replies.
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Oops...

When it's done, I will post the results, wait your response and run the commands in the given order as your post #118

Correct? Though guessing the past experience this will take some time though.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
Code:
camcontrol devlist

glabel status


Adjust for the disk names, e.g. da:
Code:
swapctl -a /dev/da0p1 /dev/da1p1 /dev/da2p1


For each disk:
Code:
zdb -luuu /dev/daXp2


Code:
zdb -e -uuuv storage

zdb -e -h storage



Run this one now. Open a 2[sup]nd[/sup] SSH session:
Code:
gstat -I1s -f 'a?da[0-9]+$'
Look for any disks that are always busy.
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
This was the output of the command I ran to quickly:

Code:
root@mfsbsd:/root # time zdb -e -bcsvL storage

Traversing all blocks to verify checksums ...
Segmentation fault (core dumped)
538.672u 185.228s 42:28.72 28.4%        84+2937k 13534329+0io 200pf+0w


I will now start running the commands above.

- - - Updated - - -

Code:
root@mfsbsd:/root # camcontrol devlist
<ATA WDC WD20EARX-00P AB51>        at scbus0 target 0 lun 0 (pass0,da0)
<ATA WDC WD20EARX-00P AB51>        at scbus0 target 1 lun 0 (pass1,da1)
<ATA WDC WD20EARX-00P AB51>        at scbus0 target 2 lun 0 (pass2,da2)
<ATA WDC WD20EARX-00P AB51>        at scbus0 target 3 lun 0 (pass3,da3)
<ATA WDC WD20EARX-00P AB51>        at scbus0 target 4 lun 0 (pass4,da4)
<ATA WDC WD20EARX-008 AB51>        at scbus0 target 5 lun 0 (pass5,da5)
<SanDisk Extreme 0001>

root@mfsbsd:/root # glabel status
                                      Name  Status  Components
                    ufsid/50ee738f6b8b4567     N/A  md0
gptid/1aefa3e9-25fa-11e2-9ab0-00151736994a     N/A  da0p2
gptid/1c2d6a74-25fa-11e2-9ab0-00151736994a     N/A  da1p2
gptid/1b8f2b64-25fa-11e2-9ab0-00151736994a     N/A  da2p2
gptid/19a8970f-25fa-11e2-9ab0-00151736994a     N/A  da3p1
gptid/19b5ec3a-25fa-11e2-9ab0-00151736994a     N/A  da3p2
gptid/19097432-25fa-11e2-9ab0-00151736994a     N/A  da4p1
gptid/19177fb9-25fa-11e2-9ab0-00151736994a     N/A  da4p2
gptid/3db06e5a-3de6-11e2-8af1-00151736994a     N/A  da5p1
gptid/3dc2f956-3de6-11e2-8af1-00151736994a     N/A  da5p2
                    ufsid/50ee739507e96f49     N/A  da6a


I also ran: swapctl -a /dev/da0p1 /dev/da1p1 /dev/da2p1

After that: zdb -luuu /dev/da0p2
However the output is way, way to big to display...? I can only copy a small part of it??

Should I continue with the commands or what...?
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Or do I have to run this?

Code:
mkdir /var/zfs
cd /var/zfs
zdb -lu /dev/ada0p2 > ada0.uber
zdb -lu /dev/ada1p2 > ada1.uber
zdb -lu /dev/ada2p2 > ada2.uber
zdb -lu /dev/ada3p2 > ada3.uber
zdb -lu /dev/ada4p2 > ada4.uber
zdb -lu /dev/ada5p2 > ada5.uber


Because you said, like before... However the code you now gave me is different and shorter?


- - - Updated - - -


Arghhh... cannot open '/dev/ada0p2': No such file or directory
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
Code:
zdb -luuu /dev/da0p2 > da0.uber
zdb -luuu /dev/da1p2 > da1.uber
zdb -luuu /dev/da2p2 > da2.uber
zdb -luuu /dev/da3p2 > da3.uber
zdb -luuu /dev/da4p2 > da4.uber
zdb -luuu /dev/da5p2 > da5.uber
 
P

ProtoSD

MVP
Joined
Jul 1, 2011
Messages
3,348
HHawk said:
Code:
gptid/19a8970f-25fa-11e2-9ab0-00151736994a     N/A  da3p1
gptid/19097432-25fa-11e2-9ab0-00151736994a     N/A  da4p1
gptid/3db06e5a-3de6-11e2-8af1-00151736994a     N/A  da5p1


I also ran: swapctl -a /dev/da0p1 /dev/da1p1 /dev/da2p1
Click to expand...

Strange, there's only swap partitions on the 3 above drives, instead of all of them. Those are the ones you want to run the "swapctl -a" commands on.
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
ProtoSD said:
Strange, there's only swap partitions on the 3 above drives, instead of all of them.
Click to expand...
I believe that's because swap was already turned on for the first three drives.
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Code:
root@mfsbsd:/var/zfs # zdb -e -uuuv storage

Uberblock:
        magic = 0000000000bab10c
        version = 28
        txg = 735273
        guid_sum = 15335734231262207449
        timestamp = 1363313166 UTC = Fri Mar 15 02:06:06 2013
        rootbp = DVA[0]=<0:5004f14c000:3000> DVA[1]=<0:33087645000:3000> DVA[2]=<0:6701aa1e000:3000> [L0 DMU objset] fletcher4 lzjb LE contiguous unique triple size=800L/200P birth=735273L/735273P fill=154 cksum=be6f62427:495d7c8f8f4:e74d2ea68fb4:1f153aea17e724



Command: zdb -e -h storage
Was to big for my screen, but below is a partial output.

Code:
2012-11-14.19:15:42 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-14.19:15:42 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-14.19:29:11 [internal pool import txg:69270] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-14.19:29:11 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-14.19:29:11 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-14.19:51:28 [internal pool import txg:69515] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-14.19:51:28 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-14.19:51:28 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-14.20:47:18 [internal pool import txg:70170] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-14.20:47:18 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-14.20:47:18 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-15.21:10:04 [internal pool import txg:71992] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-15.21:10:04 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-15.21:10:04 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-15.21:34:17 [internal pool import txg:72267] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-15.21:34:17 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-15.21:34:17 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-15.21:56:00 [internal pool import txg:72512] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-15.21:56:00 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-15.21:56:00 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-16.21:55:54 [internal pool import txg:73714] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-16.21:55:55 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-16.21:55:55 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-17.09:35:44 [internal pool import txg:75511] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-17.09:35:44 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-17.09:35:44 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-17.17:40:23 [internal pool import txg:78132] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-17.17:40:23 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-17.17:40:23 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-18.21:25:03 [internal pool import txg:82937] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-18.21:25:03 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-18.21:25:03 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-19.20:23:47 [internal pool import txg:83939] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-19.20:23:47 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-19.20:23:47 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-20.17:01:54 [internal pool import txg:86146] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-20.17:01:54 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-20.17:01:54 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-21.21:15:29 [internal pool import txg:91574] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-21.21:15:29 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-21.21:15:29 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-22.17:14:59 [internal pool import txg:93434] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-22.17:14:59 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-22.17:14:59 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-25.21:41:30 [internal pool import txg:98014] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-25.21:41:30 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-25.21:41:30 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-26.17:33:03 [internal pool import txg:99104] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-26.17:33:04 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-26.17:33:04 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-27.07:56:42 [internal pool scrub txg:109520] func=1 mintxg=0 maxtxg=109520
2012-11-27.07:56:51 zpool scrub storage
2012-11-27.11:39:34 [internal pool scrub done txg:111629] complete=1
2012-11-28.16:52:50 [internal pool import txg:120305] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-28.16:52:50 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-28.16:52:50 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-28.19:49:25 zpool offline storage gptid/1a551ccf-25fa-11e2-9ab0-00151736994a
2012-11-29.06:46:48 [internal pool import txg:122445] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-29.06:46:49 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-29.06:46:49 zpool set cachefile=/data/zfs/zpool.cache storage
2012-11-29.06:52:16 [internal pool import txg:122485] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-11-29.06:52:16 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-11-29.06:52:16 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.15:51:20 [internal pool import txg:132764] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-03.15:51:20 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-03.15:51:20 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.15:59:08 [internal pool import txg:132839] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-03.15:59:08 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-03.15:59:08 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.17:59:33 [internal pool import txg:134207] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-03.17:59:33 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-03.17:59:33 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.18:12:49 [internal pool import txg:134345] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-03.18:12:49 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-03.18:12:49 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.18:31:22 [internal pool import txg:134553] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-03.18:31:22 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-03.18:31:22 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-03.18:55:47 zpool online storage 6201553240551106299
2012-12-03.18:56:40 zpool offline storage 6201553240551106299
2012-12-04.07:43:07 [internal pool scrub txg:144061] func=2 mintxg=3 maxtxg=144061
2012-12-04.07:43:18 [internal vdev attach txg:144063] replace vdev=/dev/gptid/3dc2f956-3de6-11e2-8af1-00151736994a for vdev=/dev/gptid/1a551ccf-25fa-11e2-9ab0-00151736994a
2012-12-04.07:43:18 zpool replace storage 6201553240551106299 gptid/3dc2f956-3de6-11e2-8af1-00151736994a
2012-12-04.11:05:45 [internal pool scrub done txg:145931] complete=1
2012-12-04.12:04:26 [internal pool import txg:146620] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-04.12:04:26 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-04.12:04:26 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-04.12:39:23 [internal vdev detach txg:147040] vdev=/dev/gptid/1a551ccf-25fa-11e2-9ab0-00151736994a
2012-12-04.12:39:23 zpool detach storage 6201553240551106299
2012-12-04.12:43:54 [internal pool import txg:147079] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-04.12:43:54 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-04.12:43:54 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-04.13:53:44 [internal pool scrub txg:147917] func=1 mintxg=0 maxtxg=147917
2012-12-04.13:53:52 zpool scrub storage
2012-12-04.17:23:19 [internal pool scrub done txg:149909] complete=1
2012-12-05.18:08:40 [internal pool import txg:153722] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-05.18:08:40 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-05.18:08:40 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-06.16:45:43 [internal pool import txg:157761] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-06.16:45:43 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-06.16:45:43 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-07.07:40:30 [internal pool import txg:163054] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-07.07:40:30 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-07.07:40:30 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-09.21:08:17 [internal pool import txg:192368] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-09.21:08:18 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-09.21:08:18 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-10.20:07:02 [internal pool import txg:200361] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-10.20:07:02 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-10.20:07:02 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-11.20:54:23 [internal pool import txg:202449] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-11.20:54:23 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-11.20:54:23 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-12.20:26:01 [internal pool import txg:204175] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-12.20:26:01 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-12.20:26:01 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-13.20:06:26 [internal pool import txg:206146] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-13.20:06:26 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-13.20:06:26 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-14.23:04:06 [internal pool import txg:207963] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-14.23:04:06 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-14.23:04:06 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-15.13:43:23 [internal pool import txg:208833] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-15.13:43:23 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-15.13:43:23 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-15.19:05:34 [internal pool import txg:212723] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-15.19:05:34 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-15.19:05:34 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-16.14:36:38 [internal pool import txg:216444] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-16.14:36:38 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-16.14:36:38 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-17.21:52:32 [internal pool import txg:222597] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-17.21:52:32 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-17.21:52:32 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-18.21:44:11 [internal pool import txg:223467] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-18.21:44:11 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-18.21:44:11 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-19.19:54:13 [internal pool import txg:224676] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-19.19:54:13 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-19.19:54:13 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-20.16:39:15 [internal pool import txg:227177] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-20.16:39:15 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-20.16:39:15 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-21.20:00:09 [internal pool import txg:232183] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-21.20:00:09 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-21.20:00:09 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-23.01:46:58 [internal pool import txg:235756] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-23.01:46:58 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-23.01:46:58 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-24.16:05:30 [internal pool import txg:251660] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-24.16:05:30 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-24.16:05:30 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-25.23:14:46 [internal pool import txg:257519] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-25.23:14:46 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-25.23:14:46 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-28.11:21:44 [internal pool import txg:300185] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2012-12-28.11:21:44 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2012-12-28.11:21:44 zpool set cachefile=/data/zfs/zpool.cache storage
2012-12-30.10:21:23 [internal pool scrub txg:334091] func=1 mintxg=0 maxtxg=334091
2012-12-30.10:21:31 zpool scrub storage
2012-12-30.14:10:44 [internal pool scrub done txg:336245] complete=1
2013-01-01.13:57:48 [internal pool import txg:378293] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-01.13:57:48 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-01.13:57:48 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-02.19:52:53 [internal pool import txg:387982] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-02.19:52:53 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-02.19:52:53 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-03.20:07:31 [internal pool import txg:392750] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-03.20:07:31 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-03.20:07:37 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-03.21:22:36 [internal pool import txg:394134] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-03.21:22:36 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-03.21:22:36 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-04.18:03:24 [internal pool import txg:396982] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-04.18:03:24 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-04.18:03:24 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-05.13:32:17 [internal pool import txg:421151] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-05.13:32:17 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-05.13:32:17 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-07.21:37:11 [internal pool import txg:446168] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-07.21:37:11 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-07.21:37:11 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-08.21:44:58 [internal pool import txg:447606] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-08.21:44:58 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-08.21:44:58 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-09.20:56:44 [internal pool import txg:449207] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-09.20:56:44 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-09.20:56:44 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-10.21:56:50 [internal pool import txg:450801] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-10.21:56:50 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-10.21:56:50 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-11.18:11:31 [internal pool import txg:452065] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-11.18:11:31 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-11.18:11:31 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-14.16:33:27 [internal pool import txg:495545] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-14.16:33:27 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-14.16:33:27 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.13:26:53 [internal pool import txg:496179] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.13:26:53 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.13:26:53 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.13:55:32 [internal pool import txg:496500] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.13:55:32 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.13:55:32 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.14:03:49 [internal pool import txg:496578] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.14:03:50 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.14:03:50 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.14:08:19 [internal pool import txg:496612] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.14:08:19 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.14:08:19 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.14:15:17 [internal pool import txg:496680] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.14:15:17 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.14:15:17 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.21:22:08 [internal pool import txg:496856] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.21:22:08 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.21:22:08 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-15.22:31:21 [internal pool import txg:497682] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-15.22:31:21 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-15.22:31:21 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-16.19:45:18 [internal pool import txg:498140] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-16.19:45:18 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-16.19:45:18 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-16.21:21:42 [internal pool import txg:499283] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-16.21:21:42 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-16.21:21:42 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-17.20:25:00 [internal pool import txg:500471] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-17.20:25:00 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-17.20:25:00 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-18.19:40:54 [internal pool import txg:501777] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-18.19:40:54 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-18.19:40:54 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-19.08:33:11 [internal pool import txg:504573] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-19.08:33:11 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-19.08:33:11 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-21.21:42:10 [internal pool import txg:532487] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-21.21:42:10 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-21.21:42:10 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-22.17:58:18 [internal pool import txg:533579] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-22.17:58:18 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-22.17:58:18 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-23.21:13:03 [internal pool import txg:542448] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-23.21:13:03 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-23.21:13:03 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-24.16:35:48 [internal pool import txg:543984] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-24.16:35:48 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-24.16:35:48 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-25.16:51:22 [internal pool import txg:548720] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-25.16:51:22 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-25.16:51:22 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-26.00:42:56 [internal pool scrub txg:554585] func=1 mintxg=0 maxtxg=554585
2013-01-26.00:43:04 zpool scrub storage
2013-01-26.04:30:00 [internal pool scrub done txg:556756] complete=1
2013-01-26.19:30:25 [internal pool import txg:567547] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-26.19:30:25 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-26.19:30:25 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-28.20:52:12 [internal pool import txg:587564] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-28.20:52:12 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-28.20:52:12 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-29.19:53:30 [internal pool import txg:588725] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-29.19:53:30 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-29.19:53:30 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-30.22:19:25 [internal pool import txg:591429] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-30.22:19:25 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-30.22:19:25 zpool set cachefile=/data/zfs/zpool.cache storage
2013-01-31.20:36:20 [internal pool import txg:592367] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-01-31.20:36:20 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-01-31.20:36:20 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-01.18:59:06 [internal pool import txg:594309] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-01.18:59:06 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-01.18:59:06 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-02.18:20:56 [internal pool import txg:607452] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-02.18:20:56 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-02.18:20:56 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-03.22:02:15 [internal pool import txg:610983] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-03.22:02:15 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-03.22:02:15 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-04.19:45:19 [internal pool import txg:611153] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-04.19:45:19 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-04.19:45:19 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-05.20:39:00 [internal pool import txg:613856] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-05.20:39:00 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-05.20:39:00 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-06.18:48:00 [internal pool import txg:616177] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-06.18:48:00 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-06.18:48:00 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-07.21:50:14 [internal pool import txg:618969] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-07.21:50:14 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-07.21:50:14 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-08.20:51:21 [internal pool import txg:619831] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-08.20:51:21 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-08.20:51:21 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-10.09:09:13 [internal pool import txg:622056] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-10.09:09:13 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-10.09:09:13 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-11.21:20:08 [internal pool import txg:632075] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-11.21:20:08 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-11.21:20:08 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-12.21:17:22 [internal pool import txg:633473] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-12.21:17:22 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-12.21:17:22 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-13.17:25:52 [internal pool import txg:634911] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-13.17:25:52 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-13.17:25:52 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-14.20:57:40 [internal pool import txg:639180] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-14.20:57:40 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-14.20:57:40 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-15.21:05:50 [internal pool import txg:639965] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-15.21:05:50 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-15.21:05:50 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-16.14:41:54 [internal pool import txg:641882] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-16.14:41:54 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-16.14:41:54 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-18.21:57:19 [internal pool import txg:665506] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-18.21:57:19 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-18.21:57:19 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-19.21:08:05 [internal pool import txg:666563] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-19.21:08:05 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-19.21:08:05 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-20.21:23:24 [internal pool import txg:668255] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-20.21:23:24 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-20.21:23:24 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-21.21:06:01 [internal pool import txg:669432] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-21.21:06:01 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-21.21:06:01 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-22.21:04:29 [internal pool import txg:671258] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-22.21:04:29 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-22.21:04:29 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-23.13:26:53 [internal pool import txg:673760] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-23.13:26:53 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-23.13:26:53 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-23.23:23:26 [internal pool scrub txg:680963] func=1 mintxg=0 maxtxg=680963
2013-02-23.23:23:34 zpool scrub storage
2013-02-24.03:13:57 [internal pool scrub done txg:683165] complete=1
2013-02-24.20:16:41 [internal pool import txg:687022] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-24.20:16:41 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-24.20:16:41 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-25.20:18:21 [internal pool import txg:689003] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-25.20:18:21 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-25.20:18:21 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-26.19:52:22 [internal pool import txg:691351] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-26.19:52:22 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-26.19:52:22 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-27.21:38:30 [internal pool import txg:693857] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-27.21:38:30 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-27.21:38:30 zpool set cachefile=/data/zfs/zpool.cache storage
2013-02-28.21:20:54 [internal pool import txg:695038] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-02-28.21:20:54 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-02-28.21:20:54 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-02.13:56:21 [internal pool import txg:697085] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-02.13:56:21 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-02.13:56:21 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-04.21:35:27 [internal pool import txg:721271] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-04.21:35:27 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-04.21:35:27 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-05.22:09:03 [internal pool import txg:722663] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-05.22:09:03 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-05.22:09:03 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-06.20:34:45 [internal pool import txg:723609] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-06.20:34:45 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-06.20:34:45 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-07.22:17:51 [internal pool import txg:725973] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-07.22:17:51 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-07.22:17:51 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-10.00:44:58 [internal pool import txg:727008] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-10.00:44:58 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-10.00:44:58 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-10.22:10:58 [internal pool import txg:727504] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-10.22:10:59 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-10.22:10:59 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-11.22:13:13 [internal pool import txg:728722] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-11.22:13:13 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-11.22:13:13 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-12.22:13:05 [internal pool import txg:729986] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-12.22:13:05 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-12.22:13:05 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-13.21:39:49 [internal pool import txg:731149] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-13.21:39:49 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-13.21:39:49 zpool set cachefile=/data/zfs/zpool.cache storage
2013-03-14.22:03:31 [internal pool import txg:732362] pool spa 28; zfs spa 28; zpl 5; uts  8.3-RELEASE-p4 803000 amd64
2013-03-14.22:03:31 zpool import -o cachefile=none -R /mnt -f 17472259698871586545
2013-03-14.22:03:31 zpool set cachefile=/data/zfs/zpool.cache storage
root@mfsbsd:/var/zfs #


Code:
dT: 1.001s  w: 1.000s  filter: a?da[0-9]+$
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    0      0      0      0    0.0      0      0    0.0    0.0| da0
    0      0      0      0    0.0      0      0    0.0    0.0| da1
    0      0      0      0    0.0      0      0    0.0    0.0| da2
    0      0      0      0    0.0      0      0    0.0    0.0| da3
    0      0      0      0    0.0      0      0    0.0    0.0| da4
    0      0      0      0    0.0      0      0    0.0    0.0| da5
    0      0      0      0    0.0      0      0    0.0    0.0| da6


Not much happening...?

//edit

If I run ' zdb -e -h storage' several times after each other, the percentages / numbers increase above for a short time, but nothing special imho? :S
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
HHawk said:
Command: zdb -e -h storage
Was to big for my screen, but below is a partial output.
Click to expand...
This should be sufficient.

HHawk said:
Not much happening...?
Click to expand...
Not yet.

HHawk said:
If I run ' zdb -e -h storage' several times after each other, the percentages / numbers increase above for a short time, but nothing special imho? :S
Click to expand...
Give me a minute to look it over. You can run this in the meantime:
Code:
sysctl vfs.zfs.debug
sysctl vfs.zfs.recover
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
paleoN said:
Give me a minute to look it over. You can run this in the meantime:
Code:
sysctl vfs.zfs.debug
sysctl vfs.zfs.recover
Click to expand...

Okay, thanks.
I ran the commands.

Code:
root@mfsbsd:/var/zfs # sysctl vfs.zfs.debug
vfs.zfs.debug: 1
root@mfsbsd:/var/zfs # sysctl vfs.zfs.recover
vfs.zfs.recover: 1
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
HHawk said:
Okay, thanks.
I ran the commands.
Click to expand...
Good, looks fine.

Do me a favor for this next part and don't go running anything before I ask you.

We should expect several of these import commands to fail unless we get lucky right away. To begin with:
Code:
zpool import -T 735272 -o rdonly=on storage

zpool status -v
Then report back. Nothing else if you please.
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Hey, I ran the first command

Code:
zpool import -T 735272 -o rdonly=on storage


(it's still running at the moment)

But I still had the 2nd screen open and I saw something weird?

Code:
dT: 1.001s  w: 1.000s  filter: a?da[0-9]+$
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    3   1171   1171  76484    5.1      0      0    0.0   76.9| da0
   10    965    965  61427    4.8      0      0    0.0   64.5| da1
   10   1304   1304 102994    7.1      0      0    0.0   99.4| da2
   10   1179   1179  83329    4.5      0      0    0.0   60.8| da3
   10    971    971  63173    4.6      0      0    0.0   61.7| da4
   10   1299   1299  77583    7.5      0      0    0.0   99.1| da5
    0      0      0      0    0.0      0      0    0.0    0.0| da6


da6 is all the time 0% busy?!

Oh wait I don't have da6... Sorry stupid. :(
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
paleoN said:
That's the mfsBSD drive. It shouldn't have any activity.
Click to expand...

Yeah sorry, I realised that after I posted it... :(

Drives still very active:

Code:
dT: 1.001s  w: 1.000s  filter: a?da[0-9]+$
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    9   1325   1325  58760    5.3      0      0    0.0   72.0| da0
    4    719    719  66139    6.2      0      0    0.0   49.9| da1
    9   1722   1722  91028    5.6      0      0    0.0   99.5| da2
    8   1443   1443  65049    4.9      0      0    0.0   71.8| da3
    9    497    497  56866   13.5      0      0    0.0   70.1| da4
    7   1387   1387  62563    5.2      0      0    0.0   73.8| da5
    0      0      0      0    0.0      0      0    0.0    0.0| da6
 
P

ProtoSD

MVP
Joined
Jul 1, 2011
Messages
3,348
HHawk said:
Yeah sorry, I realised that after I posted it... :(

Drives still very active:

Code:
dT: 1.001s  w: 1.000s  filter: a?da[0-9]+$
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
    9   1325   1325  58760    5.3      0      0    0.0   72.0| da0
    4    719    719  66139    6.2      0      0    0.0   49.9| da1
    9   1722   1722  91028    5.6      0      0    0.0   99.5| da2
    8   1443   1443  65049    4.9      0      0    0.0   71.8| da3
    9    497    497  56866   13.5      0      0    0.0   70.1| da4
    7   1387   1387  62563    5.2      0      0    0.0   73.8| da5
    0      0      0      0    0.0      0      0    0.0    0.0| da6
Click to expand...

da2 looks like it's a lot busier than the others though. Did you run and SMART tests on that?
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
ProtoSD said:
da2 looks like it's a lot busier than the others though. Did you run and SMART tests on that?
Click to expand...

Yes 2x times already one short and one long. No problems whatsoever.
And I think it doesn't matter, because it doesn't stay like that... It changes every 1 second.

See:
Code:
dT: 1.001s  w: 1.000s  filter: a?da[0-9]+$
 L(q)  ops/s    r/s   kBps   ms/r    w/s   kBps   ms/w   %busy Name
   10    658    658  52363    6.2      0      0    0.0   58.5| da0
   10   1005   1005  63152    6.5      0      0    0.0   73.2| da1
   10   1068   1068  88706    5.1      0      0    0.0   63.3| da2
    9   1119   1119  82429    7.9      0      0    0.0   92.2| da3
   10    922    922  56263    6.2      0      0    0.0   64.1| da4
   10    693    693  87076   14.0      0      0    0.0   99.1| da5
    0      0      0      0    0.0      0      0    0.0    0.0| da6
 
paleoN

paleoN

Wizard
Joined
Apr 22, 2012
Messages
1,403
HHawk said:
And I think it doesn't matter, because it doesn't stay like that... It changes every 1 second.
Click to expand...
Yes, if it was pegged the whole time that would be a symptom. As long as it's fluctuating like the other disks and e.g. the L(q) & ms/r are in range it's fine. Just keep an eye on the disks.
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Outcome:

Code:
root@mfsbsd:/var/zfs # zpool import -T 735272 -o rdonly=on storage
cannot import 'storage': one or more devices is currently unavailable
root@mfsbsd:/var/zfs # zpool status -v
no pools available
root@mfsbsd:/var/zfs #


The first command took a long time...
 
H

HHawk

Contributor
Joined
Jun 8, 2011
Messages
176
Well I am going to work in a short while, however I forwarded my ports so I can access the NAS trough SSH.
 
Status
Not open for further replies.

Similar threads

K
  • Locked
Deleted jail & plugins but can't re-install
Replies
1
Views
1K
dlavigne
D
N
  • Locked
Secure FTP issues
Replies
4
Views
2K
underpickled
underpickled
P
  • Locked
Unable to set up freeness in GUI
Replies
3
Views
1K
cyberjock
C
P
  • Locked
Help at starting freeNAS OS
Replies
5
Views
1K
Michael Wulff Nielsen
Michael Wulff Nielsen
M
  • Locked
FreeNAS 8.3.1 crashes when adding an iSCSI device extent
Replies
6
Views
4K
soibien
S
Top