Yet another Config/Zpool question

[DtEarth]

Freenas 9.2.1.7
I've dug around the forums for a few days and just haven't found an answer to my problem and/or question. First I'd like to know when does your USB config file get overwritten besides during an install or upgrade?

Reason I ask:
I made a pinky mistake and hit enter too quickly during a command line permission change. Upon a restart I got pam_start errors. Also couldn't get to shell from Console setup. I then rebooted with another USB containing Freenas 9.3. Just to see if I could get to the webGUI. Worked fine. I then pulled my old config file off the 9.2.1.7 usb. However; the zpool import was incorrect. Only thing I can remember that I may have done wrong is, while on 9.2.1.7 usb, on the console setup, I run a Reset to factory default.

Now my problem is the only zpool I get is freenas-boot, mirror-0, with two drives showing. My old ZFS was three, 3TB, RaidZ. I corrected the incorrect permissions and was able to boot back into 9.2.1.7 correctly. Well as far as I can tell.

I don't believe I have made changes to my pool that could have damaged my data. At least I hope not. Here is a log of current: zpool status, import, history, list, and gpart show. If this is incorrect way of posting files please let me know.

Maybe you experts can help. I'm pretty noob when it comes freenas as I only touch, what I call advanced, freenas and command line every few years it seems.

Many thanks for any help anyone can give.

 

[Robert Trevellyan]

It looks like you installed FreeNAS to your data drives.

 

[DtEarth]

Well that's not good. Any way to confirm that? I know I would have done that purposely.

 

[Sakuru]

First I'd like to know when does your USB config file get overwritten besides during an install or upgrade?

The config file gets written to any time you change a setting.
Please post the output of "zpool import" and "camcontrol devlist" in CODE tags.

 

[Robert Trevellyan]

Well that's not good. Any way to confirm that? I know I would have done that purposely.

Here's what I see in the file you posted:

# zpool status -v

pool: freenas-boot
state: ONLINE
status: Some supported features are not enabled on the pool. The pool can
still be used, but some features are unavailable.
action: Enable all features using 'zpool upgrade'. Once this is done,
the pool may no longer be accessible by software that does not support
the features. See zpool-features(7) for details.
scan: resilvered 242M in 0h0m with 0 errors on Wed Jun 1 08:22:59 2016
config:

NAME STATE READ WRITE CKSUM
freenas-boot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada0p2 ONLINE 0 0 0
ada1p2 ONLINE 0 0 0
ada2p2 ONLINE 0 0 0
=> 34 5860533101 ada0 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

=> 34 5860533101 ada1 GPT (2.7T)
34 94 - free - (47k)
128 4194304 1 freebsd-swap (2.0G)
4194432 5856338696 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

=> 34 5860533101 ada2 GPT (2.7T)
34 6 - free - (3.0k)
40 1024 1 bios-boot (512k)
1064 5860532064 2 freebsd-zfs (2.7T)
5860533128 7 - free - (3.5k)

#Zpool list

NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT
freenas-boot 2.72T 242M 2.72T 0% 1.00x ONLINE /mnt

This shows that freenas-boot is a 3-way mirror with a 2.72TB capacity.

 

[Sakuru]

Oh yeah, the attached file

Code:

History for 'freenas-boot':
2016-05-30.08:13:45 zpool create -f -o cachefile=/tmp/zpool.cache -o version=28 -O mountpoint=none -O atime=off -O canmount=off freenas-boot mirror ada0p2 ada1p2 ada2p2

Unfortunately, it looks like you installed FreeNAS to your 3 3 TB disks instead of your boot drive.

 

[DtEarth]

camcontrol devlist

Code:

<WDC WD30EFRX-68EUZN0 82.00A82>    at scbus4 target 0 lun 0 (ada0,pass0)       
<WDC WD30EFRX-68EUZN0 80.00A80>    at scbus5 target 0 lun 0 (ada1,pass1)       
<WDC WD30EFRX-68EUZN0 80.00A80>    at scbus5 target 1 lun 0 (ada2,pass2)       
<SanDisk Cruzer 1.26>              at scbus9 target 0 lun 0 (pass3,da0)         

Nothing returns from zpool import.

 

[Robert Trevellyan]

freenas-boot ONLINE 0 0 0
mirror-0 ONLINE 0 0 0
ada0p2 ONLINE 0 0 0
ada1p2 ONLINE 0 0 0
ada2p2 ONLINE 0 0 0

<WDC WD30EFRX-68EUZN0 82.00A82> at scbus4 target 0 lun 0 (ada0,pass0)
<WDC WD30EFRX-68EUZN0 80.00A80> at scbus5 target 0 lun 0 (ada1,pass1)
<WDC WD30EFRX-68EUZN0 80.00A80> at scbus5 target 1 lun 0 (ada2,pass2)

See how the device names match (ada0, ada1, ada2)? Your freenas-boot pool is on your 3 WD Red 3TB disks.

Nothing returns from zpool import.

Because there is no pool to import. The only pool you have is the freenas-boot pool, and that's already imported.

 

[DtEarth]

Ugggg, I'm not saying I didn't do that, of course, but I know when I put in the second usb I chose the correct usb to install it on. Each usb was a different size. Wanted to make sure I installed it to the correct drive. Guess trying to make it fail proof didn't.

 

[DtEarth]

Gotcha Robert. Thanks for clearing that up for me. From reading and figure out so many different things I got confused. New it was time to come here for help from you guys.

 

[Robert Trevellyan]

Ugggg

Yup, sucks, hate to see this happen to anyone.

 

[DtEarth]

That is true. I have backups of the important stuff. Just time to rebuild everything. Specially the 1300 movie files. Oh well live and learn. At least it wasn't a job site server.