Explain my filesystem

[toraride]

This is a very old NAS that I am trying to recover, backup and in general get up and running and make it under my control. I am probably already through 50% of the errors it had, but certain things still remain.

I run mount the "mount" command on sh while logged in as root. I am still not fully familiar with FreeNAS and hope someone can explain what my output really means, and how to interpret it. What is what, basically.

Code:

[root@SAN] ~# mount
/dev/ufs/FreeNASs1a on / (ufs, local, read-only)
devfs on /dev (devfs, local, multilabel)
/dev/md0 on /etc (ufs, local)
/dev/md1 on /mnt (ufs, local)
/dev/md2 on /var (ufs, local)
/dev/ufs/FreeNASs4 on /data (ufs, local, noatime, soft-updates)
local on /mnt/local (zfs, local, nfsv4acls)
local/01_ST on /mnt/local/01_ST (zfs, local, nfsv4acls)
local/02_HR on /mnt/local/02_HR (zfs, local, nfsv4acls)
local/03_SOFT on /mnt/local/03_SOFT (zfs, local, nfsv4acls)
local/04_STAFF on /mnt/local/04_STAFF (zfs, local, nfsv4acls)
local/05_ACCOUNT on /mnt/local/05_ACCOUNT (zfs, local, nfsv4acls)
local/06_FINANCE on /mnt/local/06_FINANCE (zfs, local, nfsv4acls)
local/07_GENERAL on /mnt/local/07_GENERAL (zfs, local, nfsv4acls)
local/08_CLIENT on /mnt/local/08_CLIENT (zfs, local, nfsv4acls)
local/09_OPERATIONS on /mnt/local/09_OPERATIONS (zfs, local, nfsv4acls)

 

[m0nkey_]

By the looks of it, your pool name is local and you have 9 datasets.

I recommend you review the documentation.

 

[toraride]

For the specific question I had, could you point me a bit better in the documentation? I have some disks failing on the NAS and I want to make sure I understand the architecture of the given setup.

 

[depasseg]

Can you please provide:
-Hardware specs
-Errors messages you need help with
-output of zpool status (In Code tags please)
-output of zfs list (In Code tags please)

 

[toraride]

Hardware specs:
Build FreeNAS-9.2.0-RELEASE-x64 (ab098f4)
Platform Intel(R) Core(TM) i3-4130 CPU @ 3.40GHz
Memory 32428MB

zpool status

Code:

pool: local
state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas exist for
   the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
  see: http://illumos.org/msg/ZFS-8000-2Q
  scan: scrub repaired 0 in 1h47m with 0 errors on Sun Sep 11 01:47:52 2016
config:

   NAME  STATE  READ WRITE CKSUM
   local  DEGRADED  0  0  0
	raidz2-0  ONLINE  0  0  0
	gptid/7c0ca494-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7ce2fc1b-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7d8c936d-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7e3703d2-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	raidz2-1  DEGRADED  0  0  0
	gptid/7ee44041-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7f91d21f-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	5264591512231518136  UNAVAIL  1  164  22  was /dev/gptid/8057dfbc-adfc-11e3-bd3c-74d02b7ee51f
	gptid/810996b2-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
   logs
	mirror-2  ONLINE  0  0  0
	gptid/814e60e6-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/8161b611-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
   cache
	gptid/8171fbda-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/8182bbba-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0

zfs list

Code:

NAME  USED  AVAIL  REFER  MOUNTPOINT
local  1.23T  5.68T  10.8M  /mnt/local
local/01_ST  1.16T  5.68T  1.16T  /mnt/local/01_ST
local/02_HR  12.6M  5.68T  12.6M  /mnt/local/02_HR
local/03_SOFT  15.2G  5.68T  15.2G  /mnt/local/03_SOFT
local/04_STAFF  52.8G  5.68T  52.8G  /mnt/local/04_STAFF
local/05_ACCOUNT  566M  5.68T  566M  /mnt/local/05_ACCOUNT
local/06_FINANCE  152M  5.68T  152M  /mnt/local/06_FINANCE
local/07_GENERAL  1000M  5.68T  1000M  /mnt/local/07_GENERAL
local/08_CLIENT  2.13G  5.68T  2.13G  /mnt/local/08_CLIENT
local/09_OPERATIONS  82.1M  5.68T  82.1M  /mnt/local/09_OPERATIONS

Error is that I as root have no permissions via rsync to write to /mnt/local which is another topic I have going on here: https://forums.freenas.org/index.php?threads/rsync-permission-problems-in-mnt-local.46710/

What I suspect is that the degraded drives, re-mounted itself as read only, and is now disabling access to core portions of the system such as ssh keys and subfolders as well as not allowing rsync to run its operations on /mnt/local, which is why I am looking at the overal file system again.

Just getting here took several days, as there we problems with pretty much anything in both the network setup and the NAS itself.

 

[depasseg]

What I suspect is that the degraded drives, re-mounted itself as read only, and is now disabling access to core portions of the system such as ssh keys and subfolders as well as not allowing rsync to run

A degraded vdev won't do that. If you have a failing drive, it can slow down performance, but in your case it appears the drive is gone, so you really shouldn't notice anything (except alerts) due to the degradation. Have you tried replacing the failed drive with a new one, and letting it resilver?

 

[toraride]

Not there yet. My main concern is the fact that I cant write to ~/.ssh and that rsync is prevented from accessing /mnt/ if triggered by CRON or .sh

 

[Spearfoot]

Hardware specs:
Build FreeNAS-9.2.0-RELEASE-x64 (ab098f4)
Platform Intel(R) Core(TM) i3-4130 CPU @ 3.40GHz
Memory 32428MB

zpool status

Code:

pool: local
state: DEGRADED
status: One or more devices could not be opened.  Sufficient replicas exist for
   the pool to continue functioning in a degraded state.
action: Attach the missing device and online it using 'zpool online'.
  see: http://illumos.org/msg/ZFS-8000-2Q
  scan: scrub repaired 0 in 1h47m with 0 errors on Sun Sep 11 01:47:52 2016
config:

   NAME  STATE  READ WRITE CKSUM
   local  DEGRADED  0  0  0
	raidz2-0  ONLINE  0  0  0
	gptid/7c0ca494-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7ce2fc1b-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7d8c936d-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7e3703d2-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	raidz2-1  DEGRADED  0  0  0
	gptid/7ee44041-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/7f91d21f-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	5264591512231518136  UNAVAIL  1  164  22  was /dev/gptid/8057dfbc-adfc-11e3-bd3c-74d02b7ee51f
	gptid/810996b2-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
   logs
	mirror-2  ONLINE  0  0  0
	gptid/814e60e6-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/8161b611-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
   cache
	gptid/8171fbda-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0
	gptid/8182bbba-adfc-11e3-bd3c-74d02b7ee51f  ONLINE  0  0  0

zfs list

Code:

NAME  USED  AVAIL  REFER  MOUNTPOINT
local  1.23T  5.68T  10.8M  /mnt/local
local/01_ST  1.16T  5.68T  1.16T  /mnt/local/01_ST
local/02_HR  12.6M  5.68T  12.6M  /mnt/local/02_HR
local/03_SOFT  15.2G  5.68T  15.2G  /mnt/local/03_SOFT
local/04_STAFF  52.8G  5.68T  52.8G  /mnt/local/04_STAFF
local/05_ACCOUNT  566M  5.68T  566M  /mnt/local/05_ACCOUNT
local/06_FINANCE  152M  5.68T  152M  /mnt/local/06_FINANCE
local/07_GENERAL  1000M  5.68T  1000M  /mnt/local/07_GENERAL
local/08_CLIENT  2.13G  5.68T  2.13G  /mnt/local/08_CLIENT
local/09_OPERATIONS  82.1M  5.68T  82.1M  /mnt/local/09_OPERATIONS

Error is that I as root have no permissions via rsync to write to /mnt/local which is another topic I have going on here: https://forums.freenas.org/index.php?threads/rsync-permission-problems-in-mnt-local.46710/

What I suspect is that the degraded drives, re-mounted itself as read only, and is now disabling access to core portions of the system such as ssh keys and subfolders as well as not allowing rsync to run its operations on /mnt/local, which is why I am looking at the overal file system again.

Just getting here took several days, as there we problems with pretty much anything in both the network setup and the NAS itself.

I addressed the rsync permissions problems you're having over in the relevant thread. Hope that helps...

From the looks of it, you've got one bad disk in vdev raidz2-1; replace it and your pool should be good-to-go.

Good luck!