Where is my space? Raid-Z2

[RichTJ99]

Hi,

I recently added a 6x 6TB (WD Red) pool to my freenas box. I have been moving most items from my original pool (6x 2TB drives) - FNPool to the new Pool. I have one shared directory /mnt/Pool/Storage & I am trying to figure out what is eating up my space.

I have roughly 8.7TiB of data on the drive (windows explorer says 9.18TB). The calculator says I started with 21.8Tib (-8.7) = 13.1Tib, I have 12.3TiB left, is the 0.8Tib missing from Snapshots?

I read that keeping the free space at 50% is ideal, it has me thinking I should buy a few more drives. If I have 6, is the next ideal step going to 8 drives? If i need to do this then I would rather do it now while I have enough room to move data around for the transition.


Thanks,
Rich

 

[Bidule0hm]

Can you post the output of zfs list -o name,used,avail,compressratio,lrefer,refer,refcompressratio,usedbysnapshots please?

If you don't use VMs you can go up to 80 % instead of 50 % ;)

 

[joeschmuck]

is the 0.8Tib missing from Snapshots?

What I like about you is you at least recognized it could be the snapshots whereas most people seem to think snapshots just don't take that much space. Good for you, of course once you provide the data asked for then you might know where you storage went to, it might not be snapshots but if you have that turned on, well...

 

[rsquared]

I have roughly 8.7TiB of data on the drive (windows explorer says 9.18TB).

I'm guessing they're both correct in their own way. 9.18TB compressed at a 1.05 ratio uses 8.74TB worth of disk space.

 

[RichTJ99]

Thanks for the help folks!

My plan is to use Pool (the big one) for storage. The only part of the VM I might use on "Pool" is CD/ISO storage unless I should just keep it on FNPool.

FNPool, I need to wipe & make a mirror (Pirate mentioned it) with the 6x 2TB drives - Can I do a 6 drive mirror?

Or

I can take the extra Dell T110 II & make it the free ESXI server & run the VM's on it with the VMDK's getting backed up on the main Freenas box.

I have another 6x 2TB drive batch ready to get put into one box or another (total of 12x 2TB's).

Right now, 6x 6TB (pool), 6x 2Tb (FNPool) in the same box.

Thanks,
Rich

Code:

[root@freenas] ~# zfs list -o name,used,avail,compressratio,lrefer,refer,refcompressratio,usedbysnapshots
NAME                                                      USED  AVAIL  RATIO  LREFER  REFER  REFRATIO  USEDSNAP
FNPool                                                   3.70T  3.31T  1.09x   9.50K   192K     1.00x      288K
FNPool/.system                                            185M  3.31T  2.54x   89.8M  89.8M     1.00x     4.11M
FNPool/.system/configs-5ece5c906a8f4df886779fae5cade8a5  4.85M  3.31T  5.12x   13.2M  3.84M     5.21x     1.01M
FNPool/.system/cores                                     8.00M  3.31T  21.09x   18.5M  2.16M    20.20x     5.84M
FNPool/.system/rrd-5ece5c906a8f4df886779fae5cade8a5       192K  3.31T  1.00x   9.50K   192K     1.00x         0
FNPool/.system/samba4                                    76.3M  3.31T  3.98x   12.0M  2.94M     6.91x     73.4M
FNPool/.system/syslog-5ece5c906a8f4df886779fae5cade8a5   1.67M  3.31T  6.98x   5.86M  1.59M     7.00x     79.9K
FNPool/NAS                                               1.65T  3.31T  1.16x   9.50K   192K     1.00x      304K
FNPool/NAS/demodataset                                   1.65T  3.31T  1.16x   1.70T  1.47T     1.18x      191G
FNPool/jails                                             2.05T  3.31T  1.04x     60K   352K     2.72x     3.76M
FNPool/jails/.warden-template-VirtualBox-4.3.12           835M  3.31T  2.01x   1.13G   834M     2.01x      559K
FNPool/jails/.warden-template-pluginjail                  577M  3.31T  1.84x    715M   576M     1.84x     1.39M
FNPool/jails/.warden-template-standard                   2.59G  3.31T  2.13x   1.80G  2.59G     2.13x     1.39M
FNPool/jails/RKplex                                       492M  3.31T  1.44x   2.09G  2.82G     2.00x      123M
FNPool/jails/Virtualbox                                   200G  3.31T  1.46x    271G   193G     1.45x     8.00G
FNPool/jails/crashplan_1                                  554M  3.31T  1.57x   1.19G   987M     1.75x      136M
FNPool/jails/emby_1                                      1.82G  3.31T  1.55x   1.99G  1.64G     1.64x      752M
FNPool/jails/plexmediaserver_1                           1.85T  3.31T  1.00x   1.30G  1.16G     1.61x     1.84T
FNPool/jails/plexmediaserver_1/plexdata                   448K  3.31T  1.00x   9.50K   192K     1.00x      256K
FNPool/jails/subsonic_1                                  1.16G  3.31T  2.27x   1.56G  1.18G     1.83x      551M
Pool                                                     8.71T  12.3T  1.05x   9.50K   192K     1.00x      384K
Pool/Storage                                             8.71T  12.3T  1.05x   9.10T  8.66T     1.05x     47.2G
freenas-boot                                             1.02G  13.0G  2.01x   15.5K    31K     1.00x         0
freenas-boot/ROOT                                        1.01G  13.0G  2.01x   12.5K    25K     1.00x         0
freenas-boot/ROOT/FreeNAS-9.3-STABLE-201512121950        1.01G  13.0G  2.01x   1.00G   524M     1.99x      506M
freenas-boot/ROOT/Initial-Install                           1K  13.0G  1.00x   1013M   510M     2.01x         0
freenas-boot/ROOT/Wizard-2015-12-15_12:12:21                1K  13.0G  1.00x   1014M   510M     2.01x         0
freenas-boot/ROOT/default                                 395K  13.0G  1.09x   1015M   511M     2.01x         0
freenas-boot/grub                                        13.6M  13.0G  1.64x   11.1M  6.79M     1.64x     6.79M
[root@freenas] ~#

 

[Bidule0hm]

Well, you have about 50 GB used by the snapshots but I don't remember if this value includes the space shared by multiple snapshots (there's a recent thread about this thing); @jgreco can you help please?

A 6 drives mirror is possible but is probably not what you want (6 copies of the same data). I guess you want 3 mirrors striped.

 

[jgreco]

I don't want to get into the snapshot space calculation debate. It's a semantic debate and if I need to figure this sort of thing out, usually I find it quicker to go and perform an experiment than to try to dredge through the words.

 

[RichTJ99]

So am I missing space or does it all look OK (enough)?

 

[Bidule0hm]

I don't want to get into the snapshot space calculation debate. It's a semantic debate and if I need to figure this sort of thing out, usually I find it quicker to go and perform an experiment than to try to dredge through the words.

I wasn't asking for a debate, just the answer to "Is the USEDSNAP value taking into account the space shared by multiple snapshots?" :)