Where did all my space go?

[Visseroth]

OK, so I have a LOT of space not available to me. I've tried blowing away snap shots (all but a couple) and that helped some but where did it all go? I've been moving folders and files around trying to re-arrange things and one of my folders I accidentally wiped out and was pulling it from a snap shot but it is a 4TB folder and I don't have enough space. According to the web gui I'm only using about 6TB but I should have TONS left.
zpool list says....

NAME SIZE ALLOC FREE CAP DEDUP HEALTH ALTROOT
storage 21.8T 20.4T 1.34T 93% 1.00x DEGRADED /mnt

I do understand it is degraded. One of my drives blipped out but it is rebuilding currently at 63% complete.

How do I find where all my space is being used? Anyone have any ideas where it went?

 

[Visseroth]

Bump

 

[anodos]

Version of FreeNAS? Hardware specs? Is FreeNAS virtualized?

What is output of 'zpool status'?

 

[Visseroth]

9.2.1.5, dual Xeon 3.2Ghz and no

pool: storage
state: ONLINE
status: One or more devices is currently being resilvered. The pool will
continue to function, possibly in a degraded state.
action: Wait for the resilver to complete.
scan: resilver in progress since Fri Jun 13 19:24:56 2014
11.8T scanned out of 20.4T at 162M/s, 15h27m to go
1015G resilvered, 57.81% done
config:

NAME STATE READ WRITE CKSUM
storage ONLINE 0 0 0
raidz2-0 ONLINE 0 0 0
gptid/a93ca521-2e05-11e2-94a7-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/0901b3e1-c196-11e2-9bcc-003048348d66 ONLINE 0 0 0
gptid/886b66c0-3168-11e2-91cf-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/5173c89c-2ece-11e2-b465-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/426780f3-305c-11e2-82a9-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
ada12 ONLINE 0 0 0 block size: 512B configured, 4096B native
raidz2-1 ONLINE 0 0 0
gptid/719e06f4-2e06-11e2-94a7-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/47688090-2f6d-11e2-bef9-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/d1fb51e4-325d-11e2-9ff7-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/10373ccc-2ecf-11e2-b465-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
gptid/d04581ae-305c-11e2-82a9-003048348d66 ONLINE 0 0 0 block size: 512B configured, 4096B native
ada5p2 ONLINE 0 0 3 block size: 512B configured, 4096B native (resilvering)

errors: No known data errors

I had to start the rebuild again.

 

[anodos]

A few more questions:

What do you mean when you say that the drive "blipped out"?
How many snapshots have you created? What is your snapshotting policy like?
Note if you have snapshots enabled, deleting files will not free up space.
Additionally, deleting individual snapshots does not always free up space. See here: http://docs.oracle.com/cd/E19253-01/819-5461/gbcxc/index.html
If possible, I would temporarily disable snapshotting and stop restructuring things until the resilvering process is complete.
Do you have a backup of your data? If not, then this might be a good time to make one.
What type of HBA do you have in the computer?
What does smartctl say about your drives? Any problems there?
On a side-note, I do not enable snapshotting until I have structured the file-tree exactly how I want it.

 

[Visseroth]

I'm not really sure. The resilvering process didn't complete and two temporary drives were shown so I shut down the machine, fired it back up and restarted the rebuild.
Snap shots take place twice a day, currently enabled and I have deleted most of the old snap shots to free up space. I also emptied the .recycle which freed up a LOT of space.
Agreed. I'll temporarily disable it, thank you.
No, no backups atm and to much data to backup. I don't have anything atm with enough capacity to back it up atm but am in the process of getting the equipment to do so.
HBA?
Smart on all the drives says pass
Agreed, I think that was part of my problem. I managed to free enough space to transfer files back.

 

[anodos]

HBA = Host Bus Adapter Basically, I'm asking how the drives are attached to your computer.
Having a drive randomly disappear and reappear indicates some sort of hardware problem. It could be (among other things) a loose cable, a problematic hot-swap bay, or that your HBA (or RAID card) is flakey. With RAIDZ2 you're theoretically fine as long as another couple of drives don't 'blip out'. As things stand, if I were you I'd back up as much data as possible (a partial backup is better than no backup if you have hardware failure).
Is the resilvering drive connected to your motherboard or to an add-on card?