ZFS is losing files

[user12345fs]

hello,
i have been using a freenas with zfs for acouple of years, with cifs to share. lately i have been losing files at random. i have a feeling that even though the drives show that it has space, it's actually is overwritting old files as new files are being copied to it for whatever reason. is zfs not aware of its available space? the only folder i copy new files to is "movies", yet it keep losing files in other folders, can someone help me out in telling me what's going on and how to fix this?

her'es alog from 9/2013

Removing stale files from /var/preserve:

Cleaning out old system announcements:

Backup passwd and group files:

Verifying group file syntax:
/etc/group is fine

Disk status:
Filesystem Size Used Avail Capacity Mounted on
/dev/ufs/FreeNASs1a 927M 359M 494M 42% /
devfs 1.0K 1.0K 0B 100% /dev
/dev/md0 4.6M 1.8M 2.4M 43% /etc
/dev/md1 824K 2.0K 756K 0% /mnt
/dev/md2 149M 16M 121M 12% /var
/dev/ufs/FreeNASs4 20M 1.8M 16M 10% /data
Raid5 1.2T 50K 1.2T 0% /mnt/Raid5
Raid5/Apps 1.3T 73G 1.2T 5% /mnt/Raid5/Apps
Raid5/Books 1.2T 11G 1.2T 1% /mnt/Raid5/Books
Raid5/CaNhac 3.7T 2.5T 1.2T 67% /mnt/Raid5/CaNhac
Raid5/Karaoke 1.8T 592G 1.2T 32% /mnt/Raid5/Karaoke
Raid5/KidMovies 2.0T 755G 1.2T 38% /mnt/Raid5/KidMovies
Raid5/Movies 3.2T 2.0T 1.2T 62% /mnt/Raid5/Movies
Raid5/Music 1.2T 34K 1.2T 0% /mnt/Raid5/Music
Raid5/Temp 1.2T 22G 1.2T 2% /mnt/Raid5/Temp
Raid5/Video 1.3T 47G 1.2T 4% /mnt/Raid5/Video

Last dump(s) done (Dump '>' file systems):

Checking status of zfs pools:
all pools are healthy

Checking status of ATA raid partitions:

Checking status of gmirror(8) devices:

Checking status of graid3(8) devices:

Checking status of gstripe(8) devices:

Network interface status:
Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll
em0 1500 <Link#1> 00:1f:29:58:79:1e 57801258 0 0 200635307 0 0
em0 1500 192.168.0.0 192.168.0.88 230375 - - 443419833 - -
em1 1500 <Link#2> 00:1f:29:58:79:1f 364870845 0 0 42499 0 0
em1 1500 192.168.0.0 192.168.0.89 363828658 - - 0 - -
re0* 1500 <Link#3> 00:1d:7d:ab:27:08 0 0 0 0 0 0
lo0 16384 <Link#4> 39181 0 0 39181 0 0
lo0 16384 fe80:4::1 fe80:4::1 0 - - 0 - -
lo0 16384 localhost ::1 0 - - 0 - -
lo0 16384 your-net localhost 39144 - - 39181 - -

Security check:
(output mailed separately)

Checking status of 3ware RAID controllers:
Alarms (most recent first):
No new alarms.

-- End of daily output --

a log from today, notice the folder size being reduced even though i don't delete from them:

Removing stale files from /var/preserve:

Cleaning out old system announcements:

Backup passwd and group files:

Verifying group file syntax:
/etc/group is fine

Disk status:
Filesystem Size Used Avail Capacity Mounted on
/dev/ufs/FreeNASs1a 927M 359M 494M 42% /
devfs 1.0K 1.0K 0B 100% /dev
/dev/md0 4.6M 1.8M 2.4M 43% /etc
/dev/md1 824K 2.0K 756K 0% /mnt
/dev/md2 149M 16M 121M 12% /var
/dev/ufs/FreeNASs4 20M 1.7M 17M 9% /data
Raid5 871G 50K 871G 0% /mnt/Raid5
Raid5/Apps 944G 73G 871G 8% /mnt/Raid5/Apps
Raid5/Books 882G 11G 871G 1% /mnt/Raid5/Books
Raid5/CaNhac 3.4T 2.6T 871G 75% /mnt/Raid5/CaNhac
Raid5/Karaoke 1.4T 585G 871G 40% /mnt/Raid5/Karaoke
Raid5/KidMovies 1.6T 793G 871G 48% /mnt/Raid5/KidMovies
Raid5/Movies 3.1T 2.2T 871G 72% /mnt/Raid5/Movies
Raid5/Music 871G 34K 871G 0% /mnt/Raid5/Music
Raid5/Temp 881G 9.6G 871G 1% /mnt/Raid5/Temp
Raid5/Video 918G 47G 871G 5% /mnt/Raid5/Video

Last dump(s) done (Dump '>' file systems):

Checking status of zfs pools:
all pools are healthy

Checking status of ATA raid partitions:

Checking status of gmirror(8) devices:

Checking status of graid3(8) devices:

Checking status of gstripe(8) devices:

Network interface status:
Name Mtu Network Address Ipkts Ierrs Idrop Opkts Oerrs Coll
em0 1500 <Link#1> 00:1f:29:58:79:1e 123957115 4327 0 161795006 0 0
em0 1500 192.168.0.0 192.168.0.88 47803730 - - 493733541 - -
em1 1500 <Link#2> 00:1f:29:58:79:1f 320173953 0 0 55111 0 0
em1 1500 192.168.0.0 192.168.0.89 319056625 - - 0 - -
re0* 1500 <Link#3> 00:1d:7d:ab:27:08 0 0 0 0 0 0
lo0 16384 <Link#4> 61377 0 0 61379 0 0
lo0 16384 fe80:4::1 fe80:4::1 0 - - 0 - -
lo0 16384 localhost ::1 0 - - 0 - -
lo0 16384 your-net localhost 61344 - - 61378 - -

Security check:
(output mailed separately)

Checking status of 3ware RAID controllers:
Alarms (most recent first):
No new alarms.

-- End of daily output --

 

[warri]

ZFS does not delete files on it's own. You are misinterpreting the logs.

Let's have a look at your output:
Filesystem Size Used Avail Capacity Mounted on
Raid5/Movies 3.2T 2.0T 1.2T 62% /mnt/Raid5/Movies (09/2013)
Raid5/Movies 3.1T 2.2T 871G 72% /mnt/Raid5/Movies (01/2014)

The dataset movies actually has more data in it now (Used: 2.2 TB vs 2.0 TB). The available capacity is lower now, because other datasets likely take up more space of your pool. The Size column is a simple addition of Used and Avail (Size = Used + Avail), that's probably why you thought it shrank in size over time.

If you want to protect yourself against accidental deletions (by users!), set up snapshot tasks.

 

[user12345fs]

oh ok, thanks for the explanation, kids have been complaining that their movies are disappearing randomly , and the shrinkage on that column jumped out at me when i looked at the log.

 

[cyberjock]

That's what happens when you make "assumptions". :) Movies disappearing is going to be a different problem. I'd make sure they aren't deleting them or something. Everyone accidentally deletes files on occasion. In your case, enabling the recycle bin feature of CIFS would be useful for identifying things people claim are deleted.