deduplication

  1. HoneyBadger

    OpenZFS "Fast Dedup" Project now in Public Review

    The collaborative project between Klara and iXsystems on "Fast Dedup" has been completed and presented as a series of pull requests (PR's) to the OpenZFS Github, ready for public review We're targeting this "Fast Dedup" functionality to release, hopefully alongside RAIDZ expansion, with TrueNAS...
  2. HoneyBadger

    Fast ZFS Dedup - Sponsorship Request

    It’s no secret that ZFS and deduplication have had performance issues in the past. Use cases that demand high read performance have aligned well with deduplication, given the compressed and deduplicated data is only stored once in ZFS read cache. Sustained write performance however has presented...
  3. H

    set compression level to 7zip (plug-in?)

    currently, maximum compression using gzip compresses a 280gb file down to 70gb on my freenas volume. same file, 7zip will compress to 30gb, but that's not internal. i don't want to store these files as 7zip files, because i think that data dedupe will save more space when they're not in their...
  4. I

    Dedup a small zvol? 20 GiB

    Hi everyone I am new here and I don't usually do this forum thing. I would like to more, but I just can't ever seem find the time. However I have no choice in this case because I believe this is the only place I can find the answer I need. I am setting up a small group of VM's on a 14gen Dell...
  5. B

    Freenas iscsi target for hyper-v host - backup necessary?

    Hello all, I am planning on using my Freenas box as iscsi target for my hyper-v host to store all my VMs on it (500GB SSD Stripe Set in Freenas). The freenas box is replicated to a freenas VM every 3 hours (yes, I am using pci passthrough (DDA in microsoft language) with a IBM ServeRaid M1015...
  6. Devin Acosta

    FreeNAS Improve Timeouts When Activity?

    I have FreeNAS installed a dedicated HP DL360g8 Server that has 3 x 10TB drives in a RAID-Z1 configuration, and I have an SSD as cache. I do have De-duplication turned on as I'm copying nightly system images to the appliance. The Server has 128GB of memory and the Storage Pool has 15TB of usable...
  7. N

    DEDUPE bug (or am I doing something wrong)?

    Hi All TLDR; I'm hoping someone can tell me if I've found a bug, or if I'm doing something wrong. I have two directory trees with almost exactly the same data, and I don't seem to be getting any space savings. Only 2 of the almost 4700+ files in each directory tree differ. All other files...
  8. D

    Deduplication Stats

    I'm trying to figure out how to see the effectiveness of my deduplication (On VM backups). zpool status seems to give helpful output, but I need some help interpreting the results. I also want to figure out why the Storage UI seems to show the pre-dedup size? zpool status -D Data_Drive...
  9. IceBoosteR

    Deduplication is hitting performance way too hard

    Hello out there, I got some problems and I think this is related to the deduplication implementation of FreeNAS. But before I open a Bug for that, I want to hear your opinion. First of all, I am aware of anything I am doing, and that deduplication can have its risks and some performance...
  10. lopr

    Analyzing my deduped SSD-mirror > leaked space

    Hello, I am a bit lost on whats wrong with my pool (mirror) consisting of two 250GB SSDs with replication on. This pool started as a single disk 120GB SSD for testing purposes and I added a 250GB disk to make it a mirror with the help of this post by Duran, checked that autoexpand=on and...
  11. geek_person

    Novato con muchas dudas

    Buenas a todos, chicas y chicos hispano parlantes, soy medio novato en esto de FreeNAS, así que ¡Hola a tod@s! Espero estar activo por el foro, aunque lo he empleado en multitud de ocasiones, para hace un simple disco en red, es ahora cuando me he agenciado con un Proliant y 4 discos para hacer...
  12. SwisherSweet

    Should I dedupe on my setup?

    I have finally gotten all my parts to built a Mac Pro FreeNAS server. The basic hardware is: Mac Pro with 2 x 6 Core Xeon "Westmere" 3.46GHz processors 64GB ECC 1,333MHz RAM 6 x 3 TB Toshiba P300 drives 120GB SSD Boot Drive (can't boot FreeNAS from USB on Mac) I have a wildcard component that...
  13. M

    SOLVED Deduplication of small dataset worth it

    Hi All, My system details. FreeNAS-9.10.2-U3 (e1497f269) Platform Intel(R) Xeon(R) CPU E3-1220L V2 @ 2.30GHz Memory 16320MB HP MicroServer Gen8. I have a main machine that does regular backups via ISCSI to FreeNAS. I have split it up into "General", "Documents" and "Photos"...
  14. S

    No BLOCKLEVEL deduplication ?!

    Good evening, I try to setup a test backup storage with FreeNAS. If FreeNAS is going to work fine, I would like to buy certified hardware. But unfortunately I got stuck in deduplication. Either I configured something wrong or the ZFS deduplication feature is N O T on block level. Please Look...
  15. IceBoosteR

    ZFS deduplication default hash

    Hello guys, I got a quick question about the FreeNAS ZFS deduplication integration. I spend some time and searched for this on the internet, but there was no suitable result. So, I have one specific dataset with 400Gigs of data, where I have deduplication enabled (DD table is kinda small, 700...
Top