Joe Gruher
Cadet
- Joined
- Jul 16, 2013
- Messages
- 5
I am aware of the risks with dedup. I just want to run an experiment where I configure a number of clients with almost-identical OS installs and boot them over iSCSI. In theory dedup should let them boot faster if their data is highly dedup-able since I should have to do less seeking on disk and get more cache hits in memory. I have 32GB RAM and only about 650GB allocated in my dedup'd array so I should have plenty of memory.
Looking on disk I see all the targets shown as their full capacity. Much of this should be deduplicated as empty space and as duplicate blocks across similar OS installs. How can I check how much this is being deduplicated (how can I check the actual capacity consumed on disk after dedup versus the allocated capacity)?
Thanks!
[root@freenas-joeboot] /mnt/joeraid/dedup# ls -l
total 557206475
drwxr-xr-x 2 root wheel 38 Jul 16 05:12 ./
drwxr-xr-x 3 root wheel 3 May 9 04:57 ../
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:24 ki01
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:48 ki01a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:33 ki02
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:47 ki02a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:33 ki03
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:47 ki03a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki04
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki05
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki06
-rw-r--r-- 1 root wheel 16106127360 Jun 12 08:20 ki07
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:06 ki07a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:43 ki08
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki08a
-rw-r--r-- 1 root wheel 21474836480 Jul 16 05:47 ki09
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki09a
-rw-r--r-- 1 root wheel 16106127360 Jun 13 02:00 ki10
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki10a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:48 ki11
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki11a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:47 ki12
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:08 ki12a
-rw-r--r-- 1 root wheel 16106127360 Jul 11 04:52 ki13
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:12 ki13a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:48 ki14
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:13 ki14a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:47 ki15
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:16 ki15a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi01
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi02
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi03
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi04vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi05vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi06vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi07vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi08vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi09vm
[root@freenas-joeboot] /mnt/joeraid/dedup#
Looking on disk I see all the targets shown as their full capacity. Much of this should be deduplicated as empty space and as duplicate blocks across similar OS installs. How can I check how much this is being deduplicated (how can I check the actual capacity consumed on disk after dedup versus the allocated capacity)?
Thanks!
[root@freenas-joeboot] /mnt/joeraid/dedup# ls -l
total 557206475
drwxr-xr-x 2 root wheel 38 Jul 16 05:12 ./
drwxr-xr-x 3 root wheel 3 May 9 04:57 ../
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:24 ki01
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:48 ki01a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:33 ki02
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:47 ki02a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 03:33 ki03
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:47 ki03a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki04
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki05
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 ki06
-rw-r--r-- 1 root wheel 16106127360 Jun 12 08:20 ki07
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:06 ki07a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:43 ki08
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki08a
-rw-r--r-- 1 root wheel 21474836480 Jul 16 05:47 ki09
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki09a
-rw-r--r-- 1 root wheel 16106127360 Jun 13 02:00 ki10
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki10a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:48 ki11
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:07 ki11a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:47 ki12
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:08 ki12a
-rw-r--r-- 1 root wheel 16106127360 Jul 11 04:52 ki13
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:12 ki13a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:48 ki14
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:13 ki14a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:47 ki15
-rw-r--r-- 1 root wheel 37580963840 Jul 16 05:16 ki15a
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi01
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi02
-rw-r--r-- 1 root wheel 16106127360 Jul 16 05:11 vi03
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi04vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi05vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi06vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi07vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi08vm
-rw-r--r-- 1 root wheel 64424509440 Jun 27 03:51 vi09vm
[root@freenas-joeboot] /mnt/joeraid/dedup#