Data used but not referenced after zfs send / receive operation to new TrueNas

yangou

Cadet
Joined
Feb 27, 2021
Messages
2
I have a new TrueNAS-12.0-U1 system and am trying to do a one-time migration of a dataset from the old system. I used the netcat method for zfs send / receive of 11TB of data. It chugged along for about 30 hours. After the nc activity finished, I just killed the zfs receive process. After this, I'm confused about what is actually going on with the dataset / file system / pool. I don't see my data in the destination dataset (pool1-z2/media) but there is indication that the space is in use by that dataset.

Still don't have a great understanding of some of the concepts but trying to figure it out!


Send:

Code:
root@freenas[~]# zfs send nasvol/supernas-cifs@auto-20210219.0700-2w | mbuffer -q -s 128K -m 1G | pv -b | nc 192.168.1.5 8000
mbuffer: warning: allocating more than half of available memory
11.2TiB


Receive:

Code:
root@nas02[~]# nc -l 8000 | mbuffer -q -s 128k -m 1G | pv -rtab | zfs receive -s -vF pool1-z2/media
mbuffer: warning: allocating more than half of available memory
receiving full stream of nasvol/supernas-cifs@auto-20210219.0700-2w into pool1-z2/media@auto-20210219.0700-2w
^C.2TiB 32:52:43 [0.00 B/s] [99.0MiB/s] /s]
mbuffer: warning: error during output to <stdout>: canceled


For zfs list -o space, it shows that pool1-z2/media is 11.0T used but is marked as "USEDCHILD". I see nothing if I look in the filesystem for that mount point. Where the heck is this data? Wonder if I need to import or mount it somehow? The zfs receive output indicates it was saving it to a snapshot I think? There aren't any snapshots on the new system.

However just looking at the file system utilization its like that 11TB I transferred is not even a part of that file system. pool1-z2/media shows total size of 7.3 TB (what is left for the pool after the 11TB transfer) and nothing used. Where did it go? Can I mount it or recover somehow?

Code:
root@nas02[/]# zfs list -o space
NAME                                                       AVAIL   USED  USEDSNAP  USEDDS  USEDREFRESERV  USEDCHILD
freenas-boot                                               26.4G  2.17G        0B     23K             0B      2.17G
freenas-boot/ROOT                                          26.4G  2.16G        0B     23K             0B      2.16G
freenas-boot/ROOT/FreeNAS-12.0-U1                          26.4G  2.16G     1.01G   1.15G             0B         0B
freenas-boot/ROOT/Initial-Install                          26.4G     1K        0B      1K             0B         0B
freenas-boot/ROOT/default                                  26.4G   231K        0B    231K             0B         0B
pool1-z2                                                   7.31T  13.2T        0B    174K             0B      13.2T
pool1-z2/.system                                           7.31T   801M        0B    753M             0B      48.9M
pool1-z2/.system/configs-e6cb7c26dd1243d3962c3f87f9eddfe5  7.31T  8.54M        0B   8.54M             0B         0B
pool1-z2/.system/cores                                     1010M  14.0M        0B   14.0M             0B         0B
pool1-z2/.system/rrd-e6cb7c26dd1243d3962c3f87f9eddfe5      7.31T  23.8M        0B   23.8M             0B         0B
pool1-z2/.system/samba4                                    7.31T   500K        0B    500K             0B         0B
pool1-z2/.system/services                                  7.31T   140K        0B    140K             0B         0B
pool1-z2/.system/syslog-e6cb7c26dd1243d3962c3f87f9eddfe5   7.31T  1.79M        0B   1.79M             0B         0B
pool1-z2/.system/webui                                     7.31T   140K        0B    140K             0B         0B
pool1-z2/esxi-zvol01                                       9.46T  2.16T        0B   12.3G          2.15T         0B
pool1-z2/general                                           7.31T   140K        0B    140K             0B         0B
pool1-z2/home-directories                                  20.0G   227K        0B    227K             0B         0B
pool1-z2/iso-images                                        7.31T   140K        0B    140K             0B         0B
pool1-z2/media                                             7.31T  11.0T        0B    145K             0B      11.0T
pool1-z2/test-encrypted-dataset                            10.0G   546K        0B    279K             0B       267K
pool1-z2/test-encrypted-dataset/blah                       10.0G   267K        0B    267K             0B         0B



Code:
root@nas02[/]# df -h
Filesystem                                                   Size    Used   Avail Capacity  Mounted on
freenas-boot/ROOT/FreeNAS-12.0-U1                             28G    1.2G     26G     4%    /
devfs                                                        1.0K    1.0K      0B   100%    /dev
tmpfs                                                         32M    9.7M     22M    30%    /etc
tmpfs                                                        4.0M    8.0K    4.0M     0%    /mnt
tmpfs                                                         11G     32M     11G     0%    /var
fdescfs                                                      1.0K    1.0K      0B   100%    /dev/fd
pool1-z2                                                     7.3T    175K    7.3T     0%    /mnt/pool1-z2
pool1-z2/home-directories                                     20G    227K     20G     0%    /mnt/pool1-z2/home-directories
pool1-z2/general                                             7.3T    140K    7.3T     0%    /mnt/pool1-z2/general
pool1-z2/iso-images                                          7.3T    140K    7.3T     0%    /mnt/pool1-z2/iso-images
pool1-z2/media                                               7.3T    146K    7.3T     0%    /mnt/pool1-z2/media
pool1-z2/.system                                             7.3T    753M    7.3T     0%    /var/db/system
pool1-z2/.system/cores                                       1.0G     14M    1.0G     1%    /var/db/system/cores
pool1-z2/.system/samba4                                      7.3T    500K    7.3T     0%    /var/db/system/samba4
pool1-z2/.system/syslog-e6cb7c26dd1243d3962c3f87f9eddfe5     7.3T    1.8M    7.3T     0%    /var/db/system/syslog-e6cb7c26dd1243d3962c3f87f9eddfe5
pool1-z2/.system/rrd-e6cb7c26dd1243d3962c3f87f9eddfe5        7.3T     24M    7.3T     0%    /var/db/system/rrd-e6cb7c26dd1243d3962c3f87f9eddfe5
pool1-z2/.system/configs-e6cb7c26dd1243d3962c3f87f9eddfe5    7.3T    8.5M    7.3T     0%    /var/db/system/configs-e6cb7c26dd1243d3962c3f87f9eddfe5
pool1-z2/.system/webui                                       7.3T    140K    7.3T     0%    /var/db/system/webui
pool1-z2/.system/services                                    7.3T    140K    7.3T     0%    /var/db/system/services
 

yangou

Cadet
Joined
Feb 27, 2021
Messages
2
I was able to resolve this finally. It seems my method of doing the zfs send / receive with nc and mbuffer was never able to finalize. I had just been exiting the process on the receive side. I resumed the transfer with only nc and it was able to finalize and data was mounted.

I'm not sure what the appropriate way to finalize with mbuffer would be. Or if this is even benefic
 
Top