Register for the iXsystems Community to get an ad-free experience and exclusive discounts in our eBay Store.

Lost Data in Upgrade to 11.2

Joined
Aug 23, 2017
Messages
3
Tried to update via the GUI yesterday from 11-STABLE to 11.2-STABLE and something with the boot drive failed. Long story short I then installed 11.2 on a new drive, booted up to that, imported the old volumes, saw there was no share, added a SMB share to one of the data sets and then saw that it was entirely empty. The volumes imported and show all the right disks, names, and datasets, but there are no files in any of them. Help? One curious thing I noticed in the zpool history is that the lines changes from zpool..... to zfs...

zpool history:
2018-11-24.15:36:14 zpool import -c /data/zfs/zpool.cache.saved -o cachefile=none -R /mnt -f 11047663621338030762
2018-11-24.15:36:14 zpool set cachefile=/data/zfs/zpool.cache MediaVolume
2018-11-24.15:37:53 zpool add -f MediaVolume raidz /dev/gptid/915dddc2-f039-11e8-8acc-d050999ece24 /dev/gptid/91ee314d-f039-11e8-8ac
c-d050999ece24 /dev/gptid/928944c4-f039-11e8-8acc-d050999ece24 /dev/gptid/932804d2-f039-11e8-8acc-d050999ece24
2018-11-30.10:39:53 zpool import -c /data/zfs/zpool.cache.saved -o cachefile=none -R /mnt -f 11047663621338030762
2018-11-30.10:39:53 zpool set cachefile=/data/zfs/zpool.cache MediaVolume
2018-11-30.10:41:36 zpool import -c /data/zfs/zpool.cache.saved -o cachefile=none -R /mnt -f 11047663621338030762
2018-11-30.10:41:36 zpool set cachefile=/data/zfs/zpool.cache MediaVolume
2018-12-01.08:31:27 zpool import -f -R /mnt 11047663621338030762
2018-12-01.08:31:27 zpool set cachefile=/data/zfs/zpool.cache MediaVolume
2018-12-01.08:31:29 zfs inherit -r mountpoint MediaVolume
2018-12-01.08:31:29 zfs set aclmode=passthrough MediaVolume
2018-12-01.08:31:34 zfs set aclinherit=passthrough MediaVolume
2018-12-01.09:50:55 zpool import -f -R /mnt 11047663621338030762
2018-12-01.09:50:56 zfs inherit -r mountpoint MediaVolume
2018-12-01.09:50:56 zpool set cachefile=/data/zfs/zpool.cache MediaVolume
2018-12-01.09:50:56 zfs set aclmode=passthrough MediaVolume
2018-12-01.09:51:00 zfs set aclinherit=passthrough MediaVolume
2018-12-01.09:51:00 zfs set mountpoint=legacy MediaVolume/.system
 

Goned

Newbie
Joined
Jan 26, 2015
Messages
76
Hi,
Same for me....
Upgrade from 11 to 11.2 ....
And no data..............WTF ???
Need help guys...
Regards,
 

nearbyatom

Newbie
Joined
Dec 12, 2017
Messages
12
Same here. I ran the udpate from the webgui then I found out my volumes and data is gone. My password and static IP addresses have been reset too. Not sure what happened. anyway to recover our data?
 

Goned

Newbie
Joined
Jan 26, 2015
Messages
76
Same here. I ran the udpate from the webgui then I found out my volumes and data is gone. My password and static IP addresses have been reset too. Not sure what happened. anyway to recover our data?
For now i don't have solution...so i think data is lost...i'm just waiting expert here to confirm that....
Very bad for FreeNAS....I am very disappointed
3 years maybe 4 years i use it....from 9 versions...
 

kdragon75

FreeNAS Expert
Joined
Aug 7, 2016
Messages
2,448
I am very disappointed
For updating to an RC with no tested plan to back out? That's on you, Not iX. ix-systems does a lot of stupid things with FreeNAS/TrueNAS but making you update to non-stable software is not one of them.

Have any of you tried reverting to your old boot environment? What do each of you see with zpool status zpool list -v and zpool import? If you see your pool, what does zfs list show?

Do you plan to make backups going forward now?
 

Goned

Newbie
Joined
Jan 26, 2015
Messages
76
For updating to an RC with no tested plan to back out? That's on you, Not iX. ix-systems does a lot of stupid things with FreeNAS/TrueNAS but making you update to non-stable software is not one of them.

Have any of you tried reverting to your old boot environment? What do each of you see with zpool status zpool list -v and zpool import? If you see your pool, what does zfs list show?

Do you plan to make backups going forward now?
When i have change 11 to 11.2 is not RC value...but STABLE...so i have "imagine" is OK....

I reinstall now 11.1....and i send you zpool information
 

Goned

Newbie
Joined
Jan 26, 2015
Messages
76
For updating to an RC with no tested plan to back out? That's on you, Not iX. ix-systems does a lot of stupid things with FreeNAS/TrueNAS but making you update to non-stable software is not one of them.

Have any of you tried reverting to your old boot environment? What do each of you see with zpool status zpool list -v and zpool import? If you see your pool, what does zfs list show?

Do you plan to make backups going forward now?
See my topics..this one is not mine => https://forums.freenas.org/index.php?threads/lost-data-upgrade-from-11-1-to-11-2-rc2.71611/#post-495718
 

kdragon75

FreeNAS Expert
Joined
Aug 7, 2016
Messages
2,448
If you can see your pool in any of the pool commands, your data is probably still there. If you can see your data sets with zfs list, check if there mounting as they should be with zfs mount.
 

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
This flew under my radar but may be the third similar case I hear about.

To confirm that, please run zfs list and see if the used values line up with how much data you used to have or if they're way down to ridiculously low values.
 

Goned

Newbie
Joined
Jan 26, 2015
Messages
76
This flew under my radar but may be the third similar case I hear about.

To confirm that, please run zfs list and see if the used values line up with how much data you used to have or if they're way down to ridiculously low values.
Hi,

with zfs list ... used value is ridiculously low values....

Do you think data is lost ?

Regards,
 

Justin The Cynical

FreeNAS Experienced
Joined
Aug 18, 2014
Messages
135
I hate to say it, but I appear to be in the same situation. Updated the other night via the GUI to 11.2 STABLE from 11.1-U1 STABLE, and several of my larger datasets are now empty.

zfs list also shows sub gig levels of usage for said datasets. Booting back to 11.1 doesn't make anything reappear either.

I should have made a snapshot, or exported the pool before the update, I know, but as 11.2 has been out for a bit, I figured that it would be 'safe'.

If there is a way to recover it, that would be awesome sauce.

Hardware:
Supermicro X(SCL+-F
Xeon E3 1230
16 gig ECC
LSI SAS2008 card, non-rebadged
 
Last edited:

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
I hate to say it, but I appear to be in the same situation. Updated the other night via the GUI to 11.2 STABLE from 11.1-U1 STABLE, and several of my larger datasets are now empty.

zfs list also shows sub gig levels of usage for said datasets. Booting back to 11.1 doesn't make anything reappear either.

I should have made a snapshot, or exported the pool before the update, I know, but as 11.2 has been out for a bit, I figured that it would be 'safe'.

If there is a way to recover it, that would be awesome sauce.

Hardware:
Supermicro X(SCL+-F
Xeon E3 1230
16 gig ECC
LSI SAS2008 card, non-rebadged
Are your logs intact? Does every file in /var/log magically start right after the update?
 

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
Also, can you tell us anything about your system? When and on what software was the pool created, what kind of services you run, etc. We really have very little to go on at the moment.
 

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108

SynbiosVyse

Newbie
Joined
May 9, 2016
Messages
17
I hate to say it, but I appear to be in the same situation. Updated the other night via the GUI to 11.2 STABLE from 11.1-U1 STABLE, and several of my larger datasets are now empty.

zfs list also shows sub gig levels of usage for said datasets. Booting back to 11.1 doesn't make anything reappear either.

I should have made a snapshot, or exported the pool before the update, I know, but as 11.2 has been out for a bit, I figured that it would be 'safe'.

If there is a way to recover it, that would be awesome sauce.

Hardware:
Supermicro X(SCL+-F
Xeon E3 1230
16 gig ECC
LSI SAS2008 card, non-rebadged
Do you mean from 11.1 to 11.2?

I updated from 11.1 U6 to 11.2 and had a similar case.

Looks like we have very different hardware specs.

What kind of services were you running? I had a jail running Syncthing and a SMB share.
 

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
Do you mean from 11.1 to 11.2?

I updated from 11.1 U6 to 11.2 and had a similar case.

Looks like we have very different hardware specs.

What kind of services were you running? I had a jail running Syncthing and a SMB share.
What's the output of zfs list on your system? Did you previously have snapshots of the data you're missing?
 

SynbiosVyse

Newbie
Joined
May 9, 2016
Messages
17
I did have snapshots and they got deleted as well. I don't have access to the machine at the moment, but I do recall zfs list showing the expected output for names, ie the zpool plus a half dozen or so first directories (or "datasets"?) of the pool. It had my data folder, syncthing folder, home folder, and maybe a few other things, if that makes sense. However, the usage was around 760 MiB when it should have been closer to 4 TiB.

By the way, I think I spoke with you on mumble and IRC last night and I have been updating the bug report with as much info as I can. I will upload more logs when I get the chance in the off chance somebody finds something fishy. I really wish I knew what the hell went wrong.

Big_Papi_Knows:
My issue sounds almost exactly like yours. Did you have a boot error with something along the lines of missing /boot/kernel/kernel after updating 11.1 U6 to 11.2 on the UI? Did you then re-install the boot device with external media? What jails and services were you running?

See my bug report here and upload what logs you can: https://redmine.ixsystems.com/issues/64512
 
Last edited:

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
Oh, I didn't notice it was you. Are you absolutely sure about the snapshots? The zpool history didn't have any deletions.
 

Ericloewe

Not-very-passive-but-aggressive
Moderator
Joined
Feb 15, 2014
Messages
16,108
If our working theory is right, a snapshot would not have been touched, so your data would be trivially recoverable. In your case, it was really gone - so, if you did have snapshots before, it would mean that the problem is more convoluted than we'd thought.
 
Top