Help with setting up non-traditional disk arrangement

[csh8428]

I'm probably going to get a lot of slack for this, but I have my reasons for setting up this way.
In 11.1 I didn't use a zpool because some of this data is backed up in the cloud; so there's no reason to have it taking up double the space on my server. On v11.1 I had 4 HDs each with their own volume. I would sync them periodically with Rsync. Disk 1 was backed up to Disk 2 and whereas Disk 3 and disk 4 were backed up to the cloud. So. Disks 3 and 4 wouldn't need any server side back-up. I know that's an odd way to set things up, but that's the way I like it.

Disk 2 recently crashed and I had to replace it. I did NOT do the correct actions to remove it from the pool. I didn't know you need to do all these steps, so I just pulled it out.

I did a clean install to 11.2 on my SSD and got a new HD. I'm having trouble figuring out how to get the HDs usable without destroying the data. They do show up in Storage - Disks, but I can't figure how to import them as volumes like I did in 11.1. If I try to give them each their own pool it says all the data will be destroyed.

How can I get the same setup in 11.2 as I had in 11.1?: where each disk is "separate" from all the others, so if one fails I can just replace it and re-copy the data from the backup disk.

Thanks for any help!!


EDIT:
FIXED IT.. sort of
Did a fresh install of 11.1
Re-imported the "volumes"(in 11.1 they are called volumes) for each physical disk as it's own volume(pool)
Did an UPGRADE to 11.2 in which the upgrade process did the migration of the disks as each with it's own pool without destroying the data

 

[Chris Moore]

I'm probably going to get a lot of slack for this,

Slack is not the correct way to describe it...

In 11.1 I didn't use a zpool because some of this data is backed up in the cloud

This is not possible. Even a single disk would be a storage pool. You need to review the documentation so you can understand what you had, which might give you a better understanding of how to move forward.

Slideshow explaining VDev, zpool, ZIL and L2ARC
https://forums.freenas.org/index.ph...ning-vdev-zpool-zil-and-l2arc-for-noobs.7775/

Terminology and Abbreviations Primer
https://forums.freenas.org/index.php?threads/terminology-and-abbreviations-primer.28174/

I had 4 HDs each with their own volume.

After reading all that you have to say, it appears that you have used incorrect terminology and that bad terminology was perpetuated by the interface.
If you issue the zpool import command at the command prompt, you should get some text similar to this:

Code:

   pool: vd3                                                                   
     id: 6662080228811196520                                                   
  state: ONLINE                                                                
status: The pool was last accessed by another system.                        
action: The pool can be imported using its name or numeric identifier and    
        the '-f' flag.                                                        
   see: http://illumos.org/msg/ZFS-8000-EY                                    
config:                                                                       
                                                                               
        vd3                                             ONLINE                
          mirror-0                                      ONLINE                
            gptid/c31ed619-7891-11e4-afe7-002511e20540  ONLINE                
            gptid/c43e301f-7891-11e4-afe7-002511e20540  ONLINE                
          mirror-1                                      ONLINE                
            gptid/f613211b-af2b-11e4-b0b6-002511e20540  ONLINE                
            gptid/c5aa4fcb-7891-11e4-afe7-002511e20540  ONLINE                
        logs                                                                   
          gptid/df7c20c6-e5c9-11e6-bcb1-e840f2d1ca87    ONLINE   

If you will share that with us, it might help us figure out what you actually have going on.

You also have entirely disregarded the change from 11.1 to 11.2 ...
If you had a fault, you should have corrected that fault before upgrading to the new version of the operating system.
My recommendation would be to go back to 11.1 and replace the disk there.

 

[csh8428]

You also have entirely disregarded the change from 11.1 to 11.2 ...
If you had a fault, you should have corrected that fault before upgrading to the new version of the operating system.
My recommendation would be to go back to 11.1 and replace the disk there.

I apologize for my ignorance..

If you issue the zpool import command at the command prompt

Would I do this in 11.2 now or in 11.1 after I've fixed everything?

So, is it possible to get these drives into 11.2 without destroying my data and without going back to 11.1?

 

[Chris Moore]

Would I do this in 11.2 now or in 11.1 after I've fixed everything?

You could do it any time. That should be independent of the user interface version. The new user interface in version 11.2 has some issues, so to be certain that the UI is not causing the problem, going back to FreeNAS-11.1-U6.3 is just a good precaution. Once everything is working, then you can upgrade if you want.

 

[Chris Moore]

So, is it possible to get these drives into 11.2 without destroying my data and without going back to 11.1?

It kind of depends on the output of the command I asked for... I have a feeling that your pool was not configured the way you thought it was.

 

[Jailer]

I have a feeling that your pool was not configured the way you thought it was.

That's the first think I thought when I read the OP.

 

[Chris Moore]

I didn't know you need to do all these steps, so I just pulled it out.

Do you still have the disk? It may need to go back in, if it is working at all.

 

[csh8428]

Do you still have the disk? It may need to go back in, if it is working at all.

I do still have the disk, but the system won't boot with the disk in. I'm going to revert back to 11.1 tonight and see if I can reconfigure the drives minus the bad drive, and upgrade to 11.2 from there instead of a fresh install. I will post with findings later this evening.

 

[csh8428]

It kind of depends on the output of the command I asked for... I have a feeling that your pool was not configured the way you thought it was.

Ok... reinstalled 11.1

Here's the zpool import results

Code:

root@freenas:~ # zpool import
   pool: Green2TB
     id: 4510218004717214648
  state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
config:

        Green2TB                                      ONLINE
          gptid/efb2c03f-1497-11e5-9074-8c89a5ddf217  ONLINE

   pool: Red3TB
     id: 8937808077657388109
  state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
config:

        Red3TB                                        ONLINE
          gptid/025bcb4b-1eb2-11e5-82e3-8c89a5ddf217  ONLINE

   pool: Red4TB
     id: 14295742038767956802
  state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
config:

        Red4TB                                        ONLINE
          gptid/16072b2d-1858-11e9-baf6-8c89a5ddf217  ONLINE

   pool: Dstar2_500GB
     id: 13123709887770241393
  state: ONLINE
status: The pool was last accessed by another system.
action: The pool can be imported using its name or numeric identifier and
        the '-f' flag.
   see: http://illumos.org/msg/ZFS-8000-EY
config:

        Dstar2_500GB                                  ONLINE
          gptid/712fafe5-1498-11e5-9074-8c89a5ddf217  ONLINE
root@freenas:~ #

Each pool is it's own physical disk in this case.
The new disk is Red4TB and the other disks have data on them. The bad disk is not in the server.
What I'm trying to do is add all the disks to 11.2 without destroying data. I want to keep each disk's data physically on it's own disk(pool). I do manual Rsyncs to back specific folders up to different disks.

How do I do that?