SOLVED Replaced 2TB drives in vdev mirror with 4TB drives - no increase in capacity

Status
Not open for further replies.
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
I had a faulty drive appear on my system and as my usage was getting quite high, I decided to buy 2x 4TB drives to replace the damaged drive and its pair in a 2x 2TB mirrored vdev.

The vdev is part of a zpool consisting of 2x 4TB and 8x 2TB drives, all run as mirrored pairs.

From the documentation, I checked that autoexpand was enabled then offlined the drive that contained errors, connected a 4TB and allowed it to resilver. Once complete, I then offlined the "good" 2TB drive, connected a 4TB and allowed it to resilver once again.
Now both new 4TB drives are in the same mirrored vdev.

What I was expecting was for zpool capacity to go up by 2TB but this hasn't happened. I've tried to export/import the volume and also tried "zpool online -e" command for the new drives.

Can anyone shed some light on a step I might have missed?
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Sorry, bit of a coding n00b here. How do I run the first item in your list?

Code:
[root@freenas ~]# camcontrol devlist											
<ATA WDC WD20EZRX-00D 0A80>		at scbus0 target 2 lun 0 (pass0,da0)		 
<ATA WDC WD20EZRX-00D 0A80>		at scbus0 target 3 lun 0 (pass1,da1)		 
<ATA WDC WD20EARX-00P AB51>		at scbus0 target 4 lun 0 (pass2,da2)		 
<ATA WDC WD20EARX-00P AB51>		at scbus0 target 5 lun 0 (pass3,da3)		 
<ATA WDC WD20EZRX-00D 0A80>		at scbus0 target 7 lun 0 (pass4,da4)		 
<ATA ST2000VN000-1HJ1 SC60>		at scbus0 target 11 lun 0 (pass5,da5)		
<ST4000VN008-2DR166 SC60>		  at scbus1 target 0 lun 0 (pass6,ada0)		
<ST4000VN008-2DR166 SC60>		  at scbus2 target 0 lun 0 (pass7,ada1)		
<ST4000VN008-2DR166 SC60>		  at scbus3 target 0 lun 0 (pass8,ada2)		
<ST4000VN008-2DR166 SC60>		  at scbus4 target 0 lun 0 (pass9,ada3)		
< USB DISK 2.0 PMAP>			   at scbus6 target 0 lun 0 (pass10,da6)​
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Did it manually instead:
Code:
											capacity			 operations	bandwidth
pool									 alloc	free		 read  write   read  write
--------------------------------------   -----   -----	  -----  -----  -----  -----
Data									 9.55T   1.49T	 16	  0  2.03M  3.19K
  mirror								 1.79T   195G	  0	  0	 48  1.10K
   ada2p2										-	  -	  0	  0	224  1.80K
   ada3p2										-	  -	  0	  0	224  1.80K
  mirror								1.79T   18.6G	  0	  0	  8	  1
	da0p2										 -	  -	  0	  0	243	712
	da3p2										 -	  -	  0	  0	198	712
  mirror								1.79T   18.5G	  0	  0	  9	  0
	da1p2										 -	  -	  0	  0	200	718
	da2p2										 -	  -	  0	  0	197	718
  mirror								1.79T   18.5G	  0	  0	  9	  0
   da4p2										  -	  -	  0	  0	201	727
	da5p2										 -	  -	  0	  0	195	727
  mirror								2.37T   1.25T	 16	  0  2.03M  2.09K
   ada0p2										-	  -	  6	  0  1.04M  2.80K
   ada1p2										-	  -	  6	  0  1020K  2.80K
--------------------------------------   -----  -----  -----  -----  -----  -----
freenas-boot							 3.74G  11.1G	  0	  0  9.37K  5.40K
  da6p2								 3.74G  11.1G	  0	  0  9.37K  5.40K
--------------------------------------   -----  -----  -----  -----  -----  -----
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
The last vdev is indeed twice as large as the others. What makes you say the pool didn't expand?
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Hi Eric,

ada2 and ada3 are also 4TB hard drives and are only showing 1.79T used and 195G free.
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Code:
[root@freenas ~]# zpool get autoexpand Data									 
NAME  PROPERTY	VALUE   SOURCE												
Data  autoexpand  on	  local
 
garm

garm

Wizard
Joined
Aug 19, 2017
Messages
1,556
Well, I’m primarily a Windows sysadm so let’s try my first troubleshoot item. Can you please set autoexpand to off and the back on again?
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Thanks for the suggestion. I turned autoexpand off and on again, though it didn't work. Maybe as the drives are already in place?
I also ran zpool online -e for every drive in the system, and detached and reattached the pool but still no luck.
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
I'd suggest offlining one disk, bringing it back online, then rinse and repeat for the other one.
 
garm

garm

Wizard
Joined
Aug 19, 2017
Messages
1,556
Ninjad by eric,

Even if that would work it would be nice to know why this happened. I’m relying heavily on disk replacement for my data growth strategy on all my managed builds..
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Ericloewe said:
I'd suggest offlining one disk, bringing it back online, then rinse and repeat for the other one.
Click to expand...
I did this through the GUI and just selected each disk, clicked offline, then online. Is that correct?
No fix, unfortunately.
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
What's the output of diskinfo -v ada2 ada3?
 
Jailer

Jailer

Not strong, but bad
Joined
Sep 12, 2014
Messages
4,977
This is going to sound very windows "ish" but did you reboot the server after you set the autoexpand flag to on?
 
Stux

Stux

MVP
Joined
Jun 2, 2016
Messages
4,419
Jailer said:
This is going to sound very windows "ish" but did you reboot the server after you set the autoexpand flag to on?
Click to expand...

Thing is you shouldn’t have to as it’s supposed to be immediate :-/
 
Jailer

Jailer

Not strong, but bad
Joined
Sep 12, 2014
Messages
4,977
Stux said:
Thing is you shouldn’t have to as it’s supposed to be immediate :-/
Click to expand...
I know, grasping at straws here mostly with my reply.
 
Ericloewe

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
diskinfo:

Code:
ada2																			
		512			 # sectorsize											
		4000787030016   # mediasize in bytes (3.6T)							 
		7814037168	  # mediasize in sectors								  
		4096			# stripesize											
		0			   # stripeoffset										  
		7752021		 # Cylinders according to firmware.					  
		16			  # Heads according to firmware.						  
		63			  # Sectors according to firmware.						
		ST4000VN008-2DR166	  # Disk descr.								   
		ZDH317GZ		# Disk ident.										   
		Not_Zoned	   # Zone Mode											 
																				
ada3																			
		512			 # sectorsize											
		4000787030016   # mediasize in bytes (3.6T)							 
		7814037168	  # mediasize in sectors								  
		4096			# stripesize											
		0			   # stripeoffset										  
		7752021		 # Cylinders according to firmware.					  
		16			  # Heads according to firmware.						  
		63			  # Sectors according to firmware.						
		ST4000VN008-2DR166	  # Disk descr.	 
		ZDH3JTNA		# Disk ident.										   
		Not_Zoned	   # Zone Mode


geom label list:

Code:
Geom name: da0p2																
Providers:																	  
1. Name: gptid/cba9e7fa-fa26-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da0p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
																				
Geom name: da1p2																
Providers:																	  
1. Name: gptid/088a8fa1-fa27-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da1p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
Geom name: da2p2																
Providers:																	  
1. Name: gptid/0aabe82f-fa27-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da2p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
 
Geom name: da3p2																
Providers:																	  
1. Name: gptid/cdbdbd79-fa26-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da3p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
 
Geom name: da4p2																
Providers:																	  
1. Name: gptid/2585b344-fa27-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da4p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
Geom name: da5p2																
Providers:																	  
1. Name: gptid/2683eeea-fa27-11e7-8b3c-bcee7be16df2							 
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 0																
   Stripeoffset: 2147549184													 
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 3902834696														
   length: 1998251364352														
   index: 0																	 
Consumers:																	  
1. Name: da5p2																  
   Mediasize: 1998251364352 (1.8T)											  
   Sectorsize: 512															  
   Stripesize: 0																
   Stripeoffset: 2147549184													 
   Mode: r1w1e2																 
Geom name: da6p1																
Providers:																	  
1. Name: gptid/977bc5c1-d390-11e6-8f21-bcee7be16df2							 
   Mediasize: 524288 (512K)													 
   Sectorsize: 512															  
   Stripesize: 0																
   Stripeoffset: 17408														  
   Mode: r0w0e0																 
   secoffset: 0																 
   offset: 0																	
   seclength: 1024															  
   length: 524288															   
   index: 0																	 
Consumers:																	  
1. Name: da6p1																  
   Mediasize: 524288 (512K)													 
   Sectorsize: 512															  
   Stripesize: 0																
   Stripeoffset: 17408														  
   Mode: r0w0e0																 
Geom name: ada0p2															   
Providers:																	  
1. Name: gptid/00b317e2-fb5d-11e7-8311-bcee7be16df2							 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 7809842696														
   length: 3998639460352														
   index: 0																	 
Consumers:																	  
1. Name: ada0p2																 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
Geom name: ada1p2															   
Providers:																	  
1. Name: gptid/019710a2-fb5d-11e7-8311-bcee7be16df2							 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 7809842696														
   length: 3998639460352														
   index: 0																	 
Consumers:																	  
1. Name: ada1p2																 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
Geom name: ada2p2															   
Providers:																	  
1. Name: gptid/1e896dce-51d9-11e8-b0d7-bcee7be16df2							 
   Mediasize: 2196875685888 (2.0T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 4290772824														
   length: 2196875685888														
   index: 0																	 
Consumers:																	  
1. Name: ada2p2																 
   Mediasize: 2196875685888 (2.0T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2																 
Geom name: ada3p2															   
Providers:																	  
1. Name: gptid/0967ef64-521c-11e8-bf9b-bcee7be16df2							 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e1																 
   secoffset: 0																 
   offset: 0																	
   seclength: 7809842696														
   length: 3998639460352														
   index: 0																	 
Consumers:																	  
1. Name: ada3p2																 
   Mediasize: 3998639460352 (3.6T)											  
   Sectorsize: 512															  
   Stripesize: 4096															 
   Stripeoffset: 0															  
   Mode: r1w1e2
 
D

Deadmeat86

Dabbler
Joined
May 8, 2018
Messages
10
Ah, ADA2 is appearing as 2.0T instead of 3.6T
 
Status
Not open for further replies.

Similar threads

S
  • Locked
Replace VDEV in pool
Replies
6
Views
6K
Chris Moore
Chris Moore
Soloam
Expand With Mirror or RaidZ
Replies
6
Views
1K
Heracles
Heracles
M
  • Locked
1.5tb for 2tb expand raid.
Replies
15
Views
3K
cyberjock
C
travalon
  • Locked
using a striped pair in a zpool?
Replies
5
Views
1K
Ericloewe
Ericloewe
A
  • Locked
Having problems upgrading 2TB-4TB drives
Replies
3
Views
1K
Stux
Stux
Top