New Hard Drives not avail.

[JohnFLi]

I have added drives in the past, and was able to use them shortly after booting up.

When I go to Storage/View Disks.....it shows I have a total of 39 disks.
I go to the CL and enter in zpool status, I can only account for 21 disks being used. (same when I use the gui to look at the disks being used for each vol)

When I go to extend or create a new vol, it tells me I only have 8 disks avail.

So where do I find the missing 10 disks???

 

[Chris Moore]

Please start by giving us more detail about the hardware you are using. Please use this as a guide:

Updated Forum Rules 12/5/18
https://forums.freenas.org/index.php?threads/updated-forum-rules-12-5-18.45124/

One of the specific things I am looking for is the model of the drives because there are some new drives that have been problematic.
Also, we need to know how these drives are connected (disk controllers) and powered (chassis type) because there have been power issues.
Details, details matter.

 

[JohnFLi]

some of what you asked for can be found in the signature, others are irrelevant for this issue.
but because you asked :P

• motherboard make and model ------------ SuperMicro X10DRL
• CPU make and model ----------------- Intel(R) Xeon(R) CPU E5-2620 v4 @ 2.10GHz
• RAM quantity -----------------------65,392MB
• hard drives, quantity, model numbers, and RAID configuration --------- yes. 39, WD101KRYZ , some raidz2, some raidz1, some striped
• hard disk controllers ---------------- 2x Rocket 750
• network cards ------------ x540T2BLK

 

[Chris Moore]

some of what you asked for can be found in the signature, others are irrelevant for this issue

Obviously, I am asking for the information that isn't provided. I don't need you give me the same information again with extra sarcasm.
You didn't tell me what the chassis is.
If you know what is irrelevant, why are you asking questions.

 

[JohnFLi]

"Obviously, I am asking for the information that isn't provided. I don't need you give me the same information again with extra sarcasm. "

From the link you provided, I copy and pasted what it stated as required information. Chassis was not on that list. Nor is there any sarcasm in answering the required information.

as for the chassis information, it is a XL60 turbo. it is designed to take 60 harddrives.

 

[Chris Moore]

From the link you provided, I copy and pasted what it stated as required information. Chassis was not on that list. Nor is there any sarcasm in answering the required information.

If you look back at my question. I asked for the chassis type because I had a suspicion that it was the problem.

One of the specific things I am looking for is the model of the drives because there are some new drives that have been problematic.
Also, we need to know how these drives are connected (disk controllers) and powered (chassis type) because there have been power issues.
Details, details matter.

When you finally answered:

as for the chassis information, it is a XL60 turbo. it is designed to take 60 harddrives.

I have one of these chassis that the organization I work for ordered about a year ago. Ours was fully populated from the start and that allowed us to determine that eight of the drive bays did not work from the start. From what you told us, you have added drives to bays that were vacant. I don't know if you tried to put the drives into different drive bays, but you could easily have some bad bays. We went through the vendor and got replacement Rocket 750 cards first but that didn't fix the problem so it must have been cabling. They ended up sending us an entire replacement chassis. They probably won't do that for you if you have had this for any significant period of time.

This year, we bought one of these and it works much better:
https://www.supermicro.com/products/system/4U/6048/SSG-6048R-E1CR60L.cfm

 

[JohnFLi]

Would that also apply when I go to 'storage/View Disks' and I see all the disks......
but when I go to each of my volumes and click on 'View Status' I see the drives that it is using (same when I did it from teh command line)
for example:
Vol#1 it has Da15p2 and da14p2 = 2 drives
Vol#2 has 3 sets of raidz1 (3 drives each) = 9 drives
Vol #3 has 1 set of raids2 = 8 drives (4 each)
Vol#4 2 sets of raidz2 = 12 drives (6 each)
From what I see, only 20 drives are being used.
but "storage/view disks" is showing 39, that as far as I can tell, are all online.

Is there a command that I can type in that would verify that all 39 are online, or some dead that I dont see via teh GUI?
or am I just completly off base here?

 

[Chris Moore]

Vol#1 it has Da15p2 and da14p2 = 2 drives

2 drives

Vol#2 has 3 sets of raidz1 (3 drives each) = 9 drives

9 drives

Vol #3 has 1 set of raids2 = 8 drives (4 each)

is this 4 or is it 8?

Vol#4 2 sets of raidz2 = 12 drives (6 each)

is this 6 or is it 12?
If the numbers are on the high side, it would be 31 drives used.
That would leave 8 drives unused. The difference in my questions above could answer the question. You can view the, "View Disks" method to see the list of disks being used for each volume:
https://www.ixsystems.com/documentation/freenas/11/storage.html#view-disks

You might also want to setup the script disklist.pl
Output looks like this:

Code:

partition  label                                       zpool         device  sector  disk                     size  type  serial               rpm  location         multipath  mode
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
da0p1      gptid/65d9d859-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da0        512  ATA ST10000NM0016-1T    10000  HDD   xxxxZYVM            7200  SAS3008(0):2#0
da1p1      gptid/66de6408-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da1        512  ATA ST10000NM0016-1T    10000  HDD   xxxx2JT0            7200  SAS3008(0):2#1
da2p1      gptid/67ee6f2c-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da2        512  ATA ST10000NM0016-1T    10000  HDD   xxxx2SFL            7200  SAS3008(0):2#2
da3p1      gptid/6905e892-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da3        512  ATA ST10000NM0016-1T    10000  HDD   xxxx2R97            7200  SAS3008(0):2#3
da4p1      gptid/6a1e7078-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da4        512  ATA ST10000NM0016-1T    10000  HDD   xxxxYBB5            7200  SAS3008(0):2#4
da5p1      gptid/6b2a5922-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da5        512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ82D            7200  SAS3008(0):2#5
da6p1      gptid/6cf142e9-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da6        512  ATA ST10000NM0016-1T    10000  HDD   xxxx2QN6            7200  SAS3008(0):2#6
da7p1      gptid/6e039cc3-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da7        512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ5XS            7200  SAS3008(0):2#7
da8p1      gptid/6f1bdf1d-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da8        512  ATA ST10000NM0016-1T    10000  HDD   xxxxSY2Y            7200  SAS3008(0):2#8
da9p1      gptid/7026b5ed-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da9        512  ATA ST10000NM0016-1T    10000  HDD   xxxx331Y            7200  SAS3008(0):2#9
da10p1     gptid/712a87a1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da10       512  ATA ST10000NM0016-1T    10000  HDD   xxxx33CZ            7200  SAS3008(0):2#10
da11p1     gptid/723bc10e-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da11       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2JME            7200  SAS3008(0):2#11
da12p1     gptid/7416f42f-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da12       512  ATA ST10000NM0016-1T    10000  HDD   xxxx1PP6            7200  SAS3008(0):2#12
da13p1     gptid/7531a5f8-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da13       512  ATA ST10000NM0016-1T    10000  HDD   xxxxSXDE            7200  SAS3008(0):2#13
da14p1     gptid/76428144-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da14       512  ATA ST10000NM0016-1T    10000  HDD   xxxxT0ZW            7200  SAS3008(0):2#14
da15p1     gptid/7760f346-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da15       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2DPY            7200  SAS3008(0):2#15
da16p1     gptid/7866427c-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da16       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYQQH            7200  SAS3008(0):2#16
da17p1     gptid/798d143e-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da17       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2HDT            7200  SAS3008(0):2#17
da18p1     gptid/7b875ee7-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da18       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYBN2            7200  SAS3008(0):2#18
da19p1     gptid/7c9c17f7-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da19       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ84Q            7200  SAS3008(0):2#19
da20p1     gptid/7db105ca-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da20       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ772            7200  SAS3008(0):2#20
da21p1     gptid/7ed28e84-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da21       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZNQG            7200  SAS3008(0):2#21
da22p1     gptid/7ff52ad1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da22       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ6WM            7200  SAS3008(0):2#22
da23p1     gptid/80faf9ba-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da23       512  ATA ST10000NM0016-1T    10000  HDD   xxxxTM95            7200  SAS3008(0):2#23
da24p1     gptid/831d73e2-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da24       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYBH5            7200  SAS3008(0):2#24
da25p1     gptid/843431a1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da25       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYAVQ            7200  SAS3008(0):2#25
da26p1     gptid/85534614-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da26       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZY3N            7200  SAS3008(0):2#26
da27p1     gptid/866f8059-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da27       512  ATA ST10000NM0016-1T    10000  HDD   xxxxW48S            7200  SAS3008(0):2#27
da28p1     gptid/8791862e-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da28       512  ATA ST10000NM0016-1T    10000  HDD   xxxx1Q56            7200  SAS3008(0):2#28
da29p1     gptid/88abe418-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da29       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZYTY            7200  SAS3008(0):2#29
da30p1     gptid/8ad8a1e1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da30       512  ATA ST10000NM0016-1T    10000  HDD   xxxx1PX3            7200  SAS3008(0):3#0
da31p1     gptid/8bf8c94e-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da31       512  ATA ST10000NM0016-1T    10000  HDD   xxxx1PK5            7200  SAS3008(0):3#1
da32p1     gptid/8d14e578-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da32       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2HXS            7200  SAS3008(0):3#2
da33p1     gptid/8e2c0e1e-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da33       512  ATA ST10000NM0016-1T    10000  HDD   xxxx33AJ            7200  SAS3008(0):3#3
da34p1     gptid/8f4586ee-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da34       512  ATA ST10000NM0016-1T    10000  HDD   xxxx1R8R            7200  SAS3008(0):3#4
da35p1     gptid/905d5231-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da35       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2QFT            7200  SAS3008(0):3#5
da36p1     gptid/4b380e51-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da36       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ82E            7200  SAS3008(0):3#6
da37p1     gptid/4c2a3fa0-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da37       512  ATA ST10000NM0016-1T    10000  HDD   xxxxVCWQ            7200  SAS3008(0):3#7
da38p1     gptid/4d316c90-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da38       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2QA4            7200  SAS3008(0):3#8
da39p1     gptid/4e279c43-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da39       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ7WD            7200  SAS3008(0):3#9
da40p1     gptid/4f3b17f7-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da40       512  ATA ST10000NM0016-1T    10000  HDD   xxxx3370            7200  SAS3008(0):3#10
da41p1     gptid/5048ec53-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da41       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2Q71            7200  SAS3008(0):3#11
da42p1     gptid/51a5cb98-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da42       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2FQ9            7200  SAS3008(0):3#12
da43p1     gptid/52b0c4f5-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da43       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYAZ8            7200  SAS3008(0):3#13
da44p1     gptid/53c02fc8-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da44       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2HA8            7200  SAS3008(0):3#14
da45p1     gptid/54b2adad-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da45       512  ATA ST10000NM0016-1T    10000  HDD   xxxxQF9E            7200  SAS3008(0):3#15
da46p1     gptid/55c0f47a-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da46       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ7LZ            7200  SAS3008(0):3#16
da47p1     gptid/56c14c23-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da47       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ7BN            7200  SAS3008(0):3#17
da48p1     gptid/584f5745-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da48       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ82Y            7200  SAS3008(0):3#18
da49p1     gptid/5956d7f8-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da49       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZXD5            7200  SAS3008(0):3#19
da50p1     gptid/5a5a6070-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da50       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZWDJ            7200  SAS3008(0):3#20
da51p1     gptid/5b564fc1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da51       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYBHY            7200  SAS3008(0):3#21
da52p1     gptid/5c630294-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da52       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2HLZ            7200  SAS3008(0):3#22
da53p1     gptid/5d6a2431-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da53       512  ATA ST10000NM0016-1T    10000  HDD   xxxx2DHN            7200  SAS3008(0):3#23
da54p1     gptid/5ef1faf6-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da54       512  ATA ST10000NM0016-1T    10000  HDD   xxxxSVNR            7200  SAS3008(0):3#24
da55p1     gptid/5ffb8961-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da55       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYQE1            7200  SAS3008(0):3#25
da56p1     gptid/6105cc1d-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da56       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZ6C9            7200  SAS3008(0):3#26
da57p1     gptid/62120300-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da57       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZXYX            7200  SAS3008(0):3#27
da58p1     gptid/631e28a1-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da58       512  ATA ST10000NM0016-1T    10000  HDD   xxxxYQ3P            7200  SAS3008(0):3#28
da59p1     gptid/642dd1ea-f24d-11e8-bd4a-ac1f6b418926  Pogo-60x10TB  da59       512  ATA ST10000NM0016-1T    10000  HDD   xxxxZYJS            7200  SAS3008(0):3#29

You can find the source to that script here:
https://forums.freenas.org/index.ph...sktype-serial-num-multipath.59319/post-421424

 

[JohnFLi]

the attached image will show exactly how many drives are with each vol. (drives.jpg)
and the results of the perl script is in result.txt

 

[Chris Moore]

I go to the CL and enter in zpool status, I can only account for 21 disks being used. (same when I use the gui to look at the disks being used for each vol)

So, looking at the data you have shared, it looks like you have accounted for 31 drives already allocated to pools, which leaves 8 drives available for use and all drives accounted for. Is the question answered?

 

[Chris Moore]

 

[JohnFLi]

my inability to count has been proven publicly....so at least there is that.
no idea why I was coming up with different number when counting by looking at each pool by itself.

thank you for your time

 

[Ericloewe]

some of what you asked for can be found in the signature

Users on mobile cannot see signatures without jumping through hoops, if at all. Please always include all relevant information when asking for help.