Help... SAS HBA are driving me mad...

Hanry

Cadet
Joined
Dec 29, 2017
Messages
3
Hello there, FreeNAS warriors!

I inherited a SuperMicro 45-disk JBOD this week and would like to FreeNAS it. As a host I have a Dell R515, perfectly suited to the task - installed a fresh FreeNAS on it. The Dell has two SAS controllers:
1) the internal SAS controller (Dell PERC H200), serving the four internal SAS HD
2) LSI SAS controller I pulled from an IBM server. It is flashed as HBA, with LSI 2008 (B2) firmware, and has worked fine in the past in this server. The JBOD is currently configured with 20 disks on one lane and 25 disks on the other lane.

Booting up with the first lane connected to the HBA, I find that in the FreeNAS I see 24 disks: da0 to da23.
It clearly has logged the 20 JBOD drives and the four internals all in one row. Ok...

I want to do the traditional "burn in" / s.m.a.r.t. logging / badblocks register on all of the 45 drives in the JBOD.
After a while, some of the drives seem to give me odd results (e.g. one of the drives is finishing the "smartctl -t long /dev/daX" in suspiciously short time, so I would like to identify it in the JBOD to pull it out.
sas2ircu should help with this, right?
Ok, I type in "sas2ircu list" and get the result
Code:
         Adapter      Vendor  Device                       SubSys  SubSys
 Index    Type          ID      ID    Pci Address          Ven ID  Dev ID
 -----  ------------  ------  ------  -----------------    ------  ------
   0     SAS2008     1000h    72h   00h:02h:00h:00h      1028h   1f1eh
SAS2IRCU: Utility Completed Successfully.

...so far so expected.
But when I try to find the serial number of the disk in question by typing "sas2ircu 0 display|grep WD-WCAVY096XXXX" I get no results.
Weird.
Ok, let's go the long way: "sas2ircu 0 display".
Here's the result. I am very, very confused:
LSI Corporation SAS2 IR Configuration Utility.
Version 20.00.00.00 (2014.09.18)
Copyright (c) 2008-2014 LSI Corporation. All rights reserved.

Read configuration has been initiated for controller 0
------------------------------------------------------------------------
Controller information
------------------------------------------------------------------------
Controller type : SAS2008
BIOS version : 7.11.10.00
Firmware version : 7.15.08.00
Channel description : 1 Serial Attached SCSI
Initiator ID : 0
Maximum physical devices : 39
Concurrent commands supported : 2607
Slot : 0
Segment : 0
Bus : 2
Device : 0
Function : 0
RAID Support : Yes
------------------------------------------------------------------------
IR Volume information
------------------------------------------------------------------------
------------------------------------------------------------------------
Physical device information
------------------------------------------------------------------------
Initiator at ID #0

Device is a Hard disk
Enclosure # : 1
Slot # : 0
SAS Address : 5000c50-0-57b6-4759
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : SEAGATE
Model Number : ST2000NM0023
Firmware Revision : GS0D
Serial No : Z1X1XXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Hard disk
Enclosure # : 1
Slot # : 1
SAS Address : 5000c50-0-57b6-3ced
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : SEAGATE
Model Number : ST2000NM0023
Firmware Revision : GS0D
Serial No : Z1X1XXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Hard disk
Enclosure # : 1
Slot # : 2
SAS Address : 5000c50-0-57b9-d4dd
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : SEAGATE
Model Number : ST2000NM0023
Firmware Revision : GS0D
Serial No : Z1X1XXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Hard disk
Enclosure # : 1
Slot # : 3
Device is a Hard disk
Enclosure # : 1
Slot # : 2
SAS Address : 5000c50-0-57b9-d4dd
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : SEAGATE
Model Number : ST2000NM0023
Firmware Revision : GS0D
Serial No : Z1X1XXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Hard disk
Enclosure # : 1
Slot # : 3
Device is a Hard disk
Enclosure # : 1
Slot # : 2
SAS Address : 5000c50-0-57b9-d4dd
State : Ready (RDY)
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : SEAGATE
Model Number : ST2000NM0023
Firmware Revision : GS0D
Serial No : Z1X1XXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Hard disk
Enclosure # : 1
Slot # : 3
SAS Address : 5000039-6-d812-73d6
State : Ready (RDY)
Size (in MB)/(in sectors) : 1907729/3907029167
Manufacturer : TOSHIBA
Model Number : MG04SCA20EN
Firmware Revision : DS04
Serial No : 2690A11UXXXX
GUID : N/A
Protocol : SAS
Drive Type : SAS_HDD

Device is a Enclosure services device
Enclosure # : 1
Slot # : 9
SAS Address : 5d81f06-0-dd41-6000
State : Standby (SBY)
Manufacturer : DP
Model Number : BACKPLANE
Firmware Revision : 1.10
Serial No : 3AID2YR
GUID : N/A
Protocol : SAS
Device Type : Enclosure services device
------------------------------------------------------------------------
Enclosure information
------------------------------------------------------------------------
Enclosure# : 1
Logical ID : 5c81f660:dd416000
Numslots : 9
StartSlot : 0
Primary Boot Slot : 0
------------------------------------------------------------------------
SAS2IRCU: Command DISPLAY Completed Successfully.
SAS2IRCU: Utility Completed Successfully.

Three Seagate and one Toshiba are my internal disks - they are connected to the Dell PERC H200 controller!
And the JBOD appears as "Enclosure 1, Slot 9" in the list?

I would be most grateful for any suggestion on how to proceed because this thing is confusing the heck out of me!
Many thanks!
Hanry
 

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080

Chris Moore

Hall of Famer
Joined
May 2, 2015
Messages
10,080
Weird.
Ok, let's go the long way: "sas2ircu 0 display".
You probably need to be looking at adapter 1 instead of adapter 0.
 

Hanry

Cadet
Joined
Dec 29, 2017
Messages
3
Thank you Chris - I did read quite a few similar posts from over the years but had not come across that most recent one - I shall certainly try the 'camcontrol devlist' tomorrow morning!

As for the adapter - there is no 'adapter 1' - that is what is driving me crazy. 'sas2ircu list' shows exactly one adapter (item 0), and that one adapter appears to be accessing disks which are physically connected to two different HBAs - madness!
 
Top