SMART functionality on ThinkServer RAID 720i AnyRAID (smartd.conf is empty)

T H R E E

Dabbler
Joined
Apr 24, 2020
Messages
14
I might add a strong community is something you'd always like to have when it comes to software you are going to put into production. eg: this thread
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Although I'm not one to particularly endorse mrsas over a real HBA, I'd be surprised if Lenovo had removed the direct-attach functionality.

I mean, you even get daN devices at one point.

Definitely keep researching ways of getting a real HBA in there, but I'm curious to know what sas3ircu 0 display says when you're in mrsas mode (and mfi mode, while you're at it).
 

T H R E E

Dabbler
Joined
Apr 24, 2020
Messages
14
Although I'm not one to particularly endorse mrsas over a real HBA, I'd be surprised if Lenovo had removed the direct-attach functionality.

I mean, you even get daN devices at one point.

Definitely keep researching ways of getting a real HBA in there, but I'm curious to know what sas3ircu 0 display says when you're in mrsas mode (and mfi mode, while you're at it).

For both mfi and mrsas I get.
Code:
SAS3IRCU: No Controllers Found.
SAS3IRCU: No Controllers Found at Index 0.
 

T H R E E

Dabbler
Joined
Apr 24, 2020
Messages
14
Although I'm not one to particularly endorse mrsas over a real HBA, I'd be surprised if Lenovo had removed the direct-attach functionality.

I mean, you even get daN devices at one point.

Definitely keep researching ways of getting a real HBA in there, but I'm curious to know what sas3ircu 0 display says when you're in mrsas mode (and mfi mode, while you're at it).

I find it strange they get assigned as daX and then get destroyed, I mean something specific must be causeing that. Thats why I originally thought there may be a way to get it running with mrsas.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
Interesting, if sas3ircu can't talk to the controller, that sounds like the firmware is indeed hacked to hell and back. I'll have to remember to try that out on the similar-vintage Lenovo servers we have at work... What does the card identify itself as under lspci?
 

T H R E E

Dabbler
Joined
Apr 24, 2020
Messages
14
Interesting, if sas3ircu can't talk to the controller, that sounds like the firmware is indeed hacked to hell and back. I'll have to remember to try that out on the similar-vintage Lenovo servers we have at work... What does the card identify itself as under lspci?

In lspci it identifies as 03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3108 [Invader] (rev 02). There is also 05:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03) though im not sure if it is relevant.
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,194
There is also 05:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03) though im not sure if it is relevant.
Probably just there to drive some random controller on the motherboard that uses legacy PCI instead of PCIe.
Actually, it seems to be mystery device that tends to pop up when discussing their BMCs.

03:00.0 RAID bus controller: Broadcom / LSI MegaRAID SAS-3 3108 [Invader] (rev 02)
So that looks normal, which raises the question of why sas3ircu doesn't like it...
 

latez

Dabbler
Joined
Sep 29, 2014
Messages
12
Well guess what folks - I ran into the same situation. Found an incredibly good deal on Ebay that was far too good to pass up and scooped up the exact same model TD350 w/ the AnyRaid 720ix controller. After finally modding the fans with Noctua's and making the necessary firmware updates, I finally got to unpacking my shiny new Lenovo 530-8i aka LSI 9400-8i only to find to my horror and to some of you following this thread that there's quite frankly nowhere to plug into. After getting over my horror, I panickly called Lenovo's support (the machine still had warranty) only to spend an hour and half to get to the same conclusion I had initially. The 15 drive variety of this monster can indeed ONLY support the 720ix.

Not quite sure what to do with this now - this can't replace the T420 I was intending to replace.

Also - the 05:00.0 PCI bridge: ASPEED Technology, Inc. AST1150 PCI-to-PCI Bridge (rev 03) device is simply part of the onboard BMC/VGA adapter

Code:
ses0: <Lenovo 720ix 0305> Fixed Enclosure Services SPC-3 SCSI device
ses0: 150.000MB/s transferscd0: <PLDS DVDROM DH16D8SH ML31> Removable CD-ROM SCSI device

ses0: SES Device
cd0: 150.000MB/s transfers (SATA 1.x, UDMA5, ATAPI 12bytes, PIO 8192bytes)
cd0: Attempt to query device size failed: NOT READY, Medium not present - tray closed
ses0: (none) in 'ArrayDevice00', SAS Slot: 1 phys at slot 0
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses1 at ahciem0 bus 0 scbus7 target 0 lun 0
run_interrupt_driven_hooks: still waiting after 180 seconds forses0:  phy 0: parent 500062b2017bdb7f addr 5000c5009457eef5
xpt_config enc_nop_confighook_cbses1:  enc_nop_confighook_cb
<AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses1: SEMB SES Device
ses2 at ahciem1 bus 0 scbus14 target 0 lun 0
ses1: cd0 in 'Slot 03', SATA Slot: scbus6 target 0
ses2: <AHCI SGPIO Enclosure 2.00 0001> SEMB S-E-S 2.00 device
ses2: SEMB SES Device
ses0: (none) in 'ArrayDevice01', SAS Slot: 1 phys at slot 1
da0 at mrsas0 bus 1 scbus2 target 30 lun 0
da1 at mrsas0 bus 1 scbus2 target 31 lun 0
da2 at mrsas0 bus 1 scbus2 target 32 lun 0
da3 at mrsas0 bus 1 scbus2 target 33 lun 0
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
da2: da0: da3: da1: <LENOVO ST1200MM0088 L58C> Fixed Direct Access SPC-4 SCSI device
<LENOVO ST1200MM0088 L58C> Fixed Direct Access SPC-4 SCSI device
ses0:  phy 0: parent 500062b2017bdb7f addr 5000c500945881cd
<LENOVO ST1200MM0088 L58C> Fixed Direct Access SPC-4 SCSI device
<LENOVO ST1200MM0088 L58C> Fixed Direct Access SPC-4 SCSI device
da0: Serial Number Z4020JSX0000C7528B46
da2: Serial Number Z4020K6W0000C7528GRD
da3: Serial Number Z4020GX20000C8014GRC
da0: 150.000MB/s transfersda2: 150.000MB/s transfersda3: 150.000MB/s transfers
da1: Serial Number Z4020BGF0000C7525SET

da2: 1144641MB (2344225968 512 byte sectors)
da0: 1144641MB (2344225968 512 byte sectors)

da1: 150.000MB/s transfersda5 at umass-sim0 bus 0 scbus16 target 0 lun 0
da3: 1144641MB (2344225968 512 byte sectors)
da5:
da1: 1144641MB (2344225968 512 byte sectors)
<SanDisk Cruzer Fit 1.00> Removable Direct Access SPC-4 SCSI device
da4 at mrsas0 bus 1 scbus2 target 34 lun 0
da4: da5: Serial Number 4C530001160108116224
da5: 40.000MB/s transfers<LENOVO ST1200MM0088 L58C> Fixed Direct Access SPC-4 SCSI device

da5: 30528MB (62521344 512 byte sectors)
da5: quirks=0x2<NO_6_BYTE>
da4: Serial Number Z4020FX20000C801BQ7V
da4: 150.000MB/s transfers
da4: 1144641MB (2344225968 512 byte sectors)
ses0: da0,pass1 in 'ArrayDevice02', SAS Slot: 1 phys at slot 2
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500062b2017bdb7f addr 5000c50094587905
ses0: da3,pass4 in 'ArrayDevice03', SAS Slot: 1 phys at slot 3
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500062b2017bdb7f addr 5000c500945901e5
ses0: da4,pass5 in 'ArrayDevice04', SAS Slot: 1 phys at slot 4
ses0:  phy 0: SAS device type 1 phy 0 Target ( SSP )
ses0:  phy 0: parent 500062b2017bdb7f addr 5000c50094592ee5


Code:
root@freenas[~]# storcli /c0 show all

Generating detailed summary of the adapter, it may take a while to complete.

CLI Version = 007.1207.0000.0000 Sep 25, 2019
Operating system = FreeBSD 11.3-RELEASE-p7
Controller = 0
Status = Success
Description = None


Basics :
======
Controller = 0
Model = Lenovo ThinkServer RAID 720ix AnyRAID Adapter
Serial Number = SV62842083
Current Controller Date/Time = 05/01/2020, 05:28:07
Current System Date/time = 04/30/2020, 22:28:06
SAS Address = 500062b2017bdb70
PCI Address = 00:03:00:00
Mfg Date = 07/11/16
Rework Date = 00/00/00
Revision No = 07C


Version :
=======
Firmware Package Build = 24.21.0-0124
Firmware Version = 4.680.00-8515
CPLD Version = 26971-00A
Bios Version = 6.36.00.3_4.19.08.00_0x06180203
HII Version = 03.25.05.12
NVDATA Version = 3.1705.00-0020
Ctrl-R Version = 5.19-0603
Preboot CLI Version = 01.07-05:#%0000
Boot Block Version = 3.07.00.00-0003
Driver Name = mrsas
Driver Version = 07.709.04.00-fbsd



Bus :
===
Vendor Id = 0x1000
Device Id = 0x5D
SubVendor Id = 0x17AA
SubDevice Id = 0x1053
Host Interface = PCI-E
Device Interface = SAS-12G
Bus Number = 3
Device Number = 0
Function Number = 0


Pending Images in Flash :
=======================
Image name = No pending images


Status :
======
Controller Status = Optimal
Memory Correctable Errors = 0
Memory Uncorrectable Errors = 0
ECC Bucket Count = 0
Any Offline VD Cache Preserved = No
BBU Status = NA
PD Firmware Download in progress = No
Support PD Firmware Download = No
Lock Key Assigned = No
Failed to get lock key on bootup = No
Lock key has not been backed up = No
Bios was not detected during boot = No
Controller must be rebooted to complete security operation = No
A rollback operation is in progress = No
At least one PFK exists in NVRAM = Yes
SSC Policy is WB = No
Controller has booted into safe mode = No
Controller shutdown required = No


Supported Adapter Operations :
============================
Rebuild Rate = Yes
CC Rate = Yes
BGI Rate  = Yes
Reconstruct Rate = Yes
Patrol Read Rate = Yes
Alarm Control = No
Cluster Support = No
BBU = NA
Spanning = Yes
Dedicated Hot Spare = Yes
Revertible Hot Spares = Yes
Foreign Config Import = Yes
Self Diagnostic = Yes
Allow Mixed Redundancy on Array = No
Global Hot Spares = Yes
Deny SCSI Passthrough = No
Deny SMP Passthrough = No
Deny STP Passthrough = No
Support more than 8 Phys = Yes
FW and Event Time in GMT = No
Support Enhanced Foreign Import = Yes
Support Enclosure Enumeration = Yes
Support Allowed Operations = Yes
Abort CC on Error = Yes
Support Multipath = Yes
Support Odd & Even Drive count in RAID1E = No
Support Security = Yes
Support Config Page Model = Yes
Support the OCE without adding drives = Yes
Support EKM = Yes
Snapshot Enabled = No
Support PFK = Yes
Support PI = Yes
Support LDPI Type1 = No
Support LDPI Type2 = No
Support LDPI Type3 = No
Support Ld BBM Info = No
Support Shield State = Yes
Block SSD Write Disk Cache Change = Yes
Support Suspend Resume BG ops = Yes
Support Emergency Spares = Yes
Support Set Link Speed = Yes
Support Boot Time PFK Change = No
Support JBOD = Yes
Disable Online PFK Change = No
Support Perf Tuning = Yes
Support SSD PatrolRead = Yes
Real Time Scheduler = Yes
Support Reset Now = Yes
Support Emulated Drives = Yes
Headless Mode = Yes
Dedicated HotSpares Limited = No
Point In Time Progress = Yes
Extended LD = Yes
Support Uneven span  = No
Support Config Auto Balance = No
Support Maintenance Mode = No
Support Diagnostic results = Yes
Support Ext Enclosure = Yes
Support Sesmonitoring = Yes
Support SecurityonJBOD = Yes
Support ForceFlash = Yes
Support DisableImmediateIO = Yes
Support LargeIOSupport = Yes
Support DrvActivityLEDSetting = Yes
Support FlushWriteVerify = Yes
Support CPLDUpdate = Yes
Support ForceTo512e = Yes
Support discardCacheDuringLDDelete = Yes
Support JBOD Write cache = No
Support Large QD Support = No
Support Ctrl Info Extended = No
Support IButton less = No
Support AES Encryption Algorithm = No
Support Encrypted MFC = No
Support Snapdump = Yes
Support Force Personality Change = No
Support Dual Fw Image = No
Support PSOC Update = No
Support Secure Boot = No
Support Debug Queue = Yes
Support Least Latency Mode = Yes
Support OnDemand Snapdump = Yes
Support Clear Snapdump = Yes
Support FW Triggered Snapdump = Yes
Support PHY current speed = No
Support Lane current speed = No
Support NVMe Width = No
Support Lane DeviceType = No


Enterprise Key management :
=========================
Capability = Supported
Boot Agent = Not Available
Configured = No


Supported PD Operations :
=======================
Force Online = Yes
Force Offline = Yes
Force Rebuild = Yes
Deny Force Failed = No
Deny Force Good/Bad = No
Deny Missing Replace = No
Deny Clear = No
Deny Locate = No
Support Power State = Yes
Set Power State For Cfg = No
Support T10 Power State = No
Support Temperature = Yes
NCQ = Yes
Support Max Rate SATA = No
Support Degraded Media = No
Support Parallel FW Update = Yes
Support Drive Crypto Erase = Yes
Support SSD Wear Gauge = No


Supported VD Operations :
=======================
Read Policy = Yes
Write Policy = Yes
IO Policy = Yes
Access Policy = Yes
Disk Cache Policy = Yes
Reconstruction = Yes
Deny Locate = No
Deny CC = No
Allow Ctrl Encryption = No
Enable LDBBM = Yes
Support FastPath = Yes
Performance Metrics = Yes
Power Savings = No
Support Powersave Max With Cache = No
Support Breakmirror = Yes
Support SSC WriteBack = No
Support SSC Association = No
Support VD Hide = Yes
Support VD Cachebypass = Yes
Support VD discardCacheDuringLDDelete = Yes
Support VD Scsi Unmap = No


Advanced Software Option :
========================

--------------------------------------------
Adv S/W Opt         Time Remaining  Mode
--------------------------------------------
MegaRAID FastPath   Unlimited       Secured
MegaRAID SafeStore  Unlimited       Secured
MegaRAID RAID6      Unlimited       Secured
MegaRAID RAID5      Unlimited       Secured
--------------------------------------------

Safe ID =  X1EQDHF96IUW32CDV655KTVTGGNP1X9DH8T5C3RZ

HwCfg :
=====
ChipRevision =  C0
BatteryFRU = N/A
Front End Port Count = 0
Backend Port Count = 8
BBU = Absent
Alarm = Missing
Serial Debugger = Present
NVRAM Size = 32KB
Flash Size = 32MB
On Board Memory Size = 1024MB
CacheVault Flash Size = NA
TPM = Absent
Upgrade Key = Present
On Board Expander = Present
Temperature Sensor for ROC = Present
Temperature Sensor for Controller = Absent
Upgradable CPLD = Present
Upgradable PSOC = Absent
Current Size of CacheCade (GB) = 0
Current Size of FW Cache (MB) = 907
ROC temperature(Degree Celsius) = 89


Policies :
========

Policies Table :
==============

------------------------------------------------
Policy                          Current Default
------------------------------------------------
Predictive Fail Poll Interval   300 sec
Interrupt Throttle Active Count 16
Interrupt Throttle Completion   50 us
Rebuild Rate                    30 %    30%
PR Rate                         30 %    30%
BGI Rate                        30 %    30%
Check Consistency Rate          30 %    30%
Reconstruction Rate             30 %    30%
Cache Flush Interval            4s
------------------------------------------------

Flush Time(Default) = 4s
Drive Coercion Mode = 128MB
Auto Rebuild = On
Battery Warning = On
ECC Bucket Size = 15
ECC Bucket Leak Rate (hrs) = 24
Restore Hot Spare on Insertion = On
Expose Enclosure Devices = On
Maintain PD Fail History = On
Reorder Host Requests = On
Auto detect BackPlane = SGPIO/i2c SEP
Load Balance Mode = Auto
Security Key Assigned = Off
Disable Online Controller Reset = Off
Use drive activity for locate = Off


Boot :
====
BIOS Enumerate VDs = 1
Stop BIOS on Error = Off
Delay during POST = 0
Spin Down Mode = None
Enable Ctrl-R = No
Enable Web BIOS = No
Enable PreBoot CLI = No
Enable BIOS = Yes
Max Drives to Spinup at One Time = 2
Maximum number of direct attached drives to spin up in 1 min = 10
Delay Among Spinup Groups (sec) = 12
Allow Boot with Preserved Cache = Off


High Availability :
=================
Topology Type = None
Cluster Permitted = No
Cluster Active = No


Defaults :
========
Phy Polarity = 0
Phy PolaritySplit = 0
Strip Size = 256 KB
Write Policy = WT
Read Policy = No Read Ahead
Cache When BBU Bad = Off
Cached IO = Off
VD PowerSave Policy = Controller Defined
Default spin down time (mins) = 30
Coercion Mode = 128 MB
ZCR Config = Unknown
Max Chained Enclosures = 16
Direct PD Mapping = No
Restore Hot Spare on Insertion = Yes
Expose Enclosure Devices = Yes
Maintain PD Fail History = Yes
Zero Based Enclosure Enumeration = Yes
Disable Puncturing = Yes
EnableLDBBM = Yes
DisableHII = No
Un-Certified Hard Disk Drives = Allow
SMART Mode = Mode 6
Enable LED Header = Yes
LED Show Drive Activity = Yes
Dirty LED Shows Drive Activity = No
EnableCrashDump = Yes
Disable Online Controller Reset = No
Treat Single span R1E as R10 = No
Power Saving option = Disabled
TTY Log In Flash = Yes
Auto Enhanced Import = Yes
BreakMirror RAID Support = single span R1
Disable Join Mirror = Yes
Enable Shield State = Yes
Time taken to detect CME = 60 sec


Capabilities :
============
Supported Drives = SAS, SATA
RAID Level Supported = RAID0, RAID1(2 or more drives), RAID5, RAID6, RAID00, RAID10(2 or more drives per span), RAID50, RAID60
Enable JBOD = Yes
Mix in Enclosure = Allowed
Mix of SAS/SATA of HDD type in VD = Not Allowed
Mix of SAS/SATA of SSD type in VD = Not Allowed
Mix of SSD/HDD in VD = Not Allowed
SAS Disable = No
Max Arms Per VD = 32
Max Spans Per VD = 8
Max Arrays = 128
Max VD per array = 64
Max Number of VDs = 64
Max Parallel Commands = 928
Max SGE Count = 60
Max Data Transfer Size = 512 sectors
Max Strips PerIO = 128
Max Configurable CacheCade Size(GB) = 0
Max Transportable DGs = 0
Enable Snapdump = Yes
Enable SCSI Unmap = Yes
FDE Drive Mix Support = No
Min Strip Size = 64 KB
Max Strip Size = 1.000 MB


Scheduled Tasks :
===============
Consistency Check Reoccurrence = 168 hrs
Next Consistency check launch = 05/02/2020, 03:00:00
Patrol Read Reoccurrence = 168 hrs
Next Patrol Read launch = 05/02/2020, 03:00:00
Battery learn Reoccurrence = NA
Next Battery Learn = NA
OEMID = Broadcom

JBOD Drives = 5

JBOD LIST :
=========

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type
----------------------------------------------------------------------------
0:0      31 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:1      32 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:2      30 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:3      33 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:4      34 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
----------------------------------------------------------------------------

EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|Onln=Online|
Offln=Offline|Intf=Interface|Med=Media Type|SeSz=Sector Size

Physical Drives = 5

PD LIST :
=======

----------------------------------------------------------------------------
EID:Slt DID State DG     Size Intf Med SED PI SeSz Model            Sp Type
----------------------------------------------------------------------------
0:0      31 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:1      32 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:2      30 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:3      33 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
0:4      34 JBOD  -  1.090 TB SAS  HDD N   N  512B ST1200MM0088     U  -
----------------------------------------------------------------------------

EID=Enclosure Device ID|Slt=Slot No.|DID=Device ID|DG=DriveGroup
DHS=Dedicated Hot Spare|UGood=Unconfigured Good|GHS=Global Hotspare
UBad=Unconfigured Bad|Onln=Online|Offln=Offline|Intf=Interface
Med=Media Type|SED=Self Encryptive Drive|PI=Protection Info
SeSz=Sector Size|Sp=Spun|U=Up|D=Down|T=Transition|F=Foreign
UGUnsp=UGood Unsupported|UGShld=UnConfigured shielded|HSPShld=Hotspare shielded
CFShld=Configured shielded|Cpybck=CopyBack|CBShld=Copyback Shielded
UBUnsp=UBad Unsupported|Rbld=Rebuild

Enclosures = 2

Enclosure LIST :
==============

-----------------------------------------------------------------------------------------
EID State Slots PD PS Fans TSs Alms SIM Port#                      ProdID VendorSpecific
-----------------------------------------------------------------------------------------
  0 OK       28  5  0    0   1    0   0 Port 0 - 3 & Port 4 - 7 x8 720ix  x48-125.3.5.1
252 OK        8  0  0    0   0    0   1 -                          SGPIO
-----------------------------------------------------------------------------------------

EID=Enclosure Device ID |PD=Physical drive count |PS=Power Supply count|
TSs=Temperature sensor count |Alms=Alarm count |SIM=SIM Count


Edit: Updated to the latest enclosure firmware version - no change (125.3.9.0)
 
Last edited:

latez

Dabbler
Joined
Sep 29, 2014
Messages
12
One thing of note and this may or may not be useful to @T H R E E - OmniOS seems to pick up the driver ok.

Quick dd benchmark I ran on a 2x2 mirror using 10k drives this system shipped with -

Code:
Memory size: 65416 Megabytes

write 40.96 GB via dd, please wait...
time dd if=/dev/zero of=/tank/dd.tst bs=2048000 count=20000

20000+0 records in
20000+0 records out
40960000000 bytes transferred in 125.966182 secs (310MB/sec)

real     2:05.9
user        0.1
sys        22.5

40.96 GB in 125.9s = 325.34 MB/s Write

wait 40 s
read 40.96 GB via dd, please wait...
time dd if=/tank/dd.tst of=/dev/null bs=2048000

20000+0 records in
20000+0 records out
40960000000 bytes transferred in 26.735142 secs (1.43GB/sec)

real       26.7
user        0.0
sys        26.7


As you can see the reads were cached so I ran another with a much larger size - Not exactly world beating
Code:
20000+0 records in
20000+0 records out
163840000000 bytes transferred in 822.594139 secs (190MB/sec)
 
Top