Resource icon

SLOG benchmarking and finding the best SLOG

rshakin

Dabbler
Joined
Apr 2, 2019
Messages
24
One more fun toy.... This is RMS-200 From Radiant Memory Systems

Code:
=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02, NSID 0xffffffff)
Critical Warning:                   0x00
Temperature:                        46 Celsius
Available Spare:                    0%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    95,513,598,780 [48.9 PB]
Data Units Written:                 96,577,229,991 [49.4 PB]
Host Read Commands:                 1,148,532,179
Host Write Commands:                1,220,615,011
Controller Busy Time:               430
Power Cycles:                       19
Power On Hours:                     3,293
Unsafe Shutdowns:                   14
Media and Data Integrity Errors:    0
Error Information Log Entries:      1

Error Information (NVMe Log 0x01, max 63 entries)
No Errors Logged


[root@freenas ~]# diskinfo -wS /dev/nvd0
/dev/nvd0
        512             # sectorsize
        8581545984      # mediasize in bytes (8.0G)
        16760832        # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        RMS-200         # Disk descr.
        0085217         # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM

Synchronous random writes:
         0.5 kbytes:     25.9 usec/IO =     18.9 Mbytes/s
           1 kbytes:     26.6 usec/IO =     36.7 Mbytes/s
           2 kbytes:     26.8 usec/IO =     72.9 Mbytes/s
           4 kbytes:     30.3 usec/IO =    129.0 Mbytes/s
           8 kbytes:     33.5 usec/IO =    233.4 Mbytes/s
          16 kbytes:     45.9 usec/IO =    340.4 Mbytes/s
          32 kbytes:     56.3 usec/IO =    555.2 Mbytes/s
          64 kbytes:     66.5 usec/IO =    940.3 Mbytes/s
         128 kbytes:    118.0 usec/IO =   1059.6 Mbytes/s
         256 kbytes:    137.3 usec/IO =   1821.4 Mbytes/s
         512 kbytes:    176.6 usec/IO =   2830.5 Mbytes/s
        1024 kbytes:    315.6 usec/IO =   3169.0 Mbytes/s
        2048 kbytes:    540.0 usec/IO =   3703.8 Mbytes/s
        4096 kbytes:   1020.7 usec/IO =   3918.9 Mbytes/s
        8192 kbytes:   1835.7 usec/IO =   4358.1 Mbytes/s
[root@freenas ~]#
 

Constantin

Vampire Pig
Joined
May 19, 2017
Messages
1,827
Hey that’s fun! Thanks for sharing - right up there with the p4801x at the smallest write blocks.
 

2nd-in-charge

Explorer
Joined
Jan 10, 2017
Messages
94
Via the SAS controller:
So I replaced SAS2208 (IR firmware, mrsas driver) with a SAS3008 (IT firmware, mpr driver).
SAS3008 latency for small records looks much worse.
Code:
smartctl 6.6 2017-11-05 r4594 [FreeBSD 11.2-STABLE amd64] (local build)
Copyright (C) 2002-17, Bruce Allen, Christian Franke, www.smartmontools.org

=== START OF INFORMATION SECTION ===
Model Family:     Intel 730 and DC S35x0/3610/3700 Series SSDs
Device Model:     INTEL SSDSC2BA100G3T
Serial Number:    BTTV428406CP100FGN
LU WWN Device Id: 5 5cd2e4 04b68e2e8
Add. Product Id:  DELL(tm)
Firmware Version: 5DV1DL06
User Capacity:    20,006,048,768 bytes [20.0 GB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
Device is:        In smartctl database [for details use: -P show]
ATA Version is:   ACS-2 T13/2015-D revision 3
SATA Version is:  SATA 2.6, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Tue Jun 11 11:57:28 2019 AEST
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

/dev/da13
        512             # sectorsize
        20006048768     # mediasize in bytes (19G)
        39074314        # mediasize in sectors
        4096            # stripesize
        0               # stripeoffset
        2432            # Cylinders according to firmware.
        255             # Heads according to firmware.
        63              # Sectors according to firmware.
        ATA INTEL SSDSC2BA10    # Disk descr.
        BTTV428406CP100FGN      # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM
        Not_Zoned       # Zone Mode

Synchronous random writes:
         0.5 kbytes:    206.1 usec/IO =      2.4 Mbytes/s
           1 kbytes:    209.1 usec/IO =      4.7 Mbytes/s
           2 kbytes:    208.1 usec/IO =      9.4 Mbytes/s
           4 kbytes:    205.3 usec/IO =     19.0 Mbytes/s
           8 kbytes:    224.5 usec/IO =     34.8 Mbytes/s
          16 kbytes:    236.4 usec/IO =     66.1 Mbytes/s
          32 kbytes:    278.3 usec/IO =    112.3 Mbytes/s
          64 kbytes:    350.5 usec/IO =    178.3 Mbytes/s
         128 kbytes:    631.4 usec/IO =    198.0 Mbytes/s
         256 kbytes:   1261.7 usec/IO =    198.1 Mbytes/s
         512 kbytes:   2503.1 usec/IO =    199.8 Mbytes/s
        1024 kbytes:   5022.4 usec/IO =    199.1 Mbytes/s
        2048 kbytes:   9992.9 usec/IO =    200.1 Mbytes/s
        4096 kbytes:  20178.8 usec/IO =    198.2 Mbytes/s
        8192 kbytes:  40208.6 usec/IO =    199.0 Mbytes/s
/dev/da13
        512             # sectorsize
        20006048768     # mediasize in bytes (19G)
        39074314        # mediasize in sectors
        4096            # stripesize
        0               # stripeoffset
        2432            # Cylinders according to firmware.
        255             # Heads according to firmware.
        63              # Sectors according to firmware.
        ATA INTEL SSDSC2BA10    # Disk descr.
        BTTV428406CP100FGN      # Disk ident.
        Yes             # TRIM/UNMAP support
        0               # Rotation rate in RPM
        Not_Zoned       # Zone Mode

Synchronous random writes:
         0.5 kbytes:    201.6 usec/IO =      2.4 Mbytes/s
           1 kbytes:    210.1 usec/IO =      4.6 Mbytes/s
           2 kbytes:    211.5 usec/IO =      9.2 Mbytes/s
           4 kbytes:    214.9 usec/IO =     18.2 Mbytes/s
           8 kbytes:    221.4 usec/IO =     35.3 Mbytes/s
          16 kbytes:    242.4 usec/IO =     64.5 Mbytes/s
          32 kbytes:    276.4 usec/IO =    113.1 Mbytes/s
          64 kbytes:    359.3 usec/IO =    174.0 Mbytes/s
         128 kbytes:    626.0 usec/IO =    199.7 Mbytes/s
         256 kbytes:   1254.5 usec/IO =    199.3 Mbytes/s
         512 kbytes:   2521.2 usec/IO =    198.3 Mbytes/s
        1024 kbytes:   4982.6 usec/IO =    200.7 Mbytes/s
        2048 kbytes:  10037.5 usec/IO =    199.3 Mbytes/s
        4096 kbytes:  20183.6 usec/IO =    198.2 Mbytes/s
        8192 kbytes:  40485.3 usec/IO =    197.6 Mbytes/s


How can one expect million iops if a single IO takes 200us?
 

drros

Dabbler
Joined
Aug 27, 2018
Messages
10
So I replaced SAS2208 (IR firmware, mrsas driver) with a SAS3008 (IT firmware, mpr driver).
SAS3008 latency for small records looks much worse.
How can one expect million iops if a single IO takes 200us?
Not sure what did you expect to get with 7-years-old-not-intended-to-such-workload drive...
 

2nd-in-charge

Explorer
Joined
Jan 10, 2017
Messages
94
7-years-old-not-intended-to-such-workload drive...
It's not the drive I have a problem with. Same drive on a different (and presumably slower) controller responds within 65us.
 
Last edited:

JimKusz

Dabbler
Joined
Sep 10, 2018
Messages
19
Hi all:
I just got some crucial SSDs to test this idea with, so thought I'd put that in...Not really in the same class as the Intel, but here goes anyway:

Code:
=== START OF INFORMATION SECTION ===
Device Model:     CT250MX500SSD1
Serial Number:    1916E1FBCB5B
LU WWN Device Id: 5 00a075 1e1fbcb5b
Firmware Version: M3CR023
User Capacity:    250,059,350,016 bytes [250 GB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    Solid State Device
Form Factor:      2.5 inches
Device is:        Not in smartctl database [for details use: -P showall]
ATA Version is:   ACS-3 T13/2161-D revision 5
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 3.0 Gb/s)
Local Time is:    Fri Jun 14 22:12:31 2019 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

=== START OF READ SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

General SMART Values:
Offline data collection status:  (0x80)    Offline data collection activity
                    was never started.
                    Auto Offline Data Collection: Enabled.
Self-test execution status:      (   0)    The previous self-test routine completed
                    without error or no self-test has ever 
                    been run.
Total time to complete Offline 
data collection:         (    0) seconds.
Offline data collection
capabilities:              (0x7b) SMART execute Offline immediate.
                    Auto Offline data collection on/off support.
                    Suspend Offline collection upon new
                    command.
                    Offline surface scan supported.
                    Self-test supported.
                    Conveyance Self-test supported.
                    Selective Self-test supported.
SMART capabilities:            (0x0003)    Saves SMART data before entering
                    power-saving mode.
                    Supports SMART auto save timer.
Error logging capability:        (0x01)    Error logging supported.
                    General Purpose Logging supported.
Short self-test routine 
recommended polling time:      (   2) minutes.
Extended self-test routine
recommended polling time:      (  30) minutes.
Conveyance self-test routine
recommended polling time:      (   2) minutes.
SCT capabilities:            (0x0031)    SCT Status supported.
                    SCT Feature Control supported.
                    SCT Data Table supported.

SMART Attributes Data Structure revision number: 16
Vendor Specific SMART Attributes with Thresholds:
ID# ATTRIBUTE_NAME          FLAG     VALUE WORST THRESH TYPE      UPDATED  WHEN_FAILED RAW_VALUE
  1 Raw_Read_Error_Rate     0x002f   100   100   000    Pre-fail  Always       -       0
  5 Reallocated_Sector_Ct   0x0032   100   100   010    Old_age   Always       -       0
  9 Power_On_Hours          0x0032   100   100   000    Old_age   Always       -       4
 12 Power_Cycle_Count       0x0032   100   100   000    Old_age   Always       -       8
171 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
172 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
173 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
174 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       1
180 Unused_Rsvd_Blk_Cnt_Tot 0x0033   000   000   000    Pre-fail  Always       -       31
183 Runtime_Bad_Block       0x0032   100   100   000    Old_age   Always       -       0
184 End-to-End_Error        0x0032   100   100   000    Old_age   Always       -       0
187 Reported_Uncorrect      0x0032   100   100   000    Old_age   Always       -       0
194 Temperature_Celsius     0x0022   066   059   000    Old_age   Always       -       34 (Min/Max 0/41)
196 Reallocated_Event_Count 0x0032   100   100   000    Old_age   Always       -       0
197 Current_Pending_Sector  0x0032   100   100   000    Old_age   Always       -       0
198 Offline_Uncorrectable   0x0030   100   100   000    Old_age   Offline      -       0
199 UDMA_CRC_Error_Count    0x0032   100   100   000    Old_age   Always       -       0
202 Unknown_SSD_Attribute   0x0030   100   100   001    Old_age   Offline      -       0
206 Unknown_SSD_Attribute   0x000e   100   100   000    Old_age   Always       -       0
210 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       0
246 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       9312317
247 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       169609
248 Unknown_Attribute       0x0032   100   100   000    Old_age   Always       -       2447

SMART Error Log Version: 1
No Errors Logged

SMART Self-test log structure revision number 1
No self-tests have been logged.  [To run self-tests, use: smartctl -t]

SMART Selective self-test log data structure revision number 1
 SPAN  MIN_LBA  MAX_LBA  CURRENT_TEST_STATUS
    1        0        0  Not_testing
    2        0        0  Not_testing
    3        0        0  Not_testing
    4        0        0  Not_testing
    5        0        0  Completed [00% left] (0-65535)
Selective self-test flags (0x0):
  After scanning selected spans, do NOT read-scan remainder of disk.
If Selective self-test is pending on power-up, resume after 0 minute delay.

Code:
/dev/ada2
    512             # sectorsize
    250059350016    # mediasize in bytes (233G)
    488397168       # mediasize in sectors
    4096            # stripesize
    0               # stripeoffset
    484521          # Cylinders according to firmware.
    16              # Heads according to firmware.
    63              # Sectors according to firmware.
    CT250MX500SSD1    # Disk descr.
    1916E1FBCB5B    # Disk ident.
    Yes             # TRIM/UNMAP support
    0               # Rotation rate in RPM
    Not_Zoned       # Zone Mode

Synchronous random writes:
     0.5 kbytes:    382.2 usec/IO =      1.3 Mbytes/s
       1 kbytes:    383.2 usec/IO =      2.5 Mbytes/s
       2 kbytes:    408.5 usec/IO =      4.8 Mbytes/s
       4 kbytes:    394.3 usec/IO =      9.9 Mbytes/s
       8 kbytes:    423.0 usec/IO =     18.5 Mbytes/s
      16 kbytes:    438.9 usec/IO =     35.6 Mbytes/s
      32 kbytes:    549.6 usec/IO =     56.9 Mbytes/s
      64 kbytes:    751.5 usec/IO =     83.2 Mbytes/s
     128 kbytes:   1162.1 usec/IO =    107.6 Mbytes/s
     256 kbytes:   1969.1 usec/IO =    127.0 Mbytes/s
     512 kbytes:   2865.9 usec/IO =    174.5 Mbytes/s
    1024 kbytes:   4883.1 usec/IO =    204.8 Mbytes/s
    2048 kbytes:   8729.6 usec/IO =    229.1 Mbytes/s
    4096 kbytes:  16623.0 usec/IO =    240.6 Mbytes/s
    8192 kbytes:  32308.1 usec/IO =    247.6 Mbytes/s

 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Thought I should share over here too ...

regular stuff
Code:
=== START OF INFORMATION SECTION ===
Model Number:                       INTEL SSDPE21K375GA
Serial Number:                      PHKE7510005K375AGN
Firmware Version:                   E2010324
PCI Vendor/Subsystem ID:            0x8086
IEEE OUI Identifier:                0x5cd2e4
Controller ID:                      0
Number of Namespaces:               1
Namespace 1 Size/Capacity:          375,083,606,016 [375 GB]
Namespace 1 Formatted LBA Size:     512
Namespace 1 IEEE EUI-64:            e4d25c 6a8a070100
Local Time is:                      Mon Jul 15 23:27:01 2019 PDT
Firmware Updates (0x02):            1 Slot
Optional Admin Commands (0x0007):   Security Format Frmw_DL
Optional NVM Commands (0x0006):     Wr_Unc DS_Mngmt
Maximum Data Transfer Size:         32 Pages

Supported Power States
St Op     Max   Active     Idle   RL RT WL WT  Ent_Lat  Ex_Lat
 0 +    18.00W       -        -    0  0  0  0        0       0

Supported LBA Sizes (NSID 0x1)
Id Fmt  Data  Metadt  Rel_Perf
 0 +     512       0         2
 1 -     512       8         2
 2 -     512      16         2
 3 -    4096       0         0
 4 -    4096       8         0
 5 -    4096      64         0
 6 -    4096     128         0

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02, NSID 0xffffffff)
Critical Warning:                   0x00
Temperature:                        44 Celsius
Available Spare:                    100%
Available Spare Threshold:          0%
Percentage Used:                    0%
Data Units Read:                    522,565 [267 GB]
Data Units Written:                 4,452,989 [2.27 TB]
Host Read Commands:                 19,271,381
Host Write Commands:                107,530,152
Controller Busy Time:               25
Power Cycles:                       1,120
Power On Hours:                     2,320
Unsafe Shutdowns:                   1,076
Media and Data Integrity Errors:    0
Error Information Log Entries:      0

Error Information (NVMe Log 0x01, max 64 entries)
No Errors Logged



diskinfo -citvwS /dev/nvd0
512 # sectorsize
375083606016 # mediasize in bytes (349G)
732585168 # mediasize in sectors
0 # stripesize
0 # stripeoffset
INTEL SSDPE21K375GA # Disk descr.
PHKE7510005K375AGN # Disk ident.
Yes # TRIM/UNMAP support
0 # Rotation rate in RPM

I/O command overhead:
time to read 10MB block 0.010853 sec = 0.001 msec/sector
time to read 20480 sectors 0.432072 sec = 0.021 msec/sector
calculated command overhead = 0.021 msec/sector

Seek times:
Full stroke: 250 iter in 0.026141 sec = 0.105 msec
Half stroke: 250 iter in 0.011957 sec = 0.048 msec
Quarter stroke: 500 iter in 0.018267 sec = 0.037 msec
Short forward: 400 iter in 0.016424 sec = 0.041 msec
Short backward: 400 iter in 0.018157 sec = 0.045 msec
Seq outer: 2048 iter in 0.060869 sec = 0.030 msec
Seq inner: 2048 iter in 0.046046 sec = 0.022 msec

Transfer rates:
outside: 102400 kbytes in 0.105981 sec = 966211 kbytes/sec
middle: 102400 kbytes in 0.090489 sec = 1131629 kbytes/sec
inside: 102400 kbytes in 0.111131 sec = 921435 kbytes/sec

Asynchronous random reads:
sectorsize: 1341848 ops in 3.000216 sec = 447250 IOPS
4 kbytes: 1343147 ops in 3.000109 sec = 447699 IOPS
32 kbytes: 178116 ops in 3.002087 sec = 59331 IOPS
128 kbytes: 46179 ops in 3.008889 sec = 15348 IOPS

Synchronous random writes:
0.5 kbytes: 32.2 usec/IO = 15.2 Mbytes/s
1 kbytes: 32.4 usec/IO = 30.1 Mbytes/s
2 kbytes: 33.4 usec/IO = 58.4 Mbytes/s
4 kbytes: 25.8 usec/IO = 151.4 Mbytes/s
8 kbytes: 33.2 usec/IO = 235.3 Mbytes/s
16 kbytes: 42.2 usec/IO = 370.4 Mbytes/s
32 kbytes: 56.2 usec/IO = 556.2 Mbytes/s
64 kbytes: 86.7 usec/IO = 720.8 Mbytes/s
128 kbytes: 137.1 usec/IO = 911.6 Mbytes/s
256 kbytes: 215.2 usec/IO = 1161.6 Mbytes/s
512 kbytes: 360.2 usec/IO = 1388.0 Mbytes/s
1024 kbytes: 667.9 usec/IO = 1497.3 Mbytes/s
2048 kbytes: 1221.1 usec/IO = 1637.8 Mbytes/s
4096 kbytes: 2388.8 usec/IO = 1674.5 Mbytes/s
8192 kbytes: 4719.0 usec/IO = 1695.3 Mbytes/s


fancy stuff
Code:
diskinfo -citvwS /dev/pmem0

512 # sectorsize
17179865088 # mediasize in bytes (16G)
33554424 # mediasize in sectors
0 # stripesize
0 # stripeoffset
PMEM region 16GB # Disk descr.
9548ADD1D6FC0231 # Disk ident.
No # TRIM/UNMAP support
0 # Rotation rate in RPM

I/O command overhead:
time to read 10MB block 0.002227 sec = 0.000 msec/sector
time to read 20480 sectors 0.026084 sec = 0.001 msec/sector
calculated command overhead = 0.001 msec/sector

Seek times:
Full stroke: 250 iter in 0.000439 sec = 0.002 msec
Half stroke: 250 iter in 0.000425 sec = 0.002 msec
Quarter stroke: 500 iter in 0.000830 sec = 0.002 msec
Short forward: 400 iter in 0.000622 sec = 0.002 msec
Short backward: 400 iter in 0.000692 sec = 0.002 msec
Seq outer: 2048 iter in 0.002606 sec = 0.001 msec
Seq inner: 2048 iter in 0.002542 sec = 0.001 msec

Transfer rates:
outside: 102400 kbytes in 0.014434 sec = 7094361 kbytes/sec
middle: 102400 kbytes in 0.013545 sec = 7559985 kbytes/sec
inside: 102400 kbytes in 0.013614 sec = 7521669 kbytes/sec

Asynchronous random reads:
sectorsize: 1867310 ops in 3.000057 sec = 622425 IOPS
4 kbytes: 1589498 ops in 3.000047 sec = 529824 IOPS
32 kbytes: 935622 ops in 3.000054 sec = 311868 IOPS
128 kbytes: 328937 ops in 3.001158 sec = 109603 IOPS

Synchronous random writes:
0.5 kbytes: 1.6 usec/IO = 299.9 Mbytes/s
1 kbytes: 1.7 usec/IO = 589.9 Mbytes/s
2 kbytes: 1.7 usec/IO = 1143.4 Mbytes/s
4 kbytes: 1.8 usec/IO = 2135.6 Mbytes/s
8 kbytes: 2.4 usec/IO = 3244.6 Mbytes/s
16 kbytes: 3.7 usec/IO = 4192.4 Mbytes/s
32 kbytes: 9.3 usec/IO = 3344.5 Mbytes/s
64 kbytes: 12.3 usec/IO = 5088.3 Mbytes/s
128 kbytes: 17.6 usec/IO = 7119.2 Mbytes/s
256 kbytes: 27.7 usec/IO = 9021.8 Mbytes/s
512 kbytes: 46.6 usec/IO = 10731.7 Mbytes/s
1024 kbytes: 84.4 usec/IO = 11853.0 Mbytes/s
2048 kbytes: 159.5 usec/IO = 12535.5 Mbytes/s
4096 kbytes: 314.3 usec/IO = 12726.1 Mbytes/s
8192 kbytes: 621.4 usec/IO = 12873.4 Mbytes/s 


Top one is a regular 4800x, bottom one is a Micron 16GB DDR4 2666 NVDimm (mta18asf2g72pf1z-2g6v2) (/w PowerGem attached).

Please don't try that at home - compatibility and interoperability of these nvdimms are a pain in the ....
It will run without PowerGem (BBU) but will not be persistent then; PowerGems might be physically compatible but not necessarily working correctly (have not understood all the variations myself, just been told 'take care' by a real expert).
Many boards support NVDimms but few completely (in my experience - I went through 4 different boards to find one that could do firmware updates with a lot of coaxing and Micron's help)

But of course if you get it working its a monster:)
 

Ericloewe

Server Wrangler
Moderator
Joined
Feb 15, 2014
Messages
20,175
One of my hopes for DDR5 is that NVDIMMs get tighter specifications to improve compatibility.
 

Asteroza

Dabbler
Joined
Feb 12, 2018
Messages
14
NVDIMMs are (were?) a thing for a while, but they seem to have died off in popularity. Viking Technology was making a U.2 device that was DDR4 with flash backing (VT-PM8, VT-PM16) but they got discontinued with no fanfare.

See my post above - the NV1604 is definitely not a plug-and-play solution. Better scratch device than SLOG at this point.

You may be happy to hear that those U.2 drives, originally of Radian Memory Systems design, now appear to be being sold by Radian themselves as the RMS-375, and they are suggesting they might build a 32GB version. Their site and documentation are not consistent about whether the 8GB is actually available, but the 16GB version is clearly available.
 

Asteroza

Dabbler
Joined
Feb 12, 2018
Messages
14
Looking around for Flashtec NV1616 stuff, ran into the following.

Microsemi has a EoL notice ESC-2171905 issued December 13 2017 that states that the NV1608 and NV1616 in bulk purchases will end, with last order February 1 2018, and last delivery June 1 2018 while supplies last.

But, there's a hong kong outfit that claims to have over 5000 units in stock

Infinite Electronics

I am assuming that if that stock count isn't fake, these are the absolute last Flashtec NV1616's left. Good luck buying less than 20 of those from them though...
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Looking around for Flashtec NV1616 stuff, ran into the following.
I am assuming that if that stock count isn't fake, these are the absolute last Flashtec NV1616's left. Good luck buying less than 20 of those from them though...

Over at STH there is a great deal thread linking to a seller in Israel selling individual ones via Ebay...

Quoting myself from the other thread;)
So finally received my drive (NV1616), delayed by courtesy of German customs...

Faster than P4800X, slower than nvdimms, have not done any real life tests though
Been detected natively in FreeNas as nvme device.

Code:
/ diskinfo -citwS  /dev/nvd1
        512             # sectorsize
        16493051904     # mediasize in bytes (15G)
        32212992        # mediasize in sectors
        0               # stripesize
        0               # stripeoffset
        MTR_MLC_TS_16GB # Disk descr.
        0400001C3A46    # Disk ident.
        No              # TRIM/UNMAP support
        0               # Rotation rate in RPM

I/O command overhead:
        time to read 10MB block      0.011780 sec       =    0.001 msec/sector
        time to read 20480 sectors   0.662114 sec       =    0.032 msec/sector
        calculated command overhead                     =    0.032 msec/sector

Seek times:
        Full stroke:      250 iter in   0.014802 sec =    0.059 msec
        Half stroke:      250 iter in   0.015544 sec =    0.062 msec
        Quarter stroke:   500 iter in   0.026569 sec =    0.053 msec
        Short forward:    400 iter in   0.023112 sec =    0.058 msec
        Short backward:   400 iter in   0.020278 sec =    0.051 msec
        Seq outer:       2048 iter in   0.074929 sec =    0.037 msec
        Seq inner:       2048 iter in   0.086890 sec =    0.042 msec

Transfer rates:
        outside:       102400 kbytes in   0.099942 sec =  1024594 kbytes/sec
        middle:        102400 kbytes in   0.093873 sec =  1090835 kbytes/sec
        inside:        102400 kbytes in   0.096388 sec =  1062373 kbytes/sec

Asynchronous random reads:
        sectorsize:    798172 ops in    3.000061 sec =   266052 IOPS
        4 kbytes:      792316 ops in    3.000067 sec =   264099 IOPS
        32 kbytes:     461734 ops in    3.000803 sec =   153870 IOPS
        128 kbytes:    117465 ops in    3.002188 sec =    39126 IOPS

Synchronous random writes:
         0.5 kbytes:    151.1 usec/IO =      3.2 Mbytes/s
           1 kbytes:    151.3 usec/IO =      6.5 Mbytes/s
           2 kbytes:    151.8 usec/IO =     12.9 Mbytes/s
           4 kbytes:    151.1 usec/IO =     25.9 Mbytes/s
           8 kbytes:    152.1 usec/IO =     51.4 Mbytes/s
          16 kbytes:    207.8 usec/IO =     75.2 Mbytes/s
          32 kbytes:    170.4 usec/IO =    183.4 Mbytes/s
          64 kbytes:    192.7 usec/IO =    324.3 Mbytes/s
         128 kbytes:    226.9 usec/IO =    550.9 Mbytes/s
         256 kbytes:    246.5 usec/IO =   1014.2 Mbytes/s
         512 kbytes:    298.6 usec/IO =   1674.3 Mbytes/s
        1024 kbytes:    370.8 usec/IO =   2696.9 Mbytes/s
        2048 kbytes:    559.3 usec/IO =   3576.2 Mbytes/s
        4096 kbytes:    963.8 usec/IO =   4150.1 Mbytes/s
        8192 kbytes:   1788.8 usec/IO =   4472.3 Mbytes/s
 
Last edited:

HoneyBadger

actually does care
Administrator
Moderator
iXsystems
Joined
Feb 6, 2014
Messages
5,110
Over at STH there is a great deal thread linking to a seller in Israel selling individual ones via Ebay...

Quoting myself from the other thread;)
So finally received my drive (NV1616), delayed by courtesy for German customs...

Faster than P4800X, slower than nvdimms, have not done any real life tests though
Been detected natively in FreeNas as nvme device.
Something's not right, those small-block numbers are just brutally slow. What version of FreeNAS are you running?

Also note that without the supercapacitor pack and proprietary blobs to enable the "save to flash on power loss/restore on power on" workflow they're not really non-volatile.

Optane is a way better option for general users IMO.
 

Rand

Guru
Joined
Dec 30, 2013
Messages
906
Something's not right, those small-block numbers are just brutally slow. What version of FreeNAS are you running?

Also note that without the supercapacitor pack and proprietary blobs to enable the "save to flash on power loss/restore on power on" workflow they're not really non-volatile.

Optane is a way better option for general users IMO.
I started a separate thread to keep this one clean
https://www.ixsystems.com/community/threads/nv1616-potential-issues.79332/
 

Asteroza

Dabbler
Joined
Feb 12, 2018
Messages
14
I emailed them. They aren’t not selling them directly to consumers. Was told OEM only.

Yeah, I got that reply as well, and no distributors exist either. Apparently no distributor is willing to bite due to minimum order threshold (undisclosed, but definitely over 100, maybe approaching 1000... which may be painful due to pricing as new) If it was in the few 100's of units range, maybe doing a crowdsourced bulk buy with only DoA support might have been possible. Considering Radian products appear to be showing up in writezilla-type applications in appliances, we'll only see these when there are large fleet retirements of SAN/NAS equipment, which is probably why the RMS-200 is showing up on ebay.
 

turboaaa

Dabbler
Joined
Dec 31, 2017
Messages
36
Wanted to post my Seagate IronWolf 110 SSD benchmarks here. They are not near as good as I was hoping. Considering the consistent latency I am going to assume this has something to do with their advertised "DuraWrite" feature.

Code:
=== START OF INFORMATION SECTION ===
Device Model:     ZA480NM10001
Serial Number:    ---
LU WWN Device Id: 5 000c50 03ea0daeb
Firmware Version: SF44011J
User Capacity:    480,103,981,056 bytes [480 GB]
Sector Sizes:     512 bytes logical, 4096 bytes physical
Rotation Rate:    Solid State Device
Device is:        Not in smartctl database [for details use: -P showall]
ATA Version is:   ACS-4, ACS-2 T13/2015-D revision 3
SATA Version is:  SATA 3.3, 6.0 Gb/s (current: 6.0 Gb/s)
Local Time is:    Mon Oct 21 08:07:46 2019 PDT
SMART support is: Available - device has SMART capability.
SMART support is: Enabled

Code:
    512             # sectorsize
    480103981056    # mediasize in bytes (447G)
    937703088       # mediasize in sectors
    4096            # stripesize
    0               # stripeoffset
    58369           # Cylinders according to firmware.
    255             # Heads according to firmware.
    63              # Sectors according to firmware.
    ATA ZA480NM10001    # Disk descr.
    ---         # Disk ident.
    Yes             # TRIM/UNMAP support
    0               # Rotation rate in RPM
    Not_Zoned       # Zone Mode

Synchronous random writes:
     0.5 kbytes:   3465.6 usec/IO =      0.1 Mbytes/s
       1 kbytes:   3428.0 usec/IO =      0.3 Mbytes/s
       2 kbytes:   3465.8 usec/IO =      0.6 Mbytes/s
       4 kbytes:   3348.7 usec/IO =      1.2 Mbytes/s
       8 kbytes:   3372.6 usec/IO =      2.3 Mbytes/s
      16 kbytes:   3418.3 usec/IO =      4.6 Mbytes/s
      32 kbytes:   3589.6 usec/IO =      8.7 Mbytes/s
      64 kbytes:   3494.9 usec/IO =     17.9 Mbytes/s
     128 kbytes:   3630.0 usec/IO =     34.4 Mbytes/s
     256 kbytes:   3916.0 usec/IO =     63.8 Mbytes/s
     512 kbytes:   4478.3 usec/IO =    111.6 Mbytes/s
    1024 kbytes:   5559.3 usec/IO =    179.9 Mbytes/s
    2048 kbytes:   7746.3 usec/IO =    258.2 Mbytes/s
    4096 kbytes:  12259.7 usec/IO =    326.3 Mbytes/s
    8192 kbytes:  20970.7 usec/IO =    381.5 Mbytes/s
 

HoneyBadger

actually does care
Administrator
Moderator
iXsystems
Joined
Feb 6, 2014
Messages
5,110
Wanted to post my Seagate IronWolf 110 SSD benchmarks here. They are not near as good as I was hoping. Considering the consistent latency I am going to assume this has something to do with their advertised "DuraWrite" feature.

I dug into this one a little. From the manual on the Ironwolf 110:

Power Loss Data Protection  In-process writes to the NAND are completed in the event of an unexpected power loss

https://www.seagate.com/www-content/manuals/ironwolf-110-ssd/pdf/IronWolf_110_SSD_PM-100841919_B.pdf

This is the same as the Crucial MX500's "in progress NAND write" protection and not full end-to-end PLP. The cache is still volatile and as such has to be pushed to actual NAND on a sync write. That's why performance is so terrible.
 

tazinblack

Explorer
Joined
Apr 12, 2013
Messages
77
So here's the reason, why I try to only use Optanes for ZIL:

# smartctl -a /dev/nvme0

...

=== START OF SMART DATA SECTION ===
SMART overall-health self-assessment test result: PASSED

SMART/Health Information (NVMe Log 0x02, NSID 0xffffffff)
Critical Warning: 0x00
Temperature: 47 Celsius
Available Spare: 100%
Available Spare Threshold: 0%
Percentage Used: 0%
Data Units Read: 922,096 [472 GB]
Data Units Written: 501,862,740 [256 TB]
Host Read Commands: 12,056,166
Host Write Commands: 2,739,361,407
Controller Busy Time: 2,048
Power Cycles: 12
Power On Hours: 12,632
Unsafe Shutdowns: 1
Media and Data Integrity Errors: 0
Error Information Log Entries: 0

...

Ok, I confess, I use it as ZIL and SLOG.

I also managed to kill a standard SSD inside another box.
 
Top