Post Reply 
 
Thread Rating:
  • 1 Votes - 5 Average
  • 1
  • 2
  • 3
  • 4
  • 5
mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
05-21-2013, 10:07 AM
Post: #1
mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
There are bits of this conversation in many posts so let's tie things up.

In my situation, I've upgraded my Drobo 5D to the latest and greatest dashboard and firmware (2.5.2 / 3.0.7) and upon doing so, found that my 64 Crucial m4 SSD (04MH Firmware) Life went from what was a steady 100% to a dramatic 11% after the update. Eventually, this was temporarily fixed by bhiga's suggestion to shut down the Drobo, unplug it for 30 seconds, and restart. It's reverted back to 9% Life a day later.

Initially, Drobo Level III stated this was "strictly cosmetic" and that it would be fixed with the next software update. As of today, they now state the following:

"We continued to look at this issue in house, this is what we have determined the recent update to Drobo fixed an issue with the life span reporting for this model (Crucial) of mSATA SSD and that is why the life span dropped significantly after the update. The drop is real and indicates the SSD is likely to fail soon. There is no data risk to a failure of the mSATA, but we recommend it be replaced."

If you have a Crucial mSATA, you may want to check in to this and make some arrangements to address the issue. I have asked Drobo how i should attempt to convince Crucial to send me a new one based on a third party's dashboard...we'll see how that goes.

Zathrak

Drobo 5D | 64GB Crucial m4 SSD | 5 x 3TB Hitachi | Late 2012 iMac Intel Core i7 3.4Ghz, OS X Mountain Lion via Thunderbolt
Find all posts by this user
Quote this message in a reply
05-21-2013, 11:19 AM
Post: #2
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
Crucial hasn't taken responsibility for this and is directing me back to Drobo (no surprise there). I've volleyed this issue back in to Level III's extremely capable hands. #sarcasm

Zathrak

Drobo 5D | 64GB Crucial m4 SSD | 5 x 3TB Hitachi | Late 2012 iMac Intel Core i7 3.4Ghz, OS X Mountain Lion via Thunderbolt
Find all posts by this user
Quote this message in a reply
05-21-2013, 12:04 PM
Post: #3
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
Even Western Digital started asking questions when my DroboPro "failed" 6 hard drives in a row last year. I don't blame them.
The extra escalation and shipping charges were just an incremental cost of getting support from Drobo, until my unit completely failed.

Good luck.

You earn respect by how you live, not by what you demand.
-unknown
Find all posts by this user
Quote this message in a reply
05-21-2013, 02:34 PM
Post: #4
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
If Crucial doesn't see anything wrong with the mSATA (do they have some kind of user-executable diagnostic tool?) then I'd say Drobo Dashboard's report is wrong.

Even if Drobo Dashboard is correct, I find the fact that a good mSATA went to almost complete failure in such a short time. Again if Drobo Dashboard is correct (which I don't believe it is), that would point to Drobo as a likely mSATA murder suspect, especially since others are seeing similar behavior.

--Brandon | WHS2011+Drive Bender/2x Drobo v2/Drobo S G1/ Drobo S G2/Transporter
Drobo provides fault-tolerance, it's NOT a substitute for regular backups.
Drobo Best Practices - Official and Community-sourced.
Find all posts by this user
Quote this message in a reply
05-21-2013, 02:37 PM (This post was last modified: 05-21-2013 02:42 PM by Zathrak.)
Post: #5
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
I do agree that the murder suspect is the drobo itself, especially after a 6 month+ history of melting bays, failing HDDs, and now a sudden 9% mSATA drive. Even if we warranty the mSATA, I'm completely convinced that the issue will return.
What kind of garbage collection is done on the mSATA drive in a Drobo 5D? I wonder how it works and if it's related to the suggested "failure?"

Zathrak

Drobo 5D | 64GB Crucial m4 SSD | 5 x 3TB Hitachi | Late 2012 iMac Intel Core i7 3.4Ghz, OS X Mountain Lion via Thunderbolt
Find all posts by this user
Quote this message in a reply
05-21-2013, 03:23 PM
Post: #6
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
Just wanted to let everyone we are working on this, thank you for all the tests and logs you have sent to us. Yes, we originally thought this was cosmetic - I do apologize. There are a lot of Drobo team members involved here, we are doing everything we can to get to the bottom of this. Again, thank you everyone for your patience and understanding. If you have cases please continue to work with Support. Again, Thank You.
Find all posts by this user
Quote this message in a reply
05-22-2013, 06:26 AM (This post was last modified: 05-22-2013 06:26 AM by Zathrak.)
Post: #7
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
This is slightly on the longer side but I did want to post this for others to see. If you're running OS X, you might try DriveDX which provided me with the info below. The short version: the mSATA is in fact failing.

### SYSTEM INFORMATION ###
Report Timestamp : May 21, 2013 9:27:27 PM EDT
Report Timestamp (ISO 8601 format) : 2013-05-21T21:27:27

Application Name : DriveDx
Application Version : 1.0.7.394
Application Edition : 1

Computer Name : Mac Mini
Host Name : mac-mini.local
IP Address : 10.0.1.14
Computer Model : Macmini6,2

OS Boot Time : 2013-05-20T19:36:05
Time Since Boot : 1 day 01h 51m 22s
OS Name : Mac OS X
OS Version : 10.8.3
OS Build : 12D78
OS Kernel Version : Darwin 12.3.0

ATA Command Support Tolerance : normal
N of drives in report : 2

### DRIVE 2 OF 2 ###
Last Checked : May 21, 2013 9:27:07 PM EDT
Last Checked (ISO 8601 format) : 2013-05-21T21:27:07

Advanced SMART Status : FAILED
Overall Health Rating : BAD 0%
Overall Performance Rating : GOOD 100%
SSD Lifetime Left Indicator : BAD 8.0%
Issues found : 2

Serial No : 000000001235034AF7AC
WWN Id : 5 00a075 1034af7ac
Volumes :
Device Path : /dev/disk2
Total Capacity : 64.0 GB (64,023,257,088 Bytes)
Model Family : Crucial/Micron RealSSD m4/C400
Model : M4-CT064M4SSD3
Firmware Version : 04MH
Drive Type : SSD

Power On Time : 3,877 hours (5 months 11 days 13 hours)
Power Cycles Count : 112
Current Power Cycle Time : 25.9 hours


=== DEVICE CAPABILITIES ===
S.M.A.R.T. support enabled : yes
DriveDx Diagnostic Rules Config : Crucial/Micron RealSSD m4/C400
Sector Logical Size : 512
Sector Physical Size : 512
Physical Interconnect : USB
Removable : yes
Ejectable : no
ATA Version : ACS-2, ATA8-ACS T13/1699-D revision 6
SATA Version : SATA 3.0, 6.0 Gb/s (current: 3.0 Gb/s)
Attributes Data Structure Revision : 16
SMART Command Transport (SCT) flags : 0x3d
SCT Status supported : yes
SCT Feature Control supported : yes
SCT Data Table supported : yes
Error logging capabilities : 0x1
Self-tests supported : yes
Offline Data Collection capabilities : 0x7b
Offline Data Collection status : 0x80
Auto Offline Data Collection flags : 0x1
I/O Path : IOService:/AppleACPIPlatformExpert/PCI0@0/AppleACPIPCI/XHC1@14/AppleUSBXHCI/Usb production@14910000/IOUSBInterface@0/IOUSBMassStorageClass/IOSCSIPeripheralDeviceNub/org_dungeon_driver_IOSATDriver/IOSATServices
[Known device ]: yes
[Drive State Flags ]: 0x40200090
[Last State Change Timestamp ]: 2013-05-21T21:27:07
[Last State Change Flags ]: 0x40200090
[Last State Change Diff Flags ]: 0x1


=== PROBLEMS SUMMARY ===
Failed Indicators (life-span / pre-fail) : 1 (0 / 1)
Failing Indicators (life-span / pre-fail) : 0 (0 / 0)
Warnings (life-span / pre-fail) : 1 (1 / 0)
Failed Self-tests (Short / Full) : 0 (0 / 0)


=== IMPORTANT HEALTH INDICATORS ===
ID NAME RAW VALUE STATUS
5 Reallocated Sector Count 0 100% OK
170 Grown Failing Block Count 0 100% OK
171 Program Fail Count 0 100% OK
172 Erase Fail Count 0 100% OK
173 Wear Leveling Count 2,776 0% Failed
189 Factory Bad Block Count 51 100% OK


=== TEMPERATURE INFORMATION (CELSIUS) ===
Current Temperature : 0
Power Cycle Min Temperature : 0
Power Cycle Max Temperature : 0
Lifetime Min Temperature : 0
Lifetime Max Temperature : 0
Recommended Min Temperature : 5
Recommended Max Temperature : 55
Temperature Min Limit : 5
Temperature Max Limit : 55


=== DRIVE HEALTH INDICATORS ===
ID | NAME | TYPE | UPDATE | RAW VALUE | VALUE | THRESHOLD | WORST | STATUS
1 Raw Read Error Rate Pre-fail online 0x0 100 50 100 100% OK
5 Reallocated Sector Count Pre-fail online 0 100 10 100 100% OK
9 Power On Hours Life-span online 3,877 100 1 100 100% OK
12 Power Cycle Count Life-span online 112 100 1 100 100% OK
170 Grown Failing Block Count Pre-fail online 0 100 10 100 100% OK
171 Program Fail Count Life-span online 0 100 1 100 100% OK
172 Erase Fail Count Life-span online 0 100 1 100 100% OK
173 Wear Leveling Count Pre-fail online 2,776 8 10 8 0% Failed
174 Unexpect Power Loss Count Life-span online 108 100 1 100 100% OK
181 Non4k Aligned Access Life-span online 1,326 100 1 100 100% OK
183 SATA Interface Downshift Life-span online 0 100 1 100 100% OK
184 End-to-End Error Pre-fail online 0 100 50 100 100% OK
187 Reported Uncorrect Life-span online 0 100 1 100 100% OK
188 Command Timeout Life-span online 0 100 1 100 100% OK
189 Factory Bad Block Count Life-span online 51 100 1 100 100% OK
194 Temperature (Celsius) Life-span online 0 100 0 100 100% OK
195 Hardware ECC Recovered Life-span online 0x0 100 1 100 100% OK
196 Reallocated Event Count Life-span online 0 100 1 100 100% OK
197 Current Pending Sectors Count Life-span online 0 100 1 100 100% OK
198 Offline Scan Uncorrectable Error Count Life-span offline 0 100 1 100 100% OK
199 UDMA CRC Error Count Life-span online 0 100 1 100 100% OK
202 Percent Rated Life Used Life-span offline 92 8 1 8 7.1% Warning
206 Write Error Rate Life-span online 0 100 1 100 100% OK


=== DRIVE ERROR LOG ===
error log is empty


=== DRIVE SELF-TEST LOG ===
self-test log is empty

Zathrak

Drobo 5D | 64GB Crucial m4 SSD | 5 x 3TB Hitachi | Late 2012 iMac Intel Core i7 3.4Ghz, OS X Mountain Lion via Thunderbolt
Find all posts by this user
Quote this message in a reply
05-22-2013, 06:40 AM
Post: #8
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
I can confirm this issue. My SSD went from 100% to 95%. Returns to 100% after Drobo reboot but drops to 95% again after this.
Find all posts by this user
Quote this message in a reply
05-22-2013, 08:28 AM
Post: #9
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
For what it's worth (likely not much - just another data point), my Crucial 32GB mSATA has stayed steady at 100%. It may just be a bad drive - it can happen to anything, even solid state. Now that you have direct SMART data from the drive, Crucial shouldn't balk at replacing it.

Drobo 5N | 250GB Samsung 850 EVO mSATA | 2 x 4TB Seagate, 3 x 4TB Hitachi | FS/EXT3 diskpack
Peak performance >100MBps read/write (based on FS disk pack, no jumbo frames, no SSD)
DroboPorts: Plex, Transmission, OpenSSH, NFS, nano, screen, bash
Find all posts by this user
Quote this message in a reply
05-22-2013, 11:17 AM (This post was last modified: 05-22-2013 11:21 AM by Zathrak.)
Post: #10
RE: mSATA Life Failure w/ Dashboard 2.5.2 and Firmware 3.0.7
Fun fact: Just talked to Crucial for quite some time once again even after providing them with copious amounts of information and logs "proving" the drive failure. According to Crucial tech support, "All consumer SSD products that they sell have a total write lifetime capacity of 72TB." I don't know if I've gone over this value yet but if I haven't yet, it's probably not far off considering the constant transferring back and forth of 10TB of data during the 6 months of testing and troubleshooting of the Drobos.

He went on to say that they "recommend using 40GB of write data each day for 5 years" and that once one of their SSDs comes close to the lifetime rating of 72TB write data, it will go in to a "read only" mode as a warning to back up your data and replace the drive."

In any case, I find it interesting that Drobo selected this mSATA as an officially supported drive without mentioning (or knowing) that it can only be used up to 72TB of write data. Surely someone would have asked about this? 0.o

The Crucial rep is giving me a free pass (RMA) due to Drobo's apparent negligence on this but I don't expect this to continue for other cases now that the proverbial cat has been let out of the bag.

I'm not entirely sure that this resolves any of the outstanding issues with this update to the firmware/software though. Anything else, Drobo? --sigh--

P.S. I've also sent this info to Drobo to help since they apparently can't do the legwork on their own.

Zathrak

Drobo 5D | 64GB Crucial m4 SSD | 5 x 3TB Hitachi | Late 2012 iMac Intel Core i7 3.4Ghz, OS X Mountain Lion via Thunderbolt
Find all posts by this user
Quote this message in a reply
Post Reply 


Forum Jump: