I had a glitch…

I guess once you start talking about backups it never ends…

See, after getting everything set up and to my liking, I found much to my annoyance that I had a glitch.

Under random circumstances, my backups would fail, usually with some kind of “can’t create directory” error.

Glitches suck, because they can be tough to debug — because by definition glitches work properly most of the time. And usually fail when it’s inconvenient to debug. Fortunately, I’d seen this one before, but I thought I’d write about it for others who might run into it.

The first thing to try in these cases is simple: Disk Utility. It’s very possible that somewhere along the way the disk got corrupted and that’s causing your problem. Tried that, but the glitch came back, so that wasn’t it.

Buried in the Energy Saver System Preference is one that says “Put the hard disk(s) to sleep when possible”. Apple seems to default this to on. I have always turned it off; in the early days of Mac OS X there were disk drivers that had problems with it and would cause glitches. Over the years things got better, but I still have never really seen any real advantage to it.

So I turned it off.

And the glitch went away. Case closed.

But here’s what seems to be happening. When Time Machine fires up (I think I saw it once with Superduper, but in general, Superduper isn’t sensitive to this, Time Machine was VERY sensitive to it) sends out a disk write request to create the backup directory. Not sure who’s to blame for the glitch, but if the disk is spun down, Time Machine doesn’t wait and reports it as a failure. Not sure if this is the driver returning a “not ready yet, try again later” that Time Machine is seeing as an error, or if Time Machine has a timeout and if it doesn’t get the response back fast enough it errors, but either way, if you ask me, the software should really be smart enough to recognize this situation and do something useful, and “error out and abort” isn’t my definition of useful.

My recommendation: turn it off. Or at the very least, turn it off when attached to the power adaptor. And quietly ask yourself why Time Machine isn’t smart enough to deal with this situation, when, well, it’s kinda it’s JOB.

To take it a step further, what if this hadn’t fixed the gltich? what next?

For me, the next step would have been to put the drive mechanism into a different housing — it’s living in that removable dock, which is new to me, and I’d need to figure out if that housing was the cause or the drive itself (which is also new). If the glitch follows the drive, it’s probably got a problem and you ought to see about having it replaced under warranty. If it goes away in the new housing, then it’s the old housing, and you have to figure out what to do, whether it’s replace or reduce your dependence on it or whatever. There are, fortunately, only so many parts to these things, so this kind of replacement swap isn’t hard to do and can quickly help you find which piece is the core or the problem.

On a related note, Laurie’s main data disk (2x500Gb mirrored raid) filled up, so we had to find more room for her. The fast reaction was to shift her to a 750Gb drive I had handy, but we ordered 2x2Tb drives and I’ll be fitting them into the RAID this weekend and that’ll give her some room to expand. It also creates complications on her backups I’m still trying to figure out how best to solve, because her backup disks are big enough for her data set, but now for the size of the data set she’s going to grow on those new disks. We have time, but I want it solved before it’s a problem.

This has me rethinking Drobos. Drobo just announced a NAS, which looks interesting, but you can buy two “plug into the computer” Drobos for the cost of the Drobo NAS, and that’s an intriguing option as well. I’m guessing the long-term answer is a Drobo on each of our primary machines and a Drobo NAS for backups, but how to build them out and in what order, I’m not sure yet.  and honestly, there are other things I’d rather spend my money on, than backups.

But I’d rather spend money on backups than Drivesavers, ya know?

You might also want to read:

  1. My trip through Time Capsule Hell leads to a different backup approach My trip through Time Capsule Hell leads to a different backup approach:   I bought a one terabyte Time Capsule shortly after it hit the...
  2. Why I don’t depend on Time Machine (and other followups to the backup note..) So it’s now Monday, and about 24 hours after I posted my note on my new backups and disk scheme. And I wrote that after...
  3. Following my own advice on backups…. While writing my article on backups (and it’s followup) I decided some of my practices weren’t what I wanted them to be. The primary issue...
  4. Will google reshape online backups? Another followup on my backup article. Google has recently announced the ability to buy online storage at prices dramatically lower than anyone else: 20 gigabytes...
  5. Some more thoughts on backups. I had a couple of people email me on my backup article (thank you all for the links and feedback!), and that led to a...

  • http://www.chuqui.com chuqui

    I see no reason to move away from superduper. Been rock solid for me, and it's not the cause of any issues, so why?

  • DaveD

    Drobo owner here. No problems at all.

    Owned a 4x500gB ReadyNAS since 1/2008 (before the NetGear buyout). Started thinking about disk space and redundant BU drives last summer. Bought a 4x1TB Drobo last October (10/2009) and have not had a single issue – not one. It's now my primary backup media (swapped it with the ReadyNAS)

    I'd recommend a Drobo for a couple of reasons:

    (1) Much easier to expand. Yeah I know, their RAID is proprietary, and I'm sure you've heard those who wonder about what happens if they go under.

    But you know what? My ReadyNAS had a power supply go last October. (I started as a mainframe operator in the late 1970s and if you've been one you too understand the irony in how “perfecty timed” that happened, going 12 days before I got my Drobo.) Imagine my concern in finding NetGear (who I abhor for their crappy wireless routers) were involved? Needless to say, I bought TWO power supplies.

    As for the proprietary RAID? I haven't heard a single issue with it. With buying a pair of 4TB drives and putting them in the enclosure when I decide to.

    (2) Much quieter. Sure, this is either a discretionary or a cosmetic thing. But you know what? It matters.

    One thing – don't get the NAS add on. I don't remember the product name but it's the thing that makes it available over the wireless. I'm not speaking from experince (and from this post it sounds like they have something new) but that doesn't sound like something that works with wide enough bandwidth. I'm using mine connected up to a MacMini and the speed bottleneck is nothing at all, unlike everything I hear about that add on.

  • http://www.chuqui.com chuqui

    No technology is perfect. Drobo has had its glitches, but the vast majority of people I know who've used one like it. There have been issues with early versions, issues that root cause back to pilot error, and sometimes, units go bad or don't work right out of the box. But most people like them, and from my research, issues are isolated, so I don't consider them a significant negative or something to worry about.

    YMMV. as always, everyone needs to do their own research and make decisions that work for them.

  • MacRat

    I have always left the option to spin down the disks when not in use.

    Maybe you should think about moving away from SuperDuper?

    • http://www.chuqui.com chuqui

      I see no reason to move away from superduper. Been rock solid for me, and it's not the cause of any issues, so why?

  • Alex

    I have heard numerous horror stories about Drobo. What do you think about that?

    • DaveD

      Drobo owner here. No problems at all.

      Owned a 4x500gB ReadyNAS since 1/2008 (before the NetGear buyout). Started thinking about disk space and redundant BU drives last summer. Bought a 4x1TB Drobo last October (10/2009) and have not had a single issue – not one. It's now my primary backup media (swapped it with the ReadyNAS)

      I'd recommend a Drobo for a couple of reasons:

      (1) Much easier to expand. Yeah I know, their RAID is proprietary, and I'm sure you've heard those who wonder about what happens if they go under.

      But you know what? My ReadyNAS had a power supply go last October. (I started as a mainframe operator in the late 1970s and if you've been one you too understand the irony in how “perfecty timed” that happened, going 12 days before I got my Drobo.) Imagine my concern in finding NetGear (who I abhor for their crappy wireless routers) were involved? Needless to say, I bought TWO power supplies.

      As for the proprietary RAID? I haven't heard a single issue with it. With buying a pair of 4TB drives and putting them in the enclosure when I decide to.

      (2) Much quieter. Sure, this is either a discretionary or a cosmetic thing. But you know what? It matters.

      One thing – don't get the NAS add on. I don't remember the product name but it's the thing that makes it available over the wireless. I'm not speaking from experince (and from this post it sounds like they have something new) but that doesn't sound like something that works with wide enough bandwidth. I'm using mine connected up to a MacMini and the speed bottleneck is nothing at all, unlike everything I hear about that add on.

    • http://www.chuqui.com chuqui

      No technology is perfect. Drobo has had its glitches, but the vast majority of people I know who've used one like it. There have been issues with early versions, issues that root cause back to pilot error, and sometimes, units go bad or don't work right out of the box. But most people like them, and from my research, issues are isolated, so I don't consider them a significant negative or something to worry about.

      YMMV. as always, everyone needs to do their own research and make decisions that work for them.