Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Serious Time Machine bug on Mountain Lion

Some of us have seen a few cases of a pretty nasty problem with Time Machine backups on Mountain Lion.


In the worst cases, the backups could not be used to do a full system restore from recent backups -- they didn't appear on the selection screen that shows only "complete" backups.


Plus, they're not recognized as backups by Setup Assistant or Migration Assistant. They don't even appear on the Select the Source or Select Your System windows.


In those cases, the top-level System, Library, and (hidden) private folders weren't backed-up at all (and in at least one other, Applications as well). But all backups complete normally, and Verify Backups from the Time Machine menubar on network backups, and Verify Disk or Repair Disk via Disk Utility do not show a problem (because what's there is intact; those can't tell what's missing.)



(In addition, we've seen a few threads where backups were unexpectedly large, sometimes all of them, sometimes just some, intermittently. In at least some of those cases, one or more of those folders was getting backed-up in full. We don't know if this is really the same problem, but it sure is suspicious.)



The problem seems to be with the Time Machine preferences file being damaged somehow; the fix is easy -- do a "full reset" of Time Machine, per #A4 in Time Machine - Troubleshooting. It won't change existing backups of course, but new ones should be ok.



However, as we have no clue as to the cause yet, we need to be sure Apple knows about this, in great detail, so I'm asking for some folks who are having these problems, and are fairly comfortable with the Finder at least, and following directions to do other things you may not be so familiar with, to help us collect information and file Bug Reports with Apple before running the fix above (as that will destroy the evidence).


If you're having this problem, and your Mac is still usable, and you're interested, please post back and we'll supply instructions.


If you're having the problem and just want to run the fix, by all means do so, but please don't post back with just a "me, too" post, unless you have something significant to add -- this thread may get long and those won't really help.


But if you're having a different problem, please do not respond to this thread. Start a new one, instead. If you're not sure how to do that, please go to the main Apple Support Communities page; some Tutorials are listed at the right. They'll show you how to get started.

Posted on Jun 4, 2013 6:11 AM

Reply
48 replies

Jun 4, 2013 6:55 AM in response to Pondini

If you have an affected system, it may be beneficial to folks to compare the two preference files. Instead of directly deleting the file, move it to your Desktop, and then after setting up Time Machine again use FileMerge (provided with XCode) to run a comparison on the new and old preference files. This may outline some common areas of the file that could be the cause for the problem, unless the problem is with corruption in other aspects of the file.

Jun 4, 2013 9:55 AM in response to Topher Kessler

It's not happened to me, and I have no clue how to reproduce it. In most cases, it's something that happened months ago, but is just turning up now, when the backups are needed most. (We may get a clue from some of the folks having the seemingly-related problem in the 5th paragraph of my first post.)


So far, I have two victims running TMdiagnostics, filing Bug Reports, and sending copies of the prefs files to me. I don't use Xcode, but should be able to find a way to see the differences.


As far as I can tell, there is no predefined setting to do what it's doing, though -- that's why this is so bizarre.


Thanks!

Jun 4, 2013 2:39 PM in response to Pondini

When I read about this problem I immediately booted from the recovery partition and went to the restore option and sure enough, the latest backup available was several months old. When I look at my 2.5TB external USB all the proper folders are their including the last 6 hourly folders taken last night and this morning. Each of them listed approx 74,270 items and almost identical 449.65 GB size. If that seems strange, it did to me also since the drives lists 1.4 TB available out of the 2.5TB size and the sum of the 6 folders is well over the 2.5TB size of the drive. Obviously the get info calculation of the folder sizes is incorrect. Just to make sure this was not a funciton of the folders being after the last available restore point I looked at the sizes of folders prior to that point and they exhibitted the same impossible size. It seems that the folder structure on a Time Machine volume is not something that can be reliably investigated with the Finder. I have not yet performed the plist fix so if there is anything you want me to look at on my drive please pass it on. I am going back to turn off TechTool snapshots as a possible help in reducing size since that has been discussed in other threads. I do run Parallels but have excluded the Virtual machine file and manually back that up to another volume. I will continue to follow this thread and add anything else I discover. BTW I am on an imac running 10.8.3, 1TB, 12 GB.


Brian

Jun 4, 2013 2:47 PM in response to brianvegas

brianvegas wrote:

. . .

It seems that the folder structure on a Time Machine volume is not something that can be reliably investigated with the Finder.

Correct. It's chock-full of "hard links" with many files and folders belonging to many folders at once. See the tan box in How Time Machine works its Magic for an explanation.



I have not yet performed the plist fix so if there is anything you want me to look at on my drive please pass it on.

Via the Finder, see what folders are at the top level of the drive. See the green box in the above link if you're not sure how they're organized.


Specifically, look for Applications, System, and Library. If any of those are missing, and you didn't exclude them, you've been bitten.

Jun 4, 2013 3:23 PM in response to Pondini

In every folder after the one listed as the latest backup when I go to restore, Applications, System and Library are missing and they were not excluded. As I understand the plist deletion fix, it will not delete all the backup data but restart the correct process to make restorable backups but still leave TM intact so I can do individual file recovery for any files previously backed up. Is there any other investigation I can do to help the investigation? I just looked back at some dates and the beginning of my problem appears to closely coincide with the release of 10.8.3, coincidence???

Jun 4, 2013 3:33 PM in response to brianvegas

brianvegas wrote:


In every folder after the one listed as the latest backup when I go to restore, Applications, System and Library are missing and they were not excluded. As I understand the plist deletion fix, it will not delete all the backup data but restart the correct process to make restorable backups but still leave TM intact so I can do individual file recovery for any files previously backed up.

Correct. You shouldn't have to do any recovery; once the fix is done, all the missing stuff should be inluded in the next backup. See below.


the beginning of my problem appears to closely coincide with the release of 10.8.3, coincidence???

Aha! That's our first actual clue! 😉 That's exactly the kind of thing that may help. Be sure to note that in your Bug Report!


Here's the procedure:



RUN THE DIAGNOSTICS


Turn Time Machine OFF, but keep the backup destination selected on the Preferences window.


If your backups are on a Time Capsule, connect to it, but obviously don't do any backups.



Open the Terminal app (in your Applications/Utilities folder). Be very careful with this app. It's a direct link into UNIX, the underpinnings of OSX, but without the protections of OSX.


In Terminal, the prompt looks like this: <Computer Name>:~ <your name>$


(where <your name> is your short user name). It's followed by a non-blinking block cursor.


Copy and paste the following after the prompt:


sudo tmdiagnose -f ~/Desktop


and press Return. You'll be prompted for your Admin password (which won't be displayed). Press Return again.


You'll see an explanatory note, then press Return again to actually run the command.


That will run a whole series of commands, and take a few minutes. Here's a sample of the beginning of what you'll see:


User uploaded file


When it's done, it will put a zip file on your Desktop containing all the output. Keep it somewhere safe so you can attach it to the bug report.


Also please move the com.apple.TimeMachine.plist file in Library/Preferences somewhere safe. There's a copy in the diagnostic package for Apple, but I'd like you to email it to me so I can take a look, too.




RUN AND TEST THE FIX


Do a "full reset" of Time Machine, per #A4 in Time Machine - Troubleshooting. (Since you already moved the old file, above, you can skip step 5 only. If step 6 shows your drive as the destination, Restart your Mac and do step 5 through the end).


That should fix the problem.


Run a backup. It will be somewhat longer, larger, and slower than usual, but all the proper folders should be backed-up.



FILE A BUG REPORT


See the green box in Reporting a Problem to Apple.


Be as clear and concise as possible: the main thing is, while you never excluded them via the Preferences Window, TM did not back up the top-level folders that are missing from your backups (any of Applications, Library, and System). The diagnostic package doesn't seem to show that, so please include a screenshot of the backups in question via the Finder, illustrating which top-level folders were, and were not, backed-up.


And be clear that once you replaced the prefs file, the problem vanished -- the proper folders were backed-up.


Also attach the diagnostic report, of course.


You probably won't hear back from them for a few weeks or months, but you might get a request for more info. Eventually you should get some sort of answer, but maybe just that they're closing your report because they've already identified the problem and are working on it. They won't tell you when it's fixed, though. We just have to test every time an update is released.



ALSO . . .


Please send the old preferences file to me, at the address on my Contact page. I'd like to take a look at it. Please note the Bug Report number, too.


Spot-check future backups to see if the fix "sticks." Let us know if it doesn't, and if you get any response to your Bug Report.


Thank you very much. This may be a big help in getting it fixed!

Jun 4, 2013 4:17 PM in response to Pondini

Never mind the possible lead with the 10.8.3 update. I just checked my wife's almost identical setup and it has been doing a backup that has not reflected the Applications, System, or Library folders since December. I can only imagine that it will deny the ability to even do a restore without going online for a Mountain Lion reinstall. I'm going to go fix hers now and then go check our laptop backups. Yuk!

Jun 4, 2013 4:25 PM in response to Topher Kessler

I just saw the write-up on your site, and have a couple of suggestions:


• Often it's not enough to just delete the plist and set up again; you have to make sure the old values aren't being held by System Prefs or a running backup, or a cache somewhere. The clue is, when you go back to set up again, if it shows the backup drive still selected, you've got the old copy, likely still damaged.


• Several folks on your site seem to think they have to erase their backups and start over. Folks tend to jump to the worst conclusions, don't they? 😟



I just got one of the plist copies, hope to start peering at it soon . . .

Jun 4, 2013 5:19 PM in response to Pondini

We may have a clue. 🙂


The plist shows the folders in question in the ExcludeByPath section, which is not accessible from or displayed on the Preferences window.


Those are special exclusions normally set in the extended attributes of a file or folder. They're used by extra Apple apps, such as iPhoto and iTunes, and 3rd-party apps, to exclude things that don't need to be backed-up, such as the iPod cache in iTunes, build folders in Xcode, etc. That means developers don't have to ask Apple to add them to the standard exclusions list. Unlike "normal" exclusions, they also follow the file if it's moved or renamed.



So . . . it's hard to tell for sure yet, until we get some more samples, but it appears that some app, somewhere, somehow, is updating the preferences file directly. With BAD stuff. 😢


Stay tuned . . .

Jun 4, 2013 8:19 PM in response to brianvegas

brianvegas wrote:


Never mind the possible lead with the 10.8.3 update. I just checked my wife's almost identical setup and it has been doing a backup that has not reflected the Applications, System, or Library folders since December. I can only imagine that it will deny the ability to even do a restore without going online for a Mountain Lion reinstall. I'm going to go fix hers now and then go check our laptop backups. Yuk!

Bingo! (I'd put a smiley here, but doesn't really seem appropriate.)


The file you sent me has the same bogus exclusions as other one I got earlier (my "We may have a clue" post above.


And your confirmation that your other 2 Macs have the same problem helps, too.


Can you determine, from the rough dates this started on each of them, any pattern? I'm thinking installation of an app, or using one. I can't imagine why any app would do it, but it looks like something has told Time Machine not to back up those folders.


Since we don't know what the trigger is, after running the fix, keep an eye on your backups to see if it "sticks." If possible, try to do that at least once per day, so you can pinpoint the timing before TM starts deleting hourly backups (after 24 hours, except the first of the day). If it suddenly stops backing-up those folders, you may be able to connect it to something you've done, and/or we might find something in your logs for that time.


If it really is an app, it's likely a 3rd-party one, on the theory that if it were an Apple app, the problem would be much more common. If so, Apple will be hard-pressed to find it!


Thanks very much for your help; keep us posted.

Jun 4, 2013 8:49 PM in response to Pondini

I perhaps should have been clearer in my explanations, but since nobody ought to be formatting their drives, they should see the system pick up where it left off. If for some reason the backups do not do this, then they may have to start from scratch, which is all I was attempting to say.


I've never understood why folks get protective of their TM backups. They're not at all permanent, and are not an archive, and can be remade quickly if something goes awry. If for some reason you are always accessing your backups and restoring files, then my suggestion would be to alter your workflow such that you are not relying on your backup for this purpose.

Jun 4, 2013 9:29 PM in response to Pondini

Pondini wrote:


The plist shows the folders in question in the ExcludeByPath section, which is not accessible from or displayed on the Preferences window.



That has been my experience. During last September to December I had about 6 backups where /System /Applications, etc. were excluded by the ExcludeByPath section. But the exclusions were gone from the ExcludeByPath for the next backup. Hence the occasional larger than usual backup - the one following the bad one. I failed to find a satisfactory or repeateble reason.


I suggest that we have two, probably related, scenarios - both with the ExcludeByPath problem:


1. Those where this happens once (or occasionally) and is corrected for the following backup. As in paragraph 5 of the OP. This is a 'nuisance' (larger than expected backup) but is not fatal for recovery as following backups are complete.


2. Those where the ExcludeByPath gets set permanently. These are the potential disasters being highlighted by Pondini and Topher.

Jun 4, 2013 9:45 PM in response to Gilby101

Gilby101 wrote:

. . .

1. Those where this happens once (or occasionally) and is corrected for the following backup. As in paragraph 5 of the OP. This is a 'nuisance' (larger than expected backup) but is not fatal for recovery as following backups are complete.

That's the scenario we need to examine.


Can you think of any app you have, or had, that would have any reason to be telling Time Machine not to back up those folders? It makes no sense to me, and it's hard to imagine it happening by accident. Sure wish it wasn't so long ago.


Are you sure it's no longer happening? You might want to check periodically.


I'm also wondering if a developer put in an app, intended to be temporary, to make backups smaller and quicker during testing, and forgot to remove it. And/or, also had code to remove it, but it doesn't always work (terrible design, but you never know). That would be even harder to find.


(I've asked the folks in the other thread, where it's intermittent, to do the same.)


What a mess!

Jun 4, 2013 10:14 PM in response to Pondini

Pondini wrote:


Can you think of any app you have, or had, that would have any reason to be telling Time Machine not to back up those folders? It makes no sense to me, and it's hard to imagine it happening by accident. Sure wish it wasn't so long ago.


I initially suspected the Microsoft Silverlight install because it had created an ExcludeByPath key with one path /Library/Application Support/Microsoft/PlayReady. After removing it and not touching Silverlight, the exclusiuon of /Applications, etc. recurred. Long ago, but I have kept .plists from that tiome and will send them to you.




Are you sure it's no longer happening? You might want to check periodically.


Definitiely not happened since December. I have two checks:

  • Occasionally use BackupLoupe to analyse backups - useful app for many reasons..
  • Use Hazel to copy com.apple.TimeMachine.plist to a folder on my desktop every time it changes and it does change on every TM backup.


I am more concenred about those with the permanent problem and who wouyld not be able to do a full recovery.

Serious Time Machine bug on Mountain Lion

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.