Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Follow-up from https://discussions.apple.com/message/13337119#13337119

Follow-up from https://discussions.apple.com/thread/2805056?answerId=13337119022#13337119022

(question about Time Machine in Snow Leopard's time).


15 months later, here I am, back again with yet another horror story.


Mac OS X 10.7.4. Since the last problem, I kept using both the disk utility and Time Machine. The process for using Time Machine is still the same as described in April 2011. That is, the Mac's two users are encrypted using the old Filevault (which is, as far as function goes, a better solution than the new one that encrypts the whole system disk - if only because it allows to encrypt the users' data while having a non encrypted admin account from which maintenance can be done by a person that does not need to access confidential data). Time Machine saves are done manually from this admin non encrypted account while the two users are logged out and the modem is powered off.


Recently, because the Time-Machine Firewire disk was becoming a bit full, I erased it (after doing two separate full disk backups using disk utility and testing that I could reboot from each of these two backups). I then did a full Time Machine save of the disk. Since then, only two incremental Time Machine saves were done, using the above process.


Then a minor disaster struck. An erroneous command deleted a very big lot of important user files (and the wastebasket was emptied before it was realised that these files had been lost). OK. That's why backups are done, and the last of the two incremental Time Machine saves had been done in the morning. So, no reason to panic.


I powered up the Firewire disk and opened the encrypted user directory saved that very morning on the Time Machine disk. The whole directory structure was present and visible. Only, ABOUT EIGHTY PERCENT OF THE USER DATA FILES WERE CORRUPT ONE WAY OR ANOTHER AND UNUSABLE!!!!!


Given this, the surprising thing is that the remaining twenty percent of the data files were OK...


I had to use one of the backups done with the disk utility to recover the other lost files. Meaning a little over a week worth of data files were lost...


Since I started using Time Machine, I did two sets of tests, which were OK and produced bootable and usable restore but did not include incremental saves. And in the two occasions where I had to use the incremental backups to recover lost data, I was presented with corrupted files or disks!!! Good record, isn't it?


I previously wrote that Time Machine was NOT a backup utility but, at best, a fancy copy utility, because it did not check the integrity of the saved data. Today I must reckon that it isn't even a copy utility, but a death trap!


BACKUPS INTEGRITY IS THE SINGLE MOST IMPORTANT FEATURE ON A COMPUTER. That Apple is advertising such a trash as Time Machine as a backup utility is simply criminal! And it may cause unlimited damage to whoever is mad or gullible enough to trust her/his data to it...

iMac, Mac OS X (10.7.4), 4 GB memory

Posted on Jul 1, 2012 12:15 PM

Reply
18 replies

Jul 1, 2012 12:47 PM in response to petermac87

Thanks for the tip, Pete. But, as you may have read, I DO use a different set of saved data: clones done with Disk Utility while booted from another disk. I never (yet?) had a problem with these Disk Utility copies of the system disk and I always reboot on them to check their validity after creating them. As I noted in the referenced previous discussion, Disk Utility DOES check the integrity of the saved data...


The trouble is that it is much longer to do a Disk Utility save than a Time Machine incremental save. So I was only using Disk Utility every second week, while I was manually saving incrementally with Time Machine every second day... I now absolutely need to find another solution... Thanks again for shooting me in the foot, Apple... I do not so much resent the fact that Time Machine is bugged (this happens...), but the fact that Apple advertises it as a backup utility when it does not check data integrity. This last point is seriously dishonest (this is an understatement if there ever was one).

Jul 1, 2012 1:40 PM in response to DenisMaillard

Since you're apparently using Time Machine and legacy File Vault in a non-standard and unsupported way, you shouldn't be surprised that they don't work as expected. I suggest you follow Apple's instructions to deactivate legacy FV, and, if you so choose, activate FV 2. Your arguments for not doing so aren't valid. Then, when you need to restore from a snapshot, do it through one of the two interfaces provided for that purpose.

Jul 1, 2012 2:29 PM in response to etresoft

Re. the previous two replies (Linc Davis and etresoft).


May I point out that:


1) My way of using Time Machine may be non standard, it is documented as supported.


2) You state that my argument for not using FV 2 are not valid: would you care to explain why? If a non authorised person has to do maintenance on the system, it is only normal that this person is not given access to confidential data. FV 2 simply does not allow this, while "legacy" FV does. Apple's convenience is not necessarily compatible with the customer's need. And "legacy" FV is still officially supported.


3) You explain me that I'm the weakest part of the backup scheme. OK. I have detailed my backup procedure. Please, explain me WHAT in it is not valid? All I do is ensuring that, when a manual save is done, no user file is left open, no encrypted data is accessed and no remote connection exists. Please, tell me how is this supposed to corrupt a backup?


4) The one possible cause for a problem I spotted in these two replies: I did not (this second time, not the first time 15 months ago when I got as a result a non bootable system disk after a "successful" restore...) use one of the two interfaces provided for this purpose. OK. Then, why is it possible to access saved data in a non supported way if this is critical for the integrity of the saved data? Nice utility that allows this...

Jul 1, 2012 4:29 PM in response to DenisMaillard

4) The one possible cause for a problem I spotted in these two replies: I did not use one of the two interfaces provided for this purpose. OK. Then, why is it possible to access saved data in a non supported way if this is critical for the integrity of the saved data?


I will agree that Apple needs to do something more to prevent direct access to the backup. However, this is almost certainly where your problem is, and I'd guess this could mean your backup is not actually corrupt. If you restore using the actual Time Machine interface, rather than poking at the backup in the Finder, you will likely have more success. Though it's still possible, of course, that the backups have been corrupted, possibly due in part to your messing with the backups in the Finder.


Beyond that, I agree with Linc... you are making your own life more difficult without any actual benefit gained through the strategies you are employing.


Used properly, Time Machine is a very good utility. Of course, part of that proper use is having at least one other backup made by some other utility, in case something goes wrong, as is always a possibility with any backups.

Jul 1, 2012 5:40 PM in response to DenisMaillard

There are 50 million people using the system one way and not having any trouble. You are using the system in a different way and having all kinds of problems. Then you come here and complain that the system doesn't work. The problem is that you have developed your own system. If it doesn't work, you have no one to blame but yourself.


If I recall correctly, the only time user directories get backed up in the old File Vault is during logout. It is not possible for the admin account to manually save a Time Machine backup while the two encrypted users are logged out. Only they can do the backup when they log out. It sounds like you have hacked up your own system to backup the encrypted user home directories manually. This is most definitely not standard. Perhaps you tried to execute that procedure while one of the users was logged in. That would be a good way to corrupt 80% of your backup. The way old File Vault worked with Time Machine is that, while both the home directory and backup encrypted images were open, it did a backup of normal, unencrypted files. That is relatively stable because if either image were corrupt, your login probably wouldn't work, let alone the backup.


There is no way to tell how long the old File Vault will work. I think there as already been one bug that only hit people still using the old File Vault. Eventually, it won't work at all. You really can't have an unprivileged administrator. If you try, you definitely can't roll your own backu with Time Machine. It just doesn't work that way.

Jul 2, 2012 3:59 AM in response to DenisMaillard

As once again, a corallary to Murphy's Law is proven.

"How many backups are required?" One more than

what you have.


Being paranoid of any sort of computer failure and relying

on computers for work, I keep 3, sometimes 4, backups of

all data, automatic and manual. And, at the end of the

day upload changes off site.


When working with a computer centric business, there is

no such thing as two many backups.

Jul 2, 2012 3:22 PM in response to DenisMaillard

OK. So, my problem is that I did not restore the user files in a supported way.


Question: I'd like to find out where the supported ways of restoring files are documented. I ask because I couldn't find it on the support site AND THERE ARE SUPPORT ARTICLES (from Snow Leopard time) THAT DO RECOMMEND RESTORING INDIVIDUAL FILES BY MANUALLY MOUNTING THE SPARSEBUNDLE IMAGE THE WAY I DID...


Also, I did open Time Machine when logged in an encrypted account, went to the date of the save I wished to restore, and accessed directories Users, then Username and doubleclicked on username.sparsebundle. This offered me to "Open with DiskImageMounter" and I dutifully clicked (and also double-clicked) on the button. Which, in either case, produced NO result... What is going wrong there?


So I had to spend a whole afternoon restoring the complete system disk's last save previous to the time of the accidental unwanted delete on a clone of the system disk, then rebooted on that clone, accessed the user files and found that they were indeed this time accessible and uncorrupted. Which allowed me to copy to the normal system disk the ones that were missing.


So far, so good.


Thanks for pointing to me that the problem was possibly there. I now have one record of one Time Machine use in case of problem that went well.


Note that, 15 months ago, when I "successfully" (according to Time Machine) restored my system disk, I did it the supported way and nevertheless was presented with a non bootable disk... This problem was never explained and I've no reason to believe it could not happen again.


No thanks however for hinting that the cause of the problem may have been doing a manual save on a quiesced system. I agree that you may be right in calling this overkill, but I don't agree that it could cause Time Machine to corrupt data. If it did, the product would simply not be worth a single cent.


No thanks either for pointing that the use of a supported feature ("legacy" Filevault) could have been the cause of the problem. Had it been the case, it would have been a bug. Period.


There remain two serious issues with Time Machine.


The first issue is the non functionality of the "Open with DiskImageMounter" button. Any possible explanation?


The second issue is, in a way, much more serious. If manually mounting the sparsebundle file is not supported (while there are support articles that recommend it...) and results, as demonstrated in my case, in restoring corrupted files, then it is a serious security issue that it is at all possible to do it. The more so as forbidding it should not be very difficult to implement.


Well, I must say I'm sorry to have to act and write as if I were the grumpy smurf, but I must point out that, until now, I did not have much luck with the one application that, ideally, should never have a problem on any OS.



Also:

"There are 50 million people using the system one way and not having any trouble. You are using the system in a different way and having all kinds of problems. Then you come here and complain that the system doesn't work. The problem is that you have developed your own system. If it doesn't work, you have no one to blame but yourself."


This is a standard answer you could do to any user who runs into any uncommon problem and is simply a way to say "I don't care" to a real problem.



"If I recall correctly, the only time user directories get backed up in the old File Vault is during logout. It is not possible for the admin account to manually save a Time Machine backup while the two encrypted users are logged out. Only they can do the backup when they log out. It sounds like you have hacked up your own system to backup the encrypted user home directories manually. This is most definitely not standard. Perhaps you tried to execute that procedure while one of the users was logged in. That would be a good way to corrupt 80% of your backup. The way old File Vault worked with Time Machine is that, while both the home directory and backup encrypted images were open, it did a backup of normal, unencrypted files. That is relatively stable because if either image were corrupt, your login probably wouldn't work, let alone the backup."


I have hacked nothing and I can guaranty that NO encrypted user is logged in when I do the save, because this system is used like a single user machine. There is ZERO chance that I did it while another user was logged in. Standard or not is irrelevant in such a case. And the save was actually not corrupted, as today's manipulations showed. You are just imagining a fake reality that would fit your position rather than accepting my word. I grant you that you do not have to believe me, but I'm certainly in a better position to know how things are done on this system than you are.



"There is no way to tell how long the old File Vault will work. I think there as already been one bug that only hit people still using the old File Vault. Eventually, it won't work at all."


Interesting position that provide a lot of upward compatibility to the users... They'll appreciate.

Jul 2, 2012 6:03 PM in response to DenisMaillard

DenisMaillard wrote:


Question: I'd like to find out where the supported ways of restoring files are documented. I ask because I couldn't find it on the support site AND THERE ARE SUPPORT ARTICLES (from Snow Leopard time) THAT DO RECOMMEND RESTORING INDIVIDUAL FILES BY MANUALLY MOUNTING THE SPARSEBUNDLE IMAGE THE WAY I DID...


The only way you should restore files is from the Time Machine interface. You can run the "Time Machine" application or you can choose "Enter Time Machine" from the Time Machine item in the menu bar. You can do that from the Finder or from any application that has built-in support for Time Machine, such as Mail or AddressBook. The only time you should ever manually go into a Time Machine volume is if the Time Machine interface fails. This will only happen if your Time Machine backup is already corrupted. If this is the case and this is your only backup, then you have nothing to lose.


Also, I did open Time Machine when logged in an encrypted account, went to the date of the save I wished to restore, and accessed directories Users, then Username and doubleclicked on username.sparsebundle. This offered me to "Open with DiskImageMounter" and I dutifully clicked (and also double-clicked) on the button. Which, in either case, produced NO result... What is going wrong there?


Everything. When logged into an encypted account, all you should do is run the "Time Machine" application or execute the "Enter Time Machine" command.


So I had to spend a whole afternoon restoring the complete system disk's last save previous to the time of the accidental unwanted delete on a clone of the system disk, then rebooted on that clone, accessed the user files and found that they were indeed this time accessible and uncorrupted. Which allowed me to copy to the normal system disk the ones that were missing.


So far, so good.


No, that sounds like a disaster. If you need to do a complete restore, just hold down "R" and boot into your recovery volume. Then restore from Time Machine. The whole thing is automated.


The first issue is the non functionality of the "Open with DiskImageMounter" button. Any possible explanation?


Whatever you were doing corrupted the volume. No mystery there.


The second issue is, in a way, much more serious. If manually mounting the sparsebundle file is not supported (while there are support articles that recommend it...) and results, as demonstrated in my case, in restoring corrupted files, then it is a serious security issue that it is at all possible to do it. The more so as forbidding it should not be very difficult to implement.


Sorry. Once you devise your own backup strategy, all bets are off. Time Machine works fine when used as intended.


I have hacked nothing and I can guaranty that NO encrypted user is logged in when I do the save, because this system is used like a single user machine.


But that is precisely the point. When using Time Machine with old File Vault, an encrypted user must be logged in when you backup. Backups happen automatically at logout.

Jul 3, 2012 9:19 AM in response to etresoft

Maybe I was not clear. If so, I apologize and shall try to make myself plain.


When you say:

"The only way you should restore files is from the Time Machine interface. You can run the "Time Machine" application or you can choose "Enter Time Machine" from the Time Machine item in the menu bar."


This is what I did yesterday afternoon. Previously, on my first attempt, I had tried accessing and restoring the files from the finder. This, because I had found support articles recommending it. By the way, WHERE can a mere mortal find the official documentation of Time Machine (I assume it does exist...)?


This first attempt had resulted in about 80% of corrupt files (but some were clean...). So vital a utility as Time Machine should never allow to do things in a forbidden way.



You say again:

"Everything. When logged into an encrypted account, all you should do is run the "Time Machine" application or execute the "Enter Time Machine" command."


In case I was not clear, this is precisely what I did. And was prompted BY TIME MACHINE, NOT BY THE FINDER to "Open with DiskImageMounter". Which, when I clicked on the button, did exactly nothing. This is why I asked "What is going wrong there?"



Again:

"No, that sounds like a disaster. If you need to do a complete restore, just hold down "R" and boot into your recovery volume. Then restore from Time Machine. The whole thing is automated."


I agree that booting the recovery disk holding "R" is one of the known ways to recover a whole disk. But, if it should not be done from the Time Machine interface run manually, WHY DOES THE UTILITY ALLOW IT AND EVEN INVITE YOU TO DO SO? This is (if it really is unsupported and forbidden) the serious security hole I was mentioning in my previous reply. Also note that it happens to be the one manipulation that allowed me to recover the lost files.



About the non working "Open with DiskImageMounter" button":

"Whatever you were doing corrupted the volume. No mystery there."


In case you did not understand, again, I was IN THE UTILITY INTERFACE IN THE SUPPORTED WAY. The button was non functional and this is what forced me to restore the whole disk. And I did NOT corrupt anything, as evidenced from the fact that the full restored disk I produced later was bootable and provided access to the uncorrupted data files I was looking for. The fact that the button was non functional in the utility is what I was reporting there.



About my own backup strategy, I repeat that I did not hack anything, simply used manually (a supported feature) a utility that can also run automatically. I did use it on a quiesced system, which can in NO way corrupt a backup if the utility is not bugged. The fact that backups of encrypted accounts happen automatically at logout is irrelevant here, as a manual backup done when encrypted users are logged out also saves their accounts, as evidenced by the fact that I did eventually recover the data I was looking for.

Jul 3, 2012 12:46 PM in response to DenisMaillard

DenisMaillard wrote:


on my first attempt, I had tried accessing and restoring the files from the finder. This, because I had found support articles recommending it. By the way, WHERE can a mere mortal find the official documentation of Time Machine (I assume it does exist...)?

Mac 101: Time Machine


If you have a URL for an official Apple support document that recommends some other method, please provide the URL. Such things need to be removed. Apple isn't perfect. Some of their documentation is lacking and/or not advisable.


This first attempt had resulted in about 80% of corrupt files (but some were clean...). So vital a utility as Time Machine should never allow to do things in a forbidden way.

I don't disagree with that but I'm sure other people would.


You say again:

"Everything. When logged into an encrypted account, all you should do is run the "Time Machine" application or execute the "Enter Time Machine" command."


In case I was not clear, this is precisely what I did. And was prompted BY TIME MACHINE, NOT BY THE FINDER to "Open with DiskImageMounter". Which, when I clicked on the button, did exactly nothing. This is why I asked "What is going wrong there?"


I am not familar with that behaviour. It sounds like your Time Machine archive was corrupted from the start. That is the only reason I can think of that it would do that.


I agree that booting the recovery disk holding "R" is one of the known ways to recover a whole disk. But, if it should not be done from the Time Machine interface run manually, WHY DOES THE UTILITY ALLOW IT AND EVEN INVITE YOU TO DO SO? This is (if it really is unsupported and forbidden) the serious security hole I was mentioning in my previous reply. Also note that it happens to be the one manipulation that allowed me to recover the lost files.


The only reason to allow manual access to a Time Machine volume would be to recover the files in case of a serious corruption, which seems to have happened in your case. The question you need to be asking is why it was corrupt in the first place.


You seem to be focusing on Time Machine's behaviour after it had detected a corrupted archive and failed. This is worst-case disaster recovery behaviour. I am trying to get you to focus on how you are performing your backups. That part is clear as mud right now.


In case you did not understand, again, I was IN THE UTILITY INTERFACE IN THE SUPPORTED WAY. The button was non functional and this is what forced me to restore the whole disk. And I did NOT corrupt anything, as evidenced from the fact that the full restored disk I produced later was bootable and provided access to the uncorrupted data files I was looking for. The fact that the button was non functional in the utility is what I was reporting there.


Please see my previous paragraph.


About my own backup strategy, I repeat that I did not hack anything, simply used manually (a supported feature) a utility that can also run automatically. I did use it on a quiesced system, which can in NO way corrupt a backup if the utility is not bugged. The fact that backups of encrypted accounts happen automatically at logout is irrelevant here, as a manual backup done when encrypted users are logged out also saves their accounts, as evidenced by the fact that I did eventually recover the data I was looking for.


One of the problems with using the old File Vault is that you have to rely on old support documents. No one is going to try out something with a configuration from a year ago. All we can do is try to remember how things used to work. From what I understand, it isn't that Time Machine was corrupting your user backups, your backups weren't taking place at all.


The most common problem with Time Machine is human intervention. The more humans stay out of it, the better it works.

Jul 3, 2012 8:49 PM in response to etresoft

OK. I give up. It is the third time you insist that I corrupted my backups (or that they did not take place), while my previous answers should have made it plain that NO corruption took place and that the backups were indeed done. Otherwise, I could never have eventually restored the lost files. Either I am not clear, or you have a comprehension problem. Or both.


What DID happen is that the way I first tried to restore the lost files was not the way it was supposed to be done.


What I was reporting since my second entry are the following points:


- I restored the file the wrong way because I found articles in the Time Machine discussion that recommended it. This is a first problem.


- When trying to restore the lost files the supported way, the command that should have allowed me to do it was not functional. This is another problem.


- IF it is indeed unsupported and forbidden to restore a whole disk from the utility interface called when logged in, then it is a serious security hole to allow it and invite the user to do so. Besides, it actually worked fine and restored a clean system disk. Which makes me wonder if it is indeed forbidden. This is possibly a third problem, depending on whether this is really forbidden or not.


Such issues in so vital a utility as Time Machine should be addressed.


And these problems have NOTHING to do with with my "human intervention". So, please, stop insisting on it as the cause of my trials, as it is now proven that the way I am doing my backups IS indeed clean (as evidenced by the fact that the lost files were eventually recovered from the backups).

Follow-up from https://discussions.apple.com/message/13337119#13337119

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.