Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Does Time Machine use a differential/delta file compression when copying files ?

Hello,


I would like to use Time Machine to backup to a MacBook Air but that computer is using a Virtual Machines store in a single file of 50 GBytes.


Once the initial backup will be done, does Time Machine will only copy the changes in this large file or will everyday copy the full 50 Bytes?


In other word does Time Machine use a differential/dela file compression algorithm (like un rsync)?


If it is not yet the case, can you please file for me an application request to the development team internally?


If others are also interested in such a feature, you’re welcome to vote for it.


Kind regards,

Olivier

MacBook Air, OS X Mountain Lion (10.8.4)

Posted on Jul 26, 2013 6:29 AM

Reply
21 replies

Jul 26, 2013 6:37 AM in response to ohault

Unless the single file database uses a sparse bundle type scheme, it is treated as a single file and any change will require a full copy of that database.


The capability to work with Time Machine is already implemented in the Sparse Bundle storage format. You need to request that your App developers build their monolithic storage formats compatible with Time Machine.

If others are also interested in such a feature, you’re welcome to vote for it.

Polls and petitions violate the terms of use of this forum.

Aug 2, 2013 2:43 AM in response to ohault

Ok, it looks like the current version of Time Machine cannot handle efficiently in network terms large files like Virtual Machine files and this a real issue today.


Is anybody here able to file an official feature request to Apple to be able to use Time Machine efficiently also with large files (let's stay > 5 GBytes) ?


I should propably mean using a differential compression algorythm over the network like the examples below:


http://rsync.samba.org/tech_report/tech_report.html

http://en.wikipedia.org/wiki/Remote_Differential_Compression

Aug 2, 2013 6:19 AM in response to ohault

Time Machine doesn't do any file comparison at all.

The OS has a daemon that tracks every file system change (fsevents). The changes are stored in a database and Time Machine uses that database to decide what gets backed up.


There really isn't a way to implement those features as the program doesn't do any file comparison at all.

Aug 2, 2013 6:21 AM in response to ohault

ohault wrote:


We are talking here about a network protocol that will be used by Time Machine on OSX to communicate with a Time Capsule, not the way bits are stored on disks.

No, it is about the way bits are stored on disks. Time Machine is complex enough as it is.


If you are using a virtual machine so much that you really need it backed up, perhaps you should consider using that operating system. Otherwise, you can configure your VM software to store files in your Mac home directory where Time Machine will back them up.

Aug 2, 2013 7:16 AM in response to ohault

ohault wrote:


I would like to use Time Machine to backup to a MacBook Air but that computer is using a Virtual Machines store in a single file of 50 GBytes...

Is that really a good idea? If you have Time Machine running automatically (I don't), it will undoubtedly be backing up the VM while it's in use. The VM file (which, at least in VMware Fusion) is really a bunch of smaller component files, which would be in a constant state of flux, so as the TM backup proceeded, the VM state at the end of the backup would be different from its state at the beginning and the component files wouldn't align time-wise. As a result, wouldn't the VM file restored via TM run the risk of being corrupted?

Aug 2, 2013 7:19 AM in response to FatMac-MacPro

FatMac\>MacPro wrote:


ohault wrote:


I would like to use Time Machine to backup to a MacBook Air but that computer is using a Virtual Machines store in a single file of 50 GBytes...

Is that really a good idea? If you have Time Machine running automatically (I don't), it will undoubtedly be backing up the VM while it's in use

Time machine does not backup files that are open.

Aug 2, 2013 7:24 AM in response to ohault

I can see two ways of handling such case:


A) if files are locked, the backup should be configured to skip them.


B) Many Virtual Machines (VM Ware Fusion, VirtualBox, ...) has built-in mechanism and APIs to create snaphots while the VM is running. In that case, Time Machine will not backup the running VMs but snapshots. Snapshoots are also big files.

Aug 2, 2013 7:24 AM in response to Csound1

Csound1 wrote:


FatMac\>MacPro wrote:


ohault wrote:


I would like to use Time Machine to backup to a MacBook Air but that computer is using a Virtual Machines store in a single file of 50 GBytes...

Is that really a good idea? If you have Time Machine running automatically (I don't), it will undoubtedly be backing up the VM while it's in use

Time machine does not backup files that are open.

So the OP's VM would only be backed up by TM if the Mac was running but the VM was not?

Does Time Machine use a differential/delta file compression when copying files ?

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.