Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Interrupting copy of large folder from MacBook to external backup

A fairly simple question—I've starting copying a folder with several subfolders of about 150 gb total from Google Drive on my MacBook desktop to an external drive. It's taking longer than I was hoping, and I may want to interrupt the copy. What's the downside of doing this? Basically, I don't know in what order the files are being copied, and how I'm going to see where to start up again tomorrow.


I.e., whether there's a way to continue where I left off, how I'll know where to continue, or whether I just need to start over, overwriting the progress I've made, and just planning ahead by copying in smaller chunks . . .


Many thanks.

MacBook Pro (2020 and later)

Posted on Mar 21, 2022 3:03 PM

Reply
Question marked as Best reply

Posted on Mar 21, 2022 4:06 PM

Prior to macOS Monterey:

Do not abort a large file transfer for exactly the reasons you already outlined. You have no idea where it left off or even if you'll end up with a partially copied file, etc. The files might not be copying in alphabetical order but in the order they are stored on disk with no sorting or based on when they were written to disk. You could split up the operations in smaller chunks and that will work but you'll need to initiate the process each time. If you do abort a file transfer with macOS Finder you should probably re-copy from the start all over again and overwrite / replace the existing files in the destination as they cannot be trusted.


macOS Monterey There is a way to resume interrupted file transfers:

However, in macOS Monterey there is the concept of pausing and resuming a copy process. You can cancel a file transfer and a ghosted destination will be kept waiting for you to resume it. You need to click on the ghosted (transparent) destination folder and there will be a pop-up prompt to Finish Copying or Keep Resumable Copy. (Test this out to ensure it works with external disks, might require APFS file system on source and destination)




Command Line Alternative:

Another way is to use the built-in rsync command in Terminal. The rsync command is used by SysAdmins frequently to copy enormous amounts of data in a reliable fashion across servers in a data center and across the Internet. But it works just as well to copy files from one local disk to an external disk.


rsync -avP --append <source> <destination>/


The options here are -a which is short for these common options (-rlptgoD). The -v is be verbose, providing some visual information to track what is happening. The -P option is show progress for every file. The magic bit is the --append which will complete an incomplete file and skip over files you've already copied. That is the magic resume functionality.


Important: I typically leave the trailing / off the source to ensure it creates those folders instead of placing the contents of the folder in the destination location.


rsync -avP --append ~/Desktop/MyFolder /Volumes/ExternalDisk


Results in MyFolder/ being created on /Volumes/ExternalDisk/


rsync -avP --append ~/Desktop/MyFolder/ /Volumes/ExternalDisk


Results in the contents of MyFolder being copied without the parent MyFolder itself to /Volumes/ExternalDisk


You may notice some performance improvement over Finder file copies as rsync can be more efficient. When performing --append operations it may take longer as checksums are used. The version of rsync included with macOS Monterey 12.3 is rsync version 2.6.9 but there is a newer 3.2.3 version you could install it via Homebrew (https://brew.sh) which many admins and developers use to obtain newer and missing command line tools found on Linux but missing or out of date on macOS. Homebrew is a 3rd party macOS command line package manager similar to apt-get, etc.




Similar questions

4 replies
Question marked as Best reply

Mar 21, 2022 4:06 PM in response to Rob Ehle

Prior to macOS Monterey:

Do not abort a large file transfer for exactly the reasons you already outlined. You have no idea where it left off or even if you'll end up with a partially copied file, etc. The files might not be copying in alphabetical order but in the order they are stored on disk with no sorting or based on when they were written to disk. You could split up the operations in smaller chunks and that will work but you'll need to initiate the process each time. If you do abort a file transfer with macOS Finder you should probably re-copy from the start all over again and overwrite / replace the existing files in the destination as they cannot be trusted.


macOS Monterey There is a way to resume interrupted file transfers:

However, in macOS Monterey there is the concept of pausing and resuming a copy process. You can cancel a file transfer and a ghosted destination will be kept waiting for you to resume it. You need to click on the ghosted (transparent) destination folder and there will be a pop-up prompt to Finish Copying or Keep Resumable Copy. (Test this out to ensure it works with external disks, might require APFS file system on source and destination)




Command Line Alternative:

Another way is to use the built-in rsync command in Terminal. The rsync command is used by SysAdmins frequently to copy enormous amounts of data in a reliable fashion across servers in a data center and across the Internet. But it works just as well to copy files from one local disk to an external disk.


rsync -avP --append <source> <destination>/


The options here are -a which is short for these common options (-rlptgoD). The -v is be verbose, providing some visual information to track what is happening. The -P option is show progress for every file. The magic bit is the --append which will complete an incomplete file and skip over files you've already copied. That is the magic resume functionality.


Important: I typically leave the trailing / off the source to ensure it creates those folders instead of placing the contents of the folder in the destination location.


rsync -avP --append ~/Desktop/MyFolder /Volumes/ExternalDisk


Results in MyFolder/ being created on /Volumes/ExternalDisk/


rsync -avP --append ~/Desktop/MyFolder/ /Volumes/ExternalDisk


Results in the contents of MyFolder being copied without the parent MyFolder itself to /Volumes/ExternalDisk


You may notice some performance improvement over Finder file copies as rsync can be more efficient. When performing --append operations it may take longer as checksums are used. The version of rsync included with macOS Monterey 12.3 is rsync version 2.6.9 but there is a newer 3.2.3 version you could install it via Homebrew (https://brew.sh) which many admins and developers use to obtain newer and missing command line tools found on Linux but missing or out of date on macOS. Homebrew is a 3rd party macOS command line package manager similar to apt-get, etc.




Mar 21, 2022 3:28 PM in response to Rob Ehle

It's taking longer than I was hoping, and I may want to interrupt the copy.


You would want to avoid doing that if at all possible.


Best case, if you stop the copying process, things will pick up where they left off when you restart things.. Worst case, things start all over again.


I've had best case and worst case results with things like this, so no way to accurately predict what will happen if you decide to stop the process.

Interrupting copy of large folder from MacBook to external backup

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.