How can I combine three files of over 20,000 photos each, so I can then remove the dups with Photosweeper. The "Combine libraries in Photos" process does not seem to work for such large libraries.

How can I combine three photo libraries of over 20,000 each, so I can then remove the duplicates at one time. The "support.apple.com" process under Combine libraries in Photos does not seem to work for exporting and importing such large photo libraries. Thanks!!!

MacBook Pro 15″, macOS 10.14

Posted on Aug 8, 2020 4:02 PM

Reply
Question marked as Top-ranking reply

Posted on Aug 9, 2020 9:18 PM

In what way does the process described "not seem to work"? It requires a fair amount of time and temporary disk space, but it is fairly straightforward. You can even do it in stages (export an album or any handy subset of the source library to a temporary Finder folder, import the result, erase/empty the temporary folder, export another clump, import it, et cetera) if exporting or importing 20,000 items at a time seems too much for you.


If you are willing to consider a third-party solution, the paid application PowerPhotos has a "Merge Libraries" function. It can even deal with duplicates during the merge, in several different ways.

See https://www.fatcatsoftware.com/powerphotos/VersionedDocs/v4/merge_libraries.html for information about their merge function. [I have no interest in PowerPhotos except as a user. Note that I have not tested the merge function, so I cannot say how well it works or how efficient it is.]


If you are still on macOS 10.14 (as shown in the footnote of your post), note that PowerPhotos cannot keep originals and modified photos connected with their reversible edits intact unless you are running at least macOS 10.15.


PowerPhotos is often recommended here for its duplicate handling facilities, so you may want to use it for that even if you don't use it for the actual merge.

2 replies
Question marked as Top-ranking reply

Aug 9, 2020 9:18 PM in response to margot818

In what way does the process described "not seem to work"? It requires a fair amount of time and temporary disk space, but it is fairly straightforward. You can even do it in stages (export an album or any handy subset of the source library to a temporary Finder folder, import the result, erase/empty the temporary folder, export another clump, import it, et cetera) if exporting or importing 20,000 items at a time seems too much for you.


If you are willing to consider a third-party solution, the paid application PowerPhotos has a "Merge Libraries" function. It can even deal with duplicates during the merge, in several different ways.

See https://www.fatcatsoftware.com/powerphotos/VersionedDocs/v4/merge_libraries.html for information about their merge function. [I have no interest in PowerPhotos except as a user. Note that I have not tested the merge function, so I cannot say how well it works or how efficient it is.]


If you are still on macOS 10.14 (as shown in the footnote of your post), note that PowerPhotos cannot keep originals and modified photos connected with their reversible edits intact unless you are running at least macOS 10.15.


PowerPhotos is often recommended here for its duplicate handling facilities, so you may want to use it for that even if you don't use it for the actual merge.

Aug 10, 2020 2:09 AM in response to margot818

The best way to merge libraries, imho, is to use iCloud, at least, if you are still running macOS 10.14. It will be nearly lossless merge, and iCloud will solve conflicts between duplicates between libraries:

Notes on Merging Photos Libraries, 2019 Version

The drawback is, that will take a long time for large libraries.


On Catalina the merging with PowerPhotos will be nearly as good, but not work well, if you are using iCloud Photos and optimise storage.




This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

How can I combine three files of over 20,000 photos each, so I can then remove the dups with Photosweeper. The "Combine libraries in Photos" process does not seem to work for such large libraries.

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.