Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Imported RAW images and now sync is broken - help...

About a week ago I imported images from a Nikon D7000 SD-card into Photos (running Catalina 10.15.7) I didn't notice that the D7000 had shot the images in JPEG+RAW so half of the files were actually RAW-photos.

The import and upload seemed to have been working fine initially, but yesterday I noticed that my Mac and iPad no longer syncs new photos. My iPhone still syncs fine (meaning I can see the recent photos on icloud.com but they don't show up on the other devices.)

Both my iPad and Mac said "transferring" stuck since September 7 (the day I imported the images).

Yesterday I tried to repair the Library on the Mac as indicated here - https://support.apple.com/en-us/HT204967 - and Photos on the Mac has been stuck on "Restoring from iCloud..." since then.

My library contains ~7000 images and the Library file local on the Mac is 28 GB in size so it can't be super slow to download over a 250 MBps fiber.

What should I do and what can I do not to lose my images?


Any help greatly appreciated!

/Mattias

Posted on Sep 16, 2021 9:58 AM

Reply
Question marked as Best reply

Posted on Sep 22, 2021 11:32 PM

Finally found a solution on MacRumours forum that worked after creating a new Photo Library and assigning it System Photos Library.

Logged out of iCloud and restarted the Mac while zapping PRAM.


Now all my libraries (Mac, iPhone and iPad) are in sync and updating properly


https://forums.macrumors.com/threads/cloudphotod-going-crazy-with-cpu-usage-disk-writes.2209412/?post=28191652#post-28191652

Similar questions

19 replies
Question marked as Best reply

Sep 22, 2021 11:32 PM in response to Mattias Sandstrom

Finally found a solution on MacRumours forum that worked after creating a new Photo Library and assigning it System Photos Library.

Logged out of iCloud and restarted the Mac while zapping PRAM.


Now all my libraries (Mac, iPhone and iPad) are in sync and updating properly


https://forums.macrumors.com/threads/cloudphotod-going-crazy-with-cpu-usage-disk-writes.2209412/?post=28191652#post-28191652

Sep 18, 2021 12:56 AM in response to DanielleM182

Thank you for the suggestion but could you explain what I should be looking for while in Safe Mode?

The only noticeable change was the missing "Photos" item under Library while in Safe Mode, I could find the photos under "Recent"

I allowed it to sit in Safe Mode overnight on power and have now restarted normally since I couldn't detect any activity.

Restarting - the "Photos" item is back, still showing restoring and one change is that the "People" item is now blank showing "0 Photos Scanned". Before Safe Mode I had People identified there. It's now been idle for an hour on power adapter and still 0 photos scanned.

Sep 19, 2021 12:12 AM in response to Mattias Sandstrom

Do the error descriptions tell you anything? (We can't see them)


Are you running any firewall/security/VPN software? If so, try turning them off.


I also haven't asked if your library is stored on your system drive, or on an external (if external what is the format)?


And are you using a referenced library (copy items to library under importing not checked)?

Sep 17, 2021 12:00 PM in response to Mattias Sandstrom

Hi


Your repair has probably triggered a complete new sync - and yes, it can take days. Your full internet speed is not used.


For example, my 5000 image 50GB library took 48 hours full time


You need to leave your mac powered on connected to power until it completes.



two other things you should check.

Do you have an "unable to upload to iCloud" automatic folder. If so, what is in it.

Create a smart album with the condition - photo - is unable to upload to iCloud.


If you have items which cannot upload, then that can stop the process completing.

Sep 19, 2021 12:04 AM in response to TonyCollinet

Waited overnight and monitored the traffic in the firewall - not much activity at all from the Mac.

Googling around I found information about the cloudphotod and checked the logs and found the information below.

The error messages repeat every 25 seconds.


default	08:55:18.808572+0200	dasd	501:com.apple.cloudphotod.sync.discretionary-when-background:76874D:[
	{name: ApplicationPolicy, policyWeight: 25.000, response: {Decision: Can Proceed, Score: 0.19}}
	{name: DeviceActivityPolicy, policyWeight: 2.000, response: {Decision: Can Proceed, Score: 0.40}}
	{name: MemoryPressurePolicy, policyWeight: 5.000, response: {Decision: Can Proceed, Score: 0.50, Rationale: [{[memoryPressure]: Required:2.00, Observed:1.00},]}}
 ] sumScores:45.934556, denominator:69.910000, FinalDecision: Can Proceed FinalScore: 0.657053}
error	08:55:19.318520+0200	cloudphotod	Failed to fetch <private> in <private>: Error Domain=CKErrorDomain Code=1 UserInfo={NSUnderlyingError=0x7f8146434010 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f8146435400 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f81464336f0 {Error Domain=CKInternalErrorDomain Code=5000 UserInfo=0x7f8146435c20 (not displayed)}}}}}, CKErrorDescription=<private>, NSDebugDescription=<private>, NSLocalizedDescription=<private>}
error	08:55:19.319200+0200	cloudphotod	Sync session in scope-update got error: Error Domain=CloudPhotoLibraryErrorDomain Code=80 UserInfo={CPLErrorRequestUUIDs=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f814623c4c0 {Error Domain=CKErrorDomain Code=1 UserInfo={NSUnderlyingError=0x7f8146434010 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f8146435400 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo=0x7f8146435d60 (not displayed)}}}, CKErrorDescription=<private>, NSDebugDescription=<private>, NSLocalizedDescription=<private>}}}, underlying error: Error Domain=CKErrorDomain Code=1 UserInfo={NSUnderlyingError=0x7f8146434010 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f8146435400 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f81464336f0 {Error Domain=CKInternalErrorDo
error	08:55:19.319469+0200	cloudphotod	Sync session did fail with error: Error Domain=CloudPhotoLibraryErrorDomain Code=80 UserInfo={CPLErrorRequestUUIDs=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f814623c4c0 {Error Domain=CKErrorDomain Code=1 UserInfo={NSUnderlyingError=0x7f8146434010 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f8146435400 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo=0x7f8146435d60 (not displayed)}}}, CKErrorDescription=<private>, NSDebugDescription=<private>, NSLocalizedDescription=<private>}}}, underlying error: Error Domain=CKErrorDomain Code=1 UserInfo={NSUnderlyingError=0x7f8146434010 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f8146435400 {Error Domain=CKInternalErrorDomain Code=5004 UserInfo={CKErrorDescription=<private>, NSLocalizedDescription=<private>, NSUnderlyingError=0x7f81464336f0 {Error Domain=CKInternalErrorDomain Code=50
default	08:55:19.319578+0200	cloudphotod	[session #91] failed during scope-update. Will schedule a restart from scope-update
default	08:55:19.319588+0200	cloudphotod	<private> is done
default	08:55:19.319652+0200	cloudphotod	Will back-off retry to 160s

Sep 19, 2021 12:43 AM in response to TonyCollinet

Thank you for your patience!

I can't find a way to see what the "<private>" tag hides in the logs. Is there a way to toggle this? (Like finding a filename there would be extremely helpful!)

Running Bitdefender AV but it has been disabled since starting to troubleshoot this. It's been running fine for over two years though.

Library stored on internal SSD on my MBP 16" 2019.

The checkbox to copy on importing is checked.


Will uninstall Bitdefender and restart the machine and let it sit for a day.

Sep 19, 2021 12:53 AM in response to TonyCollinet


TonyCollinet wrote:

Do the error descriptions tell you anything? (We can't see them)
...

Tony, to see the full error message in the posted code block, scroll it to the right. You can scroll the panel with the trackpad, if you have not the scrollbars enabled to be always shown. I have System Preferences > General > Show scroll bars set to "always", even if I do not use them frequently. But I like to be able to see at glance, if a panel needs scrolling. Sometimes it is hard to guess, that a pane or panel needs scrolling.


Matthias, you may be having items in iCloud, that Photos on Catalina cannot download, so "Restoring from iCloud" is stuck in an endless loop. Items "unable to download" do not appear in "Unable to upload"., if the are not yet on your Mac. The files may be simply too large (do you have huge videos?) or are in a legacy format, that can no longer be processed on Catalina.


Try to identify one of the items, that is is iCloud, but not restored to your Mac from iCloud. I'd start by comparing the videos in iCloud to the videos in your library. Look particularly for videos using an older codec. The problem may also be PDF files, or other files edited with a graphics software.

To compare your Mac Photos Library to the iCloud version, open it both at www.icloud.com in Photos and in Photos for Mac.


Sep 19, 2021 1:06 AM in response to léonie

As I said in the original post - I imported several RAW (.NEF) images from my fried's SD-card into Photos (this was on September 5th after a trip) and that's what I think started this mess because no sync after that.

She has a D7000 and shoots in JPEG+RAW so there are both JPEG and NEF versions for each image. The NEF-files are 25-35 MB in size each and about 40 images. I simply inserted the SD-card and allowed Photos to import the batch - my bad!


I have cleaned the entire import batch from icloud.com and emptied the "Recently Deleted" items there.

I have also deleted the entire import batch from Photos on the Mac and emptied Recently Deleted there as well.


Regarding videos - yes there are some videos in the library on iCloud. Longest about 4 minutes. I cannot see the format on icloud.com so I'm not sure about the format. I have 146 videos in icloud.com and in Photos.

Sep 19, 2021 2:34 AM in response to Mattias Sandstrom

It might have been a coincidence that the problem appeared first after you imported the RAW&JPEG pairs. The RAW format of the D7000 is on the list of supported camera models for Catalina, so iCloud should be able to handle them. The RAW & JPEG pairs may not be the culprit, perhaps just a lack of storage causing a crash. If there are some "bad apples" in your iCloud Photos Library, you would have run into problems any time after the upgrade to Catalina, whenever Photos tried to restore the library from iCloud and cannot download the older files - and this can happen after a crash left the library in an inconsistent state or after a repair or after upgrading the library to a new system version.

The error message seems to be about downloading from iCloud, not uploading to iCloud.


You need oprimarily to test to test the videos, that are are visible at www.icloud.com, but not on your Mac. To see the codecs of the videos that are on iCloud.com but not on your Mac, download the unmodified original of this video from iCloud and to play it on your Mac with QuickTime Player.

Then try to import to to a new, empty Photos Library. Do you get an error message?




Sep 20, 2021 5:14 AM in response to léonie

FWIW - I started my old MBP 13" running Big Sur and enabled iCloud Photos. All items downloaded in less than 15 minutes and the Mac syncs just fine with my iPhone (meaning photos from the iPhone is immediately appearing on the Mac).

Sure - different OS:es (Catalina on the non-working and Big Sur on the working). The old one started completely fresh because it was reinstalled when I stopped using it and now I just setup an account and enabled iCloud Photos.


I have to quote Ripley from Aliens - is there a "way to nuke (Photos) from orbit" to maybe get the iPhoto Library and caches in shape?

Imported RAW images and now sync is broken - help...

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.