RickTheRigged
Level 1 (5 points)
iPhone

Q: Why is the Photos app uploading my Photos library a second time?

Hey everyone,

 

so I recently decided to upgrade my iMac's internal HDD to a 500 GB SSD after the original HDD stopped working a couple of days ago.

 

Everything went fine, I restored my system from the most recent time machine backup, upgraded to El Capitan and the iMac runs very smoothly now.

 

However, for some reason I can't quite figure out, the Photos app is trying to upload my entire Photos library AGAIN (20.000 photos). With my somewhat slow internet connection that would take days. Also there's no apparent reason for the iMac to upload them a second time.


All the photos are in iCloud already, I can see them on my Macbook Air and when I log in to iCloud via the web interface. And somehow iCloud seems to know that - although the iMac is clearly uploading files, these files apparently go nowhere: there no duplicates in the library from what I can tell so far, and I still have the same 28 GB of free iCloud space although the iMac allegedly has already uploaded 2 gigabytes worth of photos.

 

Any ideas what I could do? Obviously I could just stop the upload manually. However, I found out that the iMac won't download any new photos (for example photos that I take on my iPhone) as long as it's still uploading those older files. So that's not really an option.

iMac (27-inch Mid 2010), iOS 7.1.2

Posted on Nov 12, 2015 12:42 AM

Close
RickTheRigged

Q: Why is the Photos app uploading my Photos library a second time?

  • All replies
  • Helpful answers

  • by léonie,Helpful

    léonie léonie Nov 12, 2015 5:11 AM in response to RickTheRigged
    Level 10 (107,629 points)
    iCloud
    Nov 12, 2015 5:11 AM in response to RickTheRigged

    After you restored the Photos Library from your Time Machine backup to a new HD, it is apparently a different library.  Photos is now merging this new library into your iCloud Photo LIbrary.

    Even if iCloud is saying "uploading", it will usually only compare to iCloud.

    Open the Console.app (it is in Applications > Utilities). The Console will show you, what iCloud is doing.

     

    You could type "photomodel" into the Console search field. Then I am seeing the process that is doing the duplicate checking:

    Screen Shot 2015-10-13 at 17.18.56GMT.png

  • by RickTheRigged,

    RickTheRigged RickTheRigged Nov 12, 2015 1:28 AM in response to léonie
    Level 1 (5 points)
    iPhone
    Nov 12, 2015 1:28 AM in response to léonie

    Thank you for your answer!

     

    The idea that iCloud is just comparing my "new" library to the old one makes sense. What worries me though is that the speed at which it is comparing is identical to the speed at which the Photos app usually uploads my new photos. Also, my internet connection is constantly extremely slow during this process, which makes me suspect that there really is some proper uploading going on.

     

    When I search for "photomodel" in the Console search field I do not get any results. Can this have anything to do with the fact that my iMac is set to German and the "photomodel" process is called differently in German?

     

    Bildschirmfoto 2015-11-12 um 10.22.26.png

  • by léonie,

    léonie léonie Nov 12, 2015 3:38 AM in response to RickTheRigged
    Level 10 (107,629 points)
    iCloud
    Nov 12, 2015 3:38 AM in response to RickTheRigged

    I don't know, what I would be seeing if my system were set to German language, I do not want to restart my Mac right now.

    But when my Mac is really uploading new media items to iCloud, I am seeing a lot of entries for cloudphotosd, like these:

     

    12/11/15 12:33:04,234 com.apple.photomodel[1846]: Duplicate Detection: removing the following masterIds: (null), versionIds: (null)

    12/11/15 12:33:04,266 cloudphotosd[330]: MSPublisher - 218471100 Submitting 1 asset collections for publication.

    12/11/15 12:33:04,275 cloudphotosd[330]: MSPublisher - 218471100 Sending metadata...

    12/11/15 12:33:04,593 cloudphotosd[330]: MSPublisher - 218471100 uploading 1 assets...

    12/11/15 12:33:05,855 cloudphotosd[330]: MSPublisher - 218471100 Sending metadata...

    12/11/15 12:33:05,920 cloudphotosd[330]: <CPSMediaStreamDaemon: 0x7fb381d54ef0>: Push notification received for My Photo Stream with targetPersonID 218471100.

    12/11/15 12:33:06,065 cloudphotosd[330]: MSSubscriber - 218471100 Found 1 new asset collections.

  • by RickTheRigged,

    RickTheRigged RickTheRigged Nov 12, 2015 5:16 AM in response to léonie
    Level 1 (5 points)
    iPhone
    Nov 12, 2015 5:16 AM in response to léonie

    When I look for "cloudphotosd" in the Console app, I do see a lot of activity. However, there are a lot of error messages: In fact, the upload has now stopped, with 18.100 items remaining for upload. Additionally, the newest photos are still missing in the iCloud library on my iMac, presumably because the Photos app, at least technically, hasn't yet finished "uploading" (comparing, that is) my photos.

     

    Bildschirmfoto 2015-11-12 um 14.13.43.png

  • by léonie,

    léonie léonie Nov 12, 2015 5:29 AM in response to RickTheRigged
    Level 10 (107,629 points)
    iCloud
    Nov 12, 2015 5:29 AM in response to RickTheRigged

    TThere seems to be a problem with the videos.  Try to click the disclosure triangles in the messages starting with "failed to generate the derivative video ..." To see the file names of the videos in question.  Do these videos play in  photos on the mac?

  • by kuky,

    kuky kuky Feb 10, 2016 7:27 AM in response to léonie
    Level 1 (8 points)
    iPad
    Feb 10, 2016 7:27 AM in response to léonie

    MSPublisher is a microsoft item , according to a conversation i just had with a senior advisor from apple.... this has nothing to do with Video like you suggest.

     

    <Edited by Host>

  • by léonie,

    léonie léonie Feb 10, 2016 7:29 AM in response to kuky
    Level 10 (107,629 points)
    iCloud
    Feb 10, 2016 7:29 AM in response to kuky

    I don't have any Microsoft software installed on my Mac.    So try to interpret my screenshot differently.

     

    The video reference is in response to RickTheRigged screenshot  - read the first lines of the Console screenshot "cloudphotosd: Failed to generate video derivative ..."

  • by kuky,

    kuky kuky Feb 10, 2016 7:33 AM in response to léonie
    Level 1 (8 points)
    iPad
    Feb 10, 2016 7:33 AM in response to léonie

    12/11/15 12:33:04,593 cloudphotosd[330]: MSPublisher - 218471100 uploading 1 assets...

  • by Old Toad,

    Old Toad Old Toad Feb 10, 2016 10:26 AM in response to RickTheRigged
    Level 10 (141,223 points)
    Mac OS X
    Feb 10, 2016 10:26 AM in response to RickTheRigged

    For what it's worth according to this Apple document, Fix missing or incorrect thumbnails in Photos - Apple Support), if you repair your library according to this Apple document, iCloud Photo Library, that will trigger a unload of all your photos to the iCloud Photo Library again. 

    Regenerate missing thumbnails with library repair tool

    If a large number of your pictures' thumbnails are missing, you can regenerate them with the Photos library repair tool:

    1. Quit Photos.
    2. Open Photos while pressing the Command and Option keys.
    3. Click Repair in the dialog that appears.

    This process recreates thumbnails for all the master images stored in your Photos library.

    Note: If you use iCloud Photo Library with Photos, this action will cause Photos to re-upload all your pictures

    .

    OTsig.png

  • by léonie,

    léonie léonie Feb 10, 2016 11:37 AM in response to kuky
    Level 10 (107,629 points)
    iCloud
    Feb 10, 2016 11:37 AM in response to kuky

    12/11/15 12:33:04,593 cloudphotosd[330]: MSPublisher - 218471100 uploading 1 assets...

    In the screenshot where you found this entry, the first message in the Console was the reason why I posted it - to document, that the photo model damon is doing duplicate detection when uploading items to iCloud. The other lines are unimportant for the problem in question, since I am having no problem with uploading my iCloud Photo Library.

     

    Since I do not have Microsoft software installed, is it really interesting to see Console entries prefixed by MS.

    What the Console is frequently showing is icloudphotosd making MSPublisher requests and MSSubscriber requests.

    That are queries to a SQL Server database, I don't know which part of iCloud uses this SQL Server database, my suspicion is that these  are the queries to the location database, because I see them more frequently when browsing photo maps, but I could not find any documentation on how the Places database is accessed.