Looks like no one’s replied in a while. To start the conversation again, simply ask a new question.

Very slow processing of raw pictures by Photos

Hi everybody.

I just moved from Aperture to Photo. I was used to work with raw files even if Aperture was beginning to work quite slow (that's one reason I moved to Photos). Now with Photo raw processing is even worst: take many seconds to open the file and all the editing tool have a huge latency.

The pictures are Nikon D750 raw files. The Mac is a Mid2010 27', with 1 Tb SSD drive, 8 Gb RAM and High Sierra 10.13.1 installed. Raw original files are in a 3 Tb external drive.


What could I do (other than buying a new Mac ore adding more RAM)?

iMac, macOS High Sierra (10.13.1)

Posted on Dec 8, 2017 10:25 AM

Reply
Question marked as Best reply

Posted on Dec 9, 2017 2:42 AM

Referenced images are not uploaded to iCloud, only managed images. If you make your referenced library your system photo library, only the photos you consolidate into the library will upload to iCloud.

One last thing: aperture had activity tool to make visible what was going on. Can I see if Photos is working in background in faces recognition or geotagging or something else?

Not directly. Photos is giving you occasionally status information, like "uploading 100 photos, updated just now, or scanning for faces (Check the status of your library in Photos for macOS - Apple Support). But this does not tell you, if the process is currently active, only that work needs to be done.

There are two utilities to look for background processes.


In the Activity Monitor enter "Photo" in the search field and you will see plenty of processes (daemons) listed. Some of the photos daemons are:

  • Photos Agent: That is the parent process handling all other Photos processes, like iCloud synchronisation
  • photoanalysisd: This is the artificial intelligence tool to recognize objects and faces in your photos and to classify the photo according to categories. It is needing a lot of processing power.
  • com.apple.photos.videoconversionservice: Some videos need to be converted for syncing with iCloud; I'm seeing these conversion services since I started to use HEIC and HEVC codecs
  • com.apple.photos.imageconversionservice:
  • com.apple.photomoments: organizing the library into moments
  • com.apple.photomodel: This process seems to be creating new memories
  • com.apple.photoingestservice: I'm seeing this process running, after I import new photos or use editing extensions
  • cloudphotosd: updating the iCloud Photo Library
  • photolibraryd: This also will be active after using photo editing extensions or external editors

User uploaded file

The Console window will give a little more information on the currently running daemons. If you click an item, you will see a brief description of theist action. And the Console will show you error messages and diagnostic messages, that might indicate a problem.

This Console screenshot is showing photolibraryd asking the external editor to release the edited image (I think):

User uploaded file

Has someone found some documentation on the process? So far, I could not find any support document explaining the purpose of the different background processes. I just watched them in the Console. And the behavior changed a lot after the upgrade from Sierra to High Sierra,

27 replies
Question marked as Best reply

Dec 9, 2017 2:42 AM in response to Dr_Ted

Referenced images are not uploaded to iCloud, only managed images. If you make your referenced library your system photo library, only the photos you consolidate into the library will upload to iCloud.

One last thing: aperture had activity tool to make visible what was going on. Can I see if Photos is working in background in faces recognition or geotagging or something else?

Not directly. Photos is giving you occasionally status information, like "uploading 100 photos, updated just now, or scanning for faces (Check the status of your library in Photos for macOS - Apple Support). But this does not tell you, if the process is currently active, only that work needs to be done.

There are two utilities to look for background processes.


In the Activity Monitor enter "Photo" in the search field and you will see plenty of processes (daemons) listed. Some of the photos daemons are:

  • Photos Agent: That is the parent process handling all other Photos processes, like iCloud synchronisation
  • photoanalysisd: This is the artificial intelligence tool to recognize objects and faces in your photos and to classify the photo according to categories. It is needing a lot of processing power.
  • com.apple.photos.videoconversionservice: Some videos need to be converted for syncing with iCloud; I'm seeing these conversion services since I started to use HEIC and HEVC codecs
  • com.apple.photos.imageconversionservice:
  • com.apple.photomoments: organizing the library into moments
  • com.apple.photomodel: This process seems to be creating new memories
  • com.apple.photoingestservice: I'm seeing this process running, after I import new photos or use editing extensions
  • cloudphotosd: updating the iCloud Photo Library
  • photolibraryd: This also will be active after using photo editing extensions or external editors

User uploaded file

The Console window will give a little more information on the currently running daemons. If you click an item, you will see a brief description of theist action. And the Console will show you error messages and diagnostic messages, that might indicate a problem.

This Console screenshot is showing photolibraryd asking the external editor to release the edited image (I think):

User uploaded file

Has someone found some documentation on the process? So far, I could not find any support document explaining the purpose of the different background processes. I just watched them in the Console. And the behavior changed a lot after the upgrade from Sierra to High Sierra,

Dec 9, 2017 10:48 AM in response to léonie

Thanks léonie. I hope you find out more. FWIW I'm the one with the 63k Aperture conversion. I'm at 644 "Photos Scanned." Not much change after several days. I've restarted Photos a couple of time, just to make sure it wasn't hung up—although I don't think it was.

A snapshot. Over a 30 second observation, Photos was typically around 60% and the next three never more than 3%. The rest consistently zero.

User uploaded file

Memory is about the same several minutes later except for Photos itself which I've seen rise to about 500MB

User uploaded file

Good luck with finding more about the processes. photolibraryd is doing more than your current estimate as I haven't done any editing since bringing into Photos, unless it's reapplying edits from Aperture which seems possible; how else are Previews going to be generated?


I looked at Console and read about 50 messages. They seemed to be low level. Many create and release session for Photos. Takes about five events.


In my case I'm assuming Henrik is right and that previews are being generated, but three days is a slow process. Most of my photos are geotagged before importing. Not my Photo System Library and no editing while this goes on. CurrentlyI have another library (just 2017) that is my Photo System Library. I don't have either of the Memories items checked in Preferences.

Dec 10, 2017 10:39 AM in response to MtnBiker

Another data point. I looked at the library for changed files in the last 1 day and found nothing. Still active CPU, memory and disk (and since it's an external drive I can feel and hear it being active and the library is the only thing on the drive).User uploaded file

Going back to 6 days day-by-day, I found the only files or folders changed were in the "Masters" folder and they appear to be image files, both Raw and jpg. The image files are two-year old photos. Jumping back 1 month (the conversion to Photos from Aperture was a week or so ago), still only images in the Masters folder are changed. No other kind of files. Either I'm doing the search wrong or something is amiss. Some kind of plist or database file should be changing.

Dec 8, 2017 10:38 AM in response to Dr_Ted

Raw original files are in a 3 Tb external drive.

What format is this drive and how is it connected? If your Photos library on the drive or are you using a referenced library to access them ? (Note that using a referenced library with Photos is not a good idea and is very likely to cause future problems -- :Disadvantages of a Referenced Library in Photos ) What are your iCloud settings?


LN

Dec 8, 2017 11:15 AM in response to MtnBiker

A bit off topic.


Actually it has nothing to do with this thread - For new topics it is rude and not productive to threadjack other's threads - having multiple people post totally different questions in the same thread is very confusing for everyone - please start your own thread for you totally different question -- Writing an effective Apple Support Communities question


LN

Dec 9, 2017 3:28 PM in response to léonie

"classify the images according to the objects in them"


I forgot, if I ever knew, that Photos did that; that would be time consuming, particularly on my four-year old MBP. Just tested it, using sunsets and found 6 (this is on my 64k photos with 644 faces [who knows how many images processed?]). Impressive.


(But I'm holding out for a real keyboard. One can hope that face recognition will make it to the Mac which will then give Apple an excuse to abandon the touch bar.)

Dec 8, 2017 10:44 AM in response to Dr_Ted

Raw original files are in a 3 Tb external drive.

How is this drive connected?


And how much free storage is on your system drive?


Are other processes hogging the CPU? If you just moved from Aperture to Photos, the photosanalysisd process will be using most of the CPU cycles to analyze your photos and to classify them according to categories.I would keep the Mac up and running during the night, so the initial analysis will be finished quickly. This can take more than a week for a large library.

Dec 8, 2017 11:00 AM in response to Dr_Ted

A bit off topic. I just migrated from Aperture and one library with 60k photos is taking forever to scan the photos for faces. In the last 12 hours, 100 photos scanned. 644 total in several days (not on all the time, but most).

2015 MacBook Pro 16B. Drive is 8GB Seagate Expansion Desktop connected via USB3. Drive was reformatted and the only thing on the drive is the Photos library. Memory Pressure is green. Over about one minute, CPU jumps around between 27 and 128%. In past three days, Photos has been off maybe 10 hours while the MBP was being used off-site. This is not the system library; it's a library with older photos. System drive (500GB SSD) has 130GB free. A mix of jpg and RAW.

Dec 8, 2017 12:34 PM in response to Dr_Ted

I had the same issue and I was abut to give up, then I saw what was causing all the problems

i also came from Aperture, Photos needs first to generate new previews then faces then geotagging it takes a llooooooonnngg time some of the function is done when photos is closed some are when you have it running.

for me it took 48 hrs before it came back to speed


i have done some tested with 40 Raw files it took under 2 minutes to auto enhance in photo and in aperture more less the same time

So give it time and keep a look at the active monitor to see what is taking up most of power from you mac


Henrik

Dec 9, 2017 1:46 AM in response to Mac-Lorenzen

Thank's a lot to everybody

Some answers:

- the external drive is a 3Tb formatted in Mac extended journaled with 610 Gb free space and connected via USB to the Mac. In the external drive are kept most of the originals (900 Gb Raw files). Photos library (300 Gb) is in the Mac 1 Tb drive (300 Gb free space)

- the migration from Aperture to Photos took more ore less 4 days

- This huge Photos library is not set as system library so it is not share via iCloud (I am creating a small library only of best pictures as a system library shared via iCloud)

- While working with photos, most of CPU tasks are within Photos processing


So do you believe I might get better performance if I consolidate all my pictures in one single library? Since it will be a 1.2 Tb library I will have to keep it in the external 3Tb drive.


One last thing: aperture had activity tool to make visible what was going on. Can I see if Photos is working in background in faces recognition or geotagging or something else?


Best regards,

Carlo

Dec 9, 2017 4:13 AM in response to léonie

Thank's Lèonie for the precise answer.


In the activity Monitor, 6-7 GB out of 8.0 Gb available are used by Photo (no other app opened)

When working in Photo picture edit mode the % CPU goes up over 100% for Poto processes (Photo, photoanalysissd, photolibraryd). This happens when working on raw pictures. When working with small jpeg files processes are much much faster (immediate opening of files and no latency in editing tools).


Another specification: the tests you see above, are done on pictures whose original raw files are inside Photo library (not referenced)


Best regards

Carlo

Dec 9, 2017 12:16 PM in response to MtnBiker

Yes, sure, the previews are also necessary, but the initial scan to classify the images according to the objects in them, requires even more processing power than rendering previews.



I don't have either of the Memories items checked in Preferences.


Photos will scan for memories nevertheless. You will just not get any notifications "You have a new memory". And photos will not create memories for the holiday events.

Very slow processing of raw pictures by Photos

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple ID.