David Yutzy

Q: Photos Library - Very Large

I've read many of the internet articles regarding large Photos (iPhoto as well) libraries and the general solution seems to revolve around maintaining multiple libraries.  Though technically a solution, I don't find it very easy to use or maintain.

 

For example:  The new iCloud Photo works great with my iPhone or mobile devices, everything is visible of every device.  However, when I want to manipulate on our 256GB MacBook pro, I can't maintain our vast library (40k photos and 7k videos) because I don't have enough local drive space to support the whole library, even with optimization.

 

I've tried several hacks that use symbolic links to shift the Photos library to a NAS or local attached USB drive and this kind of works, but gets very lagged, at least what I can determine within Photos.  Photos pretty much never gets out of sync mode and since we are constantly taking new pics and videos, what I've observed it gets out of sync (at least on the MBP) after a few days (new content in iCloud Photos and increasingly older content on the MBP).

 

A few options I've explored are:

 

  • Don't merge family photos into a single library.  Let everyone keep their own iCloud Photos and Photos library which would spread the load from a singular perspective, but once again, when we each log in to the MBP (under our own accounts), it all consumes resources on the same MBP which doesn't really solve the core problem.  My current solution is to use a single instance of Photos but don't sync (just view) and only download what we need for project books or albums.
  • Stop using Apple based products for photos management and move to Google Photos, Amazon Photos, or ??? other solution that can handle larger volumes in a much more seamless workflow.

 

I would like to solicit some feedback from the community on how folks are managing large libraries and if I've missed something that would make managing our content easier.

 

My personal opinion is that somewhere along the product path, Apple kind of missed an opportunity to understand the monster that has been created with the creation of the iPhone, iPad and other devices with great cameras for pictures and videos and now the general user has an increasingly problematic workflow just to keep it all stored, backed up, accessible, etc.

 

The latest iteration catches up to what Google and Amazon have been doing for a while, but it certainly isn't far enough.

Posted on Oct 19, 2016 1:45 AM

Close

Q: Photos Library - Very Large

  • All replies
  • Helpful answers

  • by tynegal,

    tynegal tynegal Oct 19, 2016 4:33 AM in response to David Yutzy
    Level 1 (60 points)
    Oct 19, 2016 4:33 AM in response to David Yutzy

    I have around 30k images in my Photos library and recently used PhotoSweeper to eliminate duplicates.  I also deleted an iPhotos library I hadn't realised was still there.  This freed up an enormous amount of storage.

  • by David Yutzy,

    David Yutzy David Yutzy Oct 19, 2016 4:38 AM in response to tynegal
    Level 1 (30 points)
    Photos for Mac
    Oct 19, 2016 4:38 AM in response to tynegal

    I also have run my libraries through multiple iterations:  one was to combine all of the various libraries that have evolved over the years and the second was to run a dupes scan and get rid of them.  Many times between wife, daughter and myself we send each other photos and end up with multiples, so I do this workflow on a regular basis.

     

    But even then, it still doesn't solve the fundamental issues I have above.

     

    And Photos on the OS X doesn't have all of the features now on the phone (people, places, things).  Since 2007, Apple's strategy in this area used to be clear, but now it's pretty good up to a point, then it just appears broken.

  • by Winston Churchill,

    Winston Churchill Winston Churchill Oct 19, 2016 4:47 AM in response to David Yutzy
    Level 10 (104,463 points)
    Apple TV
    Oct 19, 2016 4:47 AM in response to David Yutzy

    There are people here with much larger libraries than yours and don't have any problems. There should be no problem using an external drive and no need to start using symbolic links.

     

    Personally I think a communal family album is undesirable. Not only does it mean others might see photos that others don't want them to see, but it also means that everyone is able to delete or alter anything either intentionally or in error. Furthermore, everyone also has access to your mail, contacts, diaries, messages and the like and just like they can with your photos they can also delete and alter this data too.

  • by Winston Churchill,

    Winston Churchill Winston Churchill Oct 19, 2016 4:48 AM in response to David Yutzy
    Level 10 (104,463 points)
    Apple TV
    Oct 19, 2016 4:48 AM in response to David Yutzy

    And Photos on the OS X doesn't have all of the features now on the phone (people, places, things).

    Incorrect.

  • by David Yutzy,

    David Yutzy David Yutzy Oct 19, 2016 4:51 AM in response to Winston Churchill
    Level 1 (30 points)
    Photos for Mac
    Oct 19, 2016 4:51 AM in response to Winston Churchill

    We each have separate iCloud accounts and thus have separate logins on the "home" machine, but when we sync our phones (hardwire) it's usually through me logged in to Photos.  My gut is telling me more or less what you have stated, that I need to move away from this workflow to separate libraries by person, then share (via photo stream) what we want to have common vs a physical hard sync.

     

    I would still have to have (somehow) each person's Photos library on a NAS/external device.  But Photos will only permit iCloud Photos from a library in the ~/Pictures folder.  Any other connected library I'm unable to turn this on.  If this weren't the case, I might be able to get away with putting the Photos library on another drive.

  • by David Yutzy,

    David Yutzy David Yutzy Oct 19, 2016 4:57 AM in response to Winston Churchill
    Level 1 (30 points)
    Photos for Mac
    Oct 19, 2016 4:57 AM in response to Winston Churchill

    Well, let me rephrase:  Searching for Beaches on my phone gets 222 results (more or less correct) on Photos I get 4.  The same for other categories.  My guess is that because of the sync errors with Photos it isn't as up to date as it should be.

     

    Another issue is when we attempt to turn on "iCloud photo sync" on our phones, we get a dialog something like "To turn on sync 8,700 photos will be deleted from your phone".  This isn't what should happen, iCloud sync should literally sync what is already in iCloud Photos and what is on our phones. 

     

    Again, per my comment, the process seems right, but implementation appears to be broken.

     

    Or maybe I'm missing how it should actually work.

  • by Winston Churchill,

    Winston Churchill Winston Churchill Oct 19, 2016 5:10 AM in response to David Yutzy
    Level 10 (104,463 points)
    Apple TV
    Oct 19, 2016 5:10 AM in response to David Yutzy

    We each have separate iCloud accounts and thus have separate logins on the "home" machine

    Then you won't have the issues I suggested with contacts etc but it's even more complicated than I'd imagined. Obviously it's up to you but I'd just have separate libraries and forget all the rest. Use the family sharing album with family iCloud set ups if you want to share some photos between you all.

    I would still have to have (somehow) each person's Photos library on a NAS/external device.  But Photos will only permit iCloud Photos from a library in the ~/Pictures folder.

    That's incorrect, you can use an external drive in just the way I mentioned above.

    Well, let me rephrase:  Searching for Beaches on my phone gets 222 results (more or less correct) on Photos I get 4.  The same for other categories.  My guess is that because of the sync errors with Photos it isn't as up to date as it should be.

    Each device finds it's own faces etc so yes there is the potential for some difference but I suspect yours is more likely because everything has (seemingly) gotten in a mess.

    Another issue is when we attempt to turn on "iCloud photo sync" on our phones, we get a dialog something like "To turn on sync 8,700 photos will be deleted from your phone".  This isn't what should happen, iCloud sync should literally sync what is already in iCloud Photos and what is on our phones.

    This sounds like you have previously been syncing with iTunes, the photos it will be removing are the ones from iTunes not the ones that are in the phones photo library, you can't sync with iCloud and iTunes at the same time, so your iTunes photos are removed, this is expected behaviour.

  • by LarryHN,

    LarryHN LarryHN Oct 19, 2016 6:20 AM in response to David Yutzy
    Level 10 (85,648 points)
    Photos for Mac
    Oct 19, 2016 6:20 AM in response to David Yutzy

    Stop messing with an NAS - Photos will not work with it

     

    Multiple libraries is not a solution - as usual anyone can post anything on the internet and often it is total BS - multiple libraries are confusing and lose the search power of Photos - you will import photos to the wrong library and never be able to find the photos you need quickly

     

    the best solution is iCloud Photo Library with optimized photos on devices with limited storage and at least one large Mac with adequate storage for all originals to have everything and do the backup there

     

    Alternatives would be to use a local external hard drive formatted ac OS extended (journaled) or to change to another software program

     

    LN

  • by drhughes,

    drhughes drhughes Oct 19, 2016 5:59 PM in response to LarryHN
    Level 1 (4 points)
    Photos for Mac
    Oct 19, 2016 5:59 PM in response to LarryHN

    I have a MBAir with 256GB and iCloud Photo Library.  I've run out of space on my HD and can't import any more photos.  I'm thinking I should move my whole library to an external HD, but am not sure of how to do that properly.  What does your comment "formatted ac OS extended (journaled)" mean?

  • by LarryHN,

    LarryHN LarryHN Oct 19, 2016 9:24 PM in response to drhughes
    Level 10 (85,648 points)
    Photos for Mac
    Oct 19, 2016 9:24 PM in response to drhughes

    It means exactly what it says - to use the  photos library on an external drive the drive can only be formatted Mac OS extended (journaled) - you can format it using disk utility (in your utilities folder in the applications folder) purchase one that is correctly formatted

     

    LN