Skip navigation

Unexpected Vault Behavior- missing images

871 Views 23 Replies Latest reply: Oct 7, 2011 7:12 AM by Ernie Stamper RSS
1 2 Previous Next
DLScreative Level 4 Level 4 (1,595 points)
Currently Being Moderated
Oct 2, 2011 4:36 PM

Let me preface this by saying that I'm not one of those users that cries "Aperture deleted my images", and my first thought is always user error when I see one of those posts. However, I've had two recent experieces that make me question that position. This is one of them:

 

I wanted to copy my main library to a new drive, but it was going slowly so I decided to take a different route: I updated my vault, created a new library then restored the new library from the vault.  This is one of those rare moments when one is restoring from a vault with the original library still intact.

 

 

Everything went as planned, and as expected, until I compared the two libraries. There was a 31.16 GB discrepancy so I started digging and found that the new library had 351 fewer images than the original.

 

 

Images in the trash? no

Images offline? no

Closed/opened stacks? no

Deleted images saved out out of vault? Only accounts for about 5 GB

 

 

My Math:

Library restored from vault: 91,102 photos @ 648.21 GB

 

 

Original library 91,453 photos @  679.37 GB

 

 

351 missing 31.16 GB Difference

 

 

There are images from four different cameras ranging from 6MP to 12MP so if i average that to 9MB each I get:

351x 9MB = 31.59 GB

 

 

My conclusion: there actually are 351 missing images!

 

 

I can't think of a filtering scheme that can tell me which 351, and I can't account for this.  Can anyone else?

 

 

DLS

  • Kirby Krieger Level 6 Level 6 (11,570 points)
    Currently Being Moderated
    Oct 2, 2011 6:01 PM (in response to DLScreative)

    First -- only because your write-up is inclusive and this wasn't there -- check to see if those are rejected Images (i.e.: rated "x" or its odd keyboard equivalent, "9").

     

    Also make sure Aperture has finished processing.  You never know. 

     

    My next suggestion is too late: always run "Repair Library" prior to moving a Library.

     

    That makes me think that maybe running "Repair" on your new, diminished Library might have some effect.

     

    Fwiw, my experience with moving very large Libraries (>100,000 Images) is that a handful of Masters are always lost.  This has happened whether I moved the Masters separately and then located them (i.e.: reconnected them) or used "File→Relocated Masters".  "Handful" = <15.  I put this down to low-level drive errors (I have not scanned the drives by sector). 

     

    I have never lost a Version, however.  (I don't use Vaults.)

     

    Comparing Masters between two Libraries is inelegant, but not difficult.  Comparing Versions is probably the same.  Just for fun you could put a tag on all the Versions in the smaller Library, then merge it back into the original Library and then filter the resulting Library for "Does not have tag".

     

    Keep us posted.  Good Luck.

  • Frank Caggiano Level 7 Level 7 (22,785 points)
    Currently Being Moderated
    Oct 2, 2011 6:09 PM (in response to DLScreative)

    The 31.16 GB discrepancy is in the sizes of the two .aplibrary folders? And you see the difference in image counts by looking at the count in the Photos view or by looking at the toatal number of images listed in the Library Choice window? And are all the images in the library  managed?

     

    Need to give this more thought but for now is there anything in Images Removed from VaulttotalNamed folder (located in the folder where the vault is).

     

    One other thing to try as you still have the original library is to create a new vault from it and compare that vault to the one you just updated.

     

    Also the standard questions, the drive you are vaulting to and restoring to are formatted OS X Extended and are local?

  • Frank Caggiano Level 7 Level 7 (22,785 points)
    Currently Being Moderated
    Oct 4, 2011 7:16 AM (in response to DLScreative)

    DLScreative wrote:

     

    Frank Caggiano wrote:

     

    The 31.16 GB discrepancy is in the sizes of the two .aplibrary folders? And you see the difference in image counts by looking at the count in the Photos view or by looking at the toatal number of images listed in the Library Choice window? And are all the images in the library  managed?

     

    Yes the discrepancy is in the sizes of the two .aplibrary folders. I'm  looking at the count in the Photos view.  It's a mixed (about 50/50) managed/ referenced library.  I did check to see if offline images were the culprit. No dice.

    Even though you have moved on from this and appear to not have the time to go any further troubleshooting the problem I do have one further question.

     

    In my original reply I asked how you were coming up with the image count in the library. You indicated  it was from the count in the Photos view. I would also be curious to see how that count compares to the count given in the Library choice window. If you find the tie could you post that.

     

    regards

     

    Ps And as far as the suggestion that larger databases are somehow less robust then small databases, that opinion has no basis in fact. There are  lot of reasons to choose a managed or a referenced workflow. Library size isn't one of them.

  • Ernie Stamper Level 8 Level 8 (37,445 points)
    Currently Being Moderated
    Oct 4, 2011 7:36 AM (in response to DLScreative)

    I never use Vault, and thus cannot answer a question that comes to mind about new masters that are created whenever you choose to edit a photo in an externall editor.  Are those also backed up via Vault?

     

    Ernie

  • Kirby Krieger Level 6 Level 6 (11,570 points)
    Currently Being Moderated
    Oct 4, 2011 9:12 AM (in response to Ernie Stamper)

    Hi Ernie -- The answer is "Yes".  Afaik, they are always created as Managed Masters, and as Managed Masters are automatically included in any newly-created Vault or added to any existing Vault when that Vault is updated.

     

    DLSCreative was comparing a Library restored from a just-completed Vault to the original Library.  Since no changes were made to the Library, the two should be identical, regardless of the file status of the Image's Masters.

     

    The one thing I can think of is that creating and restoring from a Vault could give Aperture a chance to recover wasted disk space inside the Library.  I don't know any way to check this -- it would be good to know.  But 31 GB seems to be _way_ too much space to recover through database compaction.

  • Ernie Stamper Level 8 Level 8 (37,445 points)
    Currently Being Moderated
    Oct 4, 2011 9:26 AM (in response to DLScreative)

    I think he means when you hold down the Option Key while launching Aperture, and highlight each of the available libraries.  A count of versions and Masters is presented with each.

     

    Ernie

  • Frank Caggiano Level 7 Level 7 (22,785 points)
    Currently Being Moderated
    Oct 4, 2011 10:09 AM (in response to DLScreative)

    The window you get when you select Switch to other Library:

    Screen shot 2011-10-04 at 10-04 12.48.49.png

    At the bottom where it shows the complete path for the selected library it also shows the number of masters and versions in that library.

     

    Database's in general are one of the most reliable pieces of software out there. They have been around since allmost the beginning and have been extensivly studied and refined. One of the problems IMO is that then Aperture library isn't a database, its a mishmash of database files and flat files which actually make the code more complex then it needs to be. Hopefully at some future point the Aperture library will become a true database.

     

    Until then we have to work with what we have and adressing the problems we encounter. We all have our own particular vodoo we use to try and cope with the isues. Just bear that in mind when recommendations are made here.

     

    regards

  • Ernie Stamper Level 8 Level 8 (37,445 points)
    Currently Being Moderated
    Oct 4, 2011 11:49 AM (in response to DLScreative)

    I have one library where there 108 versions and 176 Masters.  Although this was a test of a Referenced Library, I can also confirm that the difference is due to there being a pair of RAW + JPEG.  The reason the Master count was not double was that there were JPEG alternatives created in Photoshop in the folder as well.

     

    In the Browser view of the Project there is only one version counted for the pairs.  That version can be changed with the Command in the drop down under Photo to be set either from the JPEG Master or RAW Master without changing the count.

     

    Do you have some pairs in this database?

     

    Ernie

1 2 Previous Next

Actions

More Like This

  • Retrieving data ...

Bookmarked By (0)

Legend

  • This solved my question - 10 points
  • This helped me - 5 points
This site contains user submitted content, comments and opinions and is for informational purposes only. Apple disclaims any and all liability for the acts, omissions and conduct of any third parties in connection with or related to your use of the site. All postings and use of the content on this site are subject to the Apple Support Communities Terms of Use.