Aperture is asking if all new photographs are the same person

Whenever I go to Faces and I'm presented with the Unknown Faces panel it asks if all the faces are the same person, every one.

I have tons of photos identified with many different people, but when it comes to unidentified pictures it only suggests one person.

I'm running Verson 3.2.3

I'm hoping someone knows the solution because it's very annoying