Ignored face keeps getting recognized

I think Faces is a great feature of iPhoto but this one thing keeps bugging me.

I have a picture of my living room and iPhoto recognizes my tv remote as a face.

Of course I clicked the X icon at the top left of the face and went on naming faces.

But each time I search faces it keeps poppin up again, even when I click the X icon time and time again.

It won't ignore the face. And this happens for a couple of more photos.

Isn't there a way to solve this or to force ignore the face?

I don't want to delete the photos but having these wrong 'faces' or ignored faces each time when I search faces is really annonying..

Thanks in advance (also I've had this since Lion & Mountain Lion, currently using Mavericks and the newest iPhoto version)