The title describes already my problem.
As expected, after the first search loop all the photos of me and my brother were added to one person. I found a way to remove the wrong recognized photos and create a new group for my brother. The problem is now that the pictures with both of us in it, appear either as me or as my brother! How can I add them to both of us?