Problem sharing Homekit home with my wife specifically

I'm having issues sharing my homekit home with my wife. When I send her an invite to my home in the home app everything seems fine until she accepts the invite. On her side the app says it cannot accept the invite. On my side I'm no longer the admin of my home, just a guest. Under "people" I can see my name is still there (hers is gone) and if I click on my picture/name, it shows my name BUT her email adress!? Somehow the accounts link together and leave everyone outside the home... I have tried this from her side aswell, her inviting me, but the same thing happens. I cannot accept, her name is still there but with my email adress. I've tried from different devices (My ipad, her iPad) but with the same result. If I invite my kid everything works just fine...

We are both running iOS 13.3.1. I've also tried loggin in and out of our icloud accounts but with no luck. It's really frustrating and getting this going is something I've been really amped about, but this has made me really disappointed..! PLEASE HELP!