Can't accept homekit invitation from iPhone or iPad
My parents have a different Apple ID than I have, and have recently bought Philips Hue lights and other things you can control using homekit and the Home app. Since we are using different Apple ID's, I thought I would be able to share their home from their devices and just accept it from my iPhone, but in the Home app on my iPhone, it will just have this spinning wheel after accepting it.
I've been letting it spin for quite some time now and it really won't accept. On my parents devices it shows as already accepted, but I can't do anything from either my iPhone or iPad.
I've already tried multiple restarts, reinstallation of the homekit devices, sending a new invitation to control the devices, reinstalling my iPad, logging out of my Apple ID and logging back in again, checking if I have iCloud Keychain enabled and nothing seems to work.
We are using an Apple TV 3rd generation as hub to control from outside the house. I've currently tried to use my (reinstalled and logged in to my parents Apple ID) iPad as a hub which still doesn't let me accept the invitation from my iPhone.
Does anyone have some other suggestion? Any help would be greatly appreciated.
iPhone 6, iOS 10.1.1