HomeKit remote access option cannot be enabled

Hello,

My problem is that I cannot enable remote access to my home from the Home app. When clicking my user, both the option to enable editing and allow remote access are greyed out, and while allow editing is on, allow remote access is off. I added my wife to Home, and I can click on her and set editing and allow remote access for her --- but not for myself, even though I'm set as the how owner.

Details, and what I already did for troubleshooting this problem:

I have an Apple TV 4th generation (4k) and it is set as my Home Hub. Keychain is on the cloud, and location services are enabled. I checked on the Apple TV that location services are enabled for Home, and on my iPhone they are also enabled for Home "while using" (there is no "always" option there. I basically followed all steps that are on the website for both the Apple TV and my iPhone, from which I'd like to have remote access. Talking with an apple advisor over the phone was completely useless, she basically read the support homepage for me, which of course I already knew and was clear that I already checked all of these points. Am hoping that maybe someone here resolved a similar problem.

Thanks.