Homekit Remote Access

I've installed my first homekit devices (iHome Smartplugs). Besides some starts and stops, it appears to be mostly working. The remote access appears to be intermittent. Sometimes it works and sometimes it does not. When it's not working it seems that I have to reboot my Apple TV and then it appears to work again. Since the device works when I am on my wifi and works intermittently remotely, I would say this was an Apple issue and not an iHome issue. Has anyone else experienced something similar?

Thanks,
Jeff