AppleTV Remote touchpad problems

Since the last TVOS update, swiping on my remote either does nothing or goes in the wrong directions. The same happens when i use the remote app on my iPhone. If i unplug the AppleTV, it works again for a while (sometimes 10 min, sometimes a day) but then goes back to non functional. I have charged it, and re-paired it numerous times. Since the same behavior happens with the remote app, I'm less inclined to think there is an issue with the remote itself but rather a software issue in the AppleTV update. I'm going to do a complete reset and update again.

Any other ideas?