Apple TV 4 pauses streaming after ~5secs
As the title says my ATV4 simply pauses the streaming after about 5 seconds of playback, in any application. I've tried YouTube, Apple Events, TED, Plex. It's all the same. If I resume the playback it starts again instantly, but it would pause again after another 5 seconds And so on. It's not a network issue, I have it now connected on Ethernet and the speed test shows an expected 94Mbps and other devices on the same network work just fine. I've even tried to reset it to factory settings, it still does the same thing. I thought it might be the remote, I took it out of range and used an iPhone remote app, no change. Even more infuriating the issue comes and goes with no appparent reason. The ATV might work perfectly well for a week then out of the blue it would simply pause any playback after 5 seconds. Then after a few hours or days it will start to work properly again.
I have no idea what to do anymore, anybody else experienced something similar?
Apple TV, tvOS 9.2