Do you have multiple apple TVs? I have 2 and thought it might have been the remotes interfering with each other and crashing the system.
This issue is happening on both Apple TVs. I only noticed the issue after buying a new 4K apple TV, although this could have coincided with a TVOS update.