Apple TV won't wake up after falling asleep for more than a few hours

I've had this issue for quite a while now, where if my Apple TV has been asleep for more than several hours straight, the display will not wake up. The light on the box itself will be on, however the only way to get the Apple TV to start displaying on the tv again is to unplug the power from the Apple TV and plug it back in to force a restart.