Apple TV Remote disconnecting when Apple TV goes to sleep

Every time my Apple TV goes to sleep, the remote disconnects from the the Apple TV and the only way I can get the Apple TV to turn back on is to either unplug the Apple TV or use the app on my iPhone. Once the Apple TV is powered back on I can reconnect / pair the remote again to the Apple TV.

Why?