4th Gen Apple TV remote constantly loses connection, then reconnects.

How can I get this to stop? I never had an issue with the 3rd Gen, and I'm very seriously thinking of going back to it. The pop up notice on the TV is VERY annoying!! The remote is charged too, which is also annoying. Thank you in advance for any help.