Why isn’t my remote staying connected?

I have a 4K Apple TV and it’s only a few months old. I’ve experienced my remote not connecting to the actual device twice. Once I had to factory reset the device and I don’t quite feel like doing that again for my $200. The only way the remote work to navigate is if I literally have it hovering over the box. I can, however, reset the Apple TV holding the menu and tv buttons and I can use the volume buttons on my television. When I move back the remote loses connection, even if I move 2 feet away from the box. This is a nuisance for the price I’m paying. I’ve tried holding the menu and volume up buttons to pair but all I get is a message to move closer but still the same problem.