My Apple Siri Remote won’t charge

You connect the lightning-to-USB cable that came with the Apple TV to either an AC wall socket with USB power adapter (e.g. same as for iPhone) or to a USB port on a computer. Not to the Apple TV box, and not to the TV.

Charge your Siri Remote - Apple Support

You connect the lightning cable that came with the Apple TV to either the Apple TV itself or a USB port that is getting some power such as a computer.