Apple TV 4K remote acting up

My Apple TV 4K remote isn’t working well. It scrolls right when you scroll left, it randomly moves around the Home Screen by its self, and looming for a show on any app take 10 mins to click as it now has a mind of its own.

Is there a way to fix this? I’ve tried it on another Apple TV in my house and it does the same thing. I’ve tried resetting it and repairing it. Still acts up. I’ve noticed the 4k remote firmware is 0118 and my regular Apple TV Siri remote firmware is 0257. I thought upgrading it to this version would fix it. But I can’t seem to get it to update. Maybe 0118 is the 4k remote firmware.

Anyways what are my options to fix this?

Thanks!