Apple TV 4K Siri Remote is changing TV to wrong input when using back/menu button

I have an LG OLED TV but I’ve read about other users with different TVs having the same issue.

Sometimes when I hit the Menu/Back button on my Siri Remote, my TV switches to HDMI 1 even though my Apple TV is on HDMI 2. Restarting my Apple TV is the only thing I’ve found to fix it. It will then work for a couple days before happening again. I recently reset my LG TV to its Initial Settings and yet less than a week later, it’s happened again. Both my TV and Apple TV are up to date. Toggling off my HDMI-CEC on the TV stops it switching but as soon as I toggle it on again, the problem returns.

It seems like it must be an issue with how the Apple TV handled CEC because my other devices don’t have this issue.

One additional variable. I play my Xbox on HDMI 1 and I use the Siri Remote menu button to switch to HDMI 2 when I want to watch something. I’m wondering if the Siri Remote somehow gets stuck thinking the initial input is the one it should switch to. I haven’t been able to replicate this with another input though.

I’ve had the Apple TV and this TV for years and they have worked flawlessly together until this started within the last couple months.

Anyone have any insight?