How to switch tv input

How do I change the input to another HDMI port when I want to use my xbox

You can do that with an Xbox controller if CEC is activated, and if CEC supports that function for both devices. Else use your TV remote (or AV receiver remote if it connects to that).

Your Apple TV remote is not involved with switching to Xbox. The Apple TV remote can only assist in switching to Apple TV box.

I USED to just press the "TV/control center" button on the remote. But is all of a sudden not working which requires I use the television remote to change inputs.