Hi there MayonnaiseTheSecond,
Welcome to Apple Support Communities. If you do not wish to use the Siri remote to control your Apple TV, you can do so using a universal remote control. The instructions are found in the Apple Support article: If you can't control your TV or receiver with your Apple TV Remote - Apple Support
"Use a home theater remote
You can use a home theater remote, like a network-based remote for home-control systems or an infrared remote (also known as a universal remote), to control your Apple TV.
To set up your home theater remote to control your Apple TV:
- Add your Apple TV to the Home app and make sure that you assign it to a room.
- Add the remote to the Home app on an iOS or iPadOS device and make sure that you assign it to a room.
After you add the remote to the Home app, you can use it to control any Apple TV that you have in your home.
To learn different ways you can use your remote to control your Apple TV, go to Settings > Remotes and Devices and select Learn Remote."
Feel free to reach back out if you have any questions.
We hope this helps you.