Apple TV remote

What is your model Apple TV? Identify your Apple TV model - Apple Support

What is your model remote? Identify your Apple TV remote - Apple Support

During setup, the first question would be to select a language. Scroll down or up to find your preferred language. With the intended selection highlighted, confirm this by clicking the center of the navigation pad.

It’s a first gen Apple TV and remote.

I presume you mean “Apple TV 4K (1st generation) (2017)”, as the original Apple TV (1st generation) (2007) is no longer functional in any meaningful way.

I can scroll to my preferred language but the pressing the button is not causing it to select. It doesn’t do anything

It is possible that there are mechanical defects in the remote. If so, that would be reason for a replacement.

Note that you have to click a bit harder, or deeper, to an audible click. Just tapping doesn’t register for confirmation of the selection.