Remote issues with 2nd gen Apple TV. (locking up)

When using 2nd gen Apple TV with provided remote, I can only scroll through items or use on-screen keyboard for a few moments at a time, and then the remote seems to lock up. After a few seconds, I can move around again, but the cycle continues.

I can type a few words with on-screen keyboard or scroll through a handful of items at a time before the remote seems to lock up and not allow me to move around.