Apple Remote - Menu button works, no other buttons work

So I have a mid-2007 iMac (The first aluminum model that was made) and one of the previous gen white apple remotes. No matter how clsoe or how far away I am from the computer, the remote's menu button opens Front Row immediately. Never misses. But then, that's it, no navigation buttons work once front row is open, only menu again to close it. Tried changing the battery out, but same thing (stinks, the new battery was a third the price of a whole new remote).

Every once in a while, if I keep hitting one of the navigation buttons, I'll get some kind of response (Maybe 1 in 50 - 75 times) but otherwsie, no response from navigation controls. Menu button never fails to open and close Front Row, though.

Any thoughts?