turn off remote control

Is there a way in system preferences to turn off recognition of a remote control? I have the 27" iMac and have been using the remote control that came with Apple TV. Every time that I use the remote on the Apple TV, the iMac wakes up and occasionally iTunes turns on and starts playing. It's quite annoying!