can't pair my siri remote with my apple tv

The remote that came with my Apple Tv was defective. Got a new one, charged it and now I can't seem to be able to pair it with my Apple TV. When I try using it I get "Pairing in progress. Bring remote closer to the device to continue pairing",