Pairing a new Apple TV Remote Control

I have read all the instructions about pairing and unpairing an Apple TV remote control. Long story short, I misplaced the remote control to my Apple TV, now I am trying to pair up the new one.

I do understand that I will have to unpair the misplaced one, but I have tried that without success. I have held down the menu key, plus the fast forward key for 6 minutes even longer but I have not seen the broken symbol. I have tried pairing the new remote but without success.

What am I doing wrong? Any help will be appreciated.