Control Centre Remote cannot find Apple TV

I have the Remote app on my iPhone. If I launch the app it finds my Apple TV and I can use the remote fine. If I used the app from Control Centre I just see 'searching' and my Apple TV can't be found. Does anyone have any ideas as to how I fix this? I have tried removing the app and reinstalling.