iPad loses connection with Chromecast in youtube

I just got a Chromecast and i love it. I love casting my netflix, youtube and renting movies with google play.

But when I cast from youtube after a few minutes i lose connection with youtube. My youtube is still playing on the screen but I can't control it my iPad. This only happens with Youtube. I can fix it by hitting disconnect then Connect. Anyway to fix this?