Playing video on apple tv and gaming on the mac

So, sometimes I send a video (that I've downloaded or made or whatever) for the kids to watch to onto my apple TV, extending my desktop. And sometimes when I do that, I'm playing a game on the main desktop. I usually have to pause while the video plays or accept muted sound on my game. Is there any way to split the audio so that what sits on my main desktop plays form the computer and what exists on the extended desktop plays from the apple TV?