How do I quit/exit a game from an Xbox controller?

I use an Xbox controller for the games and it works great. The only problem I have is exiting a game and returning to AppleTV. No button seems to do that, so I have to unplug the power and reboot. I also use a universal remote and not the standard AppleTV one. Nothing on that wants to do it either.