Can't watch apple tv when bluetooth headphones connected but tv speaker selected.

I turned off my Bluetooth headphones and started watching Apple TV using the built-in TV speakers. Later, I turned the headphones back on, and they connected with both my Apple TV and my phone. The Apple TV’s audio switched to the headphones, but I wanted to listen to music on my phone while someone else watched TV. So, I paused the Apple TV and switched its audio output back to the TV speakers. That let me play music from my phone through the headphones—but now the Apple TV won’t play properly. Whenever the other person tries to press play, the video starts for a split second and then immediately stops.

Detailed steps to recreate:

1. Bluetooth headphones turned off. Start watching apple tv using the built-in tv speaker.
2. Turn on bluetooth headphones, headphones pair with apple tv and my phone.
3. The sound for the tv switches to my headphones. I want to listen to music on my phone while someone else watches tv, so...
4. Pause the apple tv so it stops playing through my headphones.
5. In apple tv, switch the sound output from my headphones to the tv speakers.
6. Now I can play music on my phone through the bluetooth headphones, BUT, the apple tv won't play anymore. The person trying to watch tv presses play, it starts playing, and less than a second later stops playing again.

Anyone have any advice?