Apple TV Bluetooth

I’m hard of hearing so I love that I can listen to my Apple TV with a Bluetooth headset. However when I’m watching with my wife the sound on the television is muted when I’m using my headset. As a result we very seldom can watch our Apple TV together because I can only hear half of what’s being said, unless I make the volume level uncomfortable for her. When we are watching cable TV I have a wired headset that I can adjust the volume separately from the television. Is there any way to use the Bluetooth headset without muting the sound on the television and adjusting the volume separately? Or is there some other way to make this work?