Poor AirPod audio

Why is it that the sound quality gets really bad when I'm using the microphone. For example, I'm in a call on my Mac and want to listen to music in the background. But the music quality is REALLY bad. Although, when i deselect my AirPods as the microphone it all of a sudden gets better?