Changing audio output channels doesn't work

Assume I start with wired headphones plugged into my laptop with Apple Music for Windows. If I ever unplug the headphones, it won't play automatically on speaker, nor does selecting speaker as my audio output on Windows have any effect. As far as I can tell, there is no way to choose between headphones or speakers in Apple Music for Windows. Sometimes if I plug the headphones back in before restarting, the music will keep playing, sometimes not.

The same is true if I do the reverse (start with speakers, plugging in wired headphones doesn't automatically switch, nor can I actually hear any music. I don't remember if it always stops the playback or not, but no matter what I do, I usually have to restart Apple Music for Windows. Sometimes multiple times).