Music Stops at Notification, AirPods disconnect, not restart after notification

I’ve seen a few other folks post about this without resolution and I have a new twist. When I am listening with AirPods to Spotify (the only music service I use so I don’t know if it applies to others as well) and a notification comes in, the music will stop, notification play or be read aloud, and then often the music will either not resume at all or my AirPods will disconnect and the music will start playing aloud on my phone. Sometimes the disconnect will happen and sometimes it won’t but the music still stops and does not resume as it used to.

If I open the Spotify app and go to > listing on > airplay > AirPods it will resume. The problem is I’m often on biking or walking with gloves and it’s just plain annoying. Is there any solution to this that doesn’t involve just turning off announced notifications? I find them to be helpful when biking or walking or just doing chores around the house so I’d rather not turn that off.