airpods activate siri but on phone not in ear?

So about 3/10 times when I double tap to activate siri I hear nothing in ear. When I pull out my phone she is awainting a command though. When I speak one siri instantly responds with "things I can do" and a bunch of suggestions IGNORING my command both from my airpods and phone itself (only happens with airpods). Also, if I force a call I can't hear a ring or anything .. just nada, if I switch to speaker it works, back to airpods nada. So frustrating.

This a loop that just gets stuck over and over until I power cycle the phone. So annoying.

I've noticed if I force the phone to do something like play music through the airpods it will sometimes remedy it, but I feel like this is some codec issue with bluetooth interference again.