iOS 14 phone call audio routing bug?

My AirPods that were playing music got interrupted by someone on the same iCloud as me when they started calling somebody or received a call. They’ve never paired to my AirPods before. I tried forgetting the device on their iPhone but as long as my AirPods are on it defaults to them even though we did that. On the screen when the other person was calling it showed 3 different options for the audio which was default, speaker, and my AirPods specifically for some reason. If they didn’t select any of the 3 options it just switched to my AirPods. We checked in the accessibility settings and changed the call audio routing to automatic but this problem seems to still occur. I’m not sure if this happens with different devices on different iClouds but that’s a big issue because others will hear your conversation. I’d rather be able to listen without another persons iPhone stripping my AirPods audio away from mine and me being able to hear the person they’re calling along with them hearing me be confused.