Callers cannot hear me clearly when using both AirPods

Good morning, when on a call I can hear the caller and they can hear me completely clear if I wear one earbud, doesn’t matter which one I wear. However if I put both in they struggle to hear me. It’s not completely muted, but gets incredibly quiet and difficult to. I have 2 sets of AirPods and I’m having the same issue with both of them. Nearly every fix I see suggests a microphone issue which given it’s the same with both my AirPods 4 and AirPods 5 I do not see this being the case. I feel like there is some setting I’m missing that is causing this, but I’m not sure what. Any suggestions?

thank you