AirPod Pro Gen 2 - Issue with phone calls where other person hears themself, but I can't hear them

Got new AirPods for Christmas and I am having a recurring issue with them. If it's helpful the model number is A3047 and I am on iOS18.3. When I make or take a phone call it will sometimes not give me any audio but the other person is hearing only themselves back. The only way to fix it when this happens is to restart the phone, but it happens again and again. However it does not happen every time I am on the phone. Is there an issue with my AirPods or is this a bug? Is there a permanent fix for this? It is very frustrating that I can't reliably make or take phone calls with my AirPods in.