Hi gregfromos,
Thank you for using the Apple Support Communities! To help isolate the issue, do you have the microphone set to Always Left or Always Right? If so, does changing it to automatic help? To change this settings, please follow the steps below:
1.) With your AirPods in your ears and connected to your iPhone, iPad, or iPod touch, go to Settings > Bluetooth. Alternatively, you can go to Settings > AirPods.
2.) Tap the More Info button 
next to your AirPods in the list of devices.
3.) Tap Microphone and select Automatic
As noted in the following article:
Change the settings of your AirPods and AirPods Pro
There's a microphone in each AirPod, so you can make phone calls and use Siri. By default, Microphone is set to Automatic, so that either of your AirPods can act as the microphone. If you're using only one AirPod, that AirPod will be the microphone.
You can also set Microphone to Always Left or Always Right. You can also set Microphone to Always Left or Always Right to always have either the right or the left AirPod use the microphone even if you remove it from your ear or put it in the case.
If the issue remains after testing, we recommend that you reach out to Apple Support directly to take a further look. Please reach out here:
Get Support
Hope this helps!
Have a great day.
