iPhone XS iOS14 - caller can't hear me after I pick up

I first noticed this problem in early December 2020. Since then it has gotten so much worse. Basically when I pick up a call I can hear the caller but they can't hear me. If I hang up and call them back, it works. It happens pretty much 90% of the time I get a call.

There is nothing wrong with the microphone since I can use Voice Memos without a problem. I tried all the recommended solutions like force restart, turn off VoLTE, turn off noise cancellation. Nothing works.

To me this is clearly a software issue in iOS14. Anyone else dealing with this?