Airpods disconnects when on the phone/facetime but not with music

I have the first gen of the airpods and when I talk on the phone it will disconnect after 10-45 seconds and then the user on the other end sometimes will not hear me after it disconnects until I switch it to regular phone and talk. However, if I am using the airpods for just music it will be playing for 2 hours no interruptions. I tried resetting the airpods and connecting them back to the phone but the problem still persists. What can I do next?