FaceTime audio not working properly

While I'm on facetime the audio from the other party would randomly cut off and resume every few seconds. It does not follow any pattern and it is extremely frustrating. The internet connection shouldn't be the problem. Is there anything I could do to find out what the problem is? Thanks in advance. 🙂