EarPods Cutout on iPhone SE.

I have an issue with my iPhone SE of my EarPods cutting out while listening to music, podcasts or on the phone. There doesn't appear to be any pattern, but it does tend to happen within the first few minutes of playing/talking. I have tested two EarPods (one being brand new) and both headphones have had the same issue. I swapped my original iPhone SE at my local Apple Store for a new one, but now having the same issue on the replacement unit. I now suspect there is an issue with iPhone SE in general. Any help on how to eliminate this issue would be greatly appreciated as don't want a defective phone.