iOS6 Earphone Issue

Upon updating to iOS6 on my 4, whenever I get an incoming call and plug in my earphones, the sound becomes very hollow, and almost as if it's underwater. To fix it, I would need to hang up on the caller, and call them back with the earphones plugged in already. It's becoming a very annoying bothersome to me, but I'm not sure how else I could fix it. Help?