Headphone mic issue

Sometimes in the phone call the called person don’t hear my voice clearly but when i eject the headphone socket and put it again he hears my voice clearly

note that in first case when he don’t hear my voice clearly, when o get closer to the iphone mic he hears me, so i noticed that i put my handsfree but its mic doesn’t work but iphone mic is working instead