Speaker button is on when I'm using my wired headset?

Is anyone else having this issue...?

Not all the time but sometimes when is use my wired headset the speaker button is on and the person calling or the person I called can't hear me.

Is this a known issue?

Even when I reboot it will happen.....

Please help. I guess I need to bring my 4S to the Apple store tomorrow. 😢😠