Headphones don't work with iPhone 6S Plus

My headphones sometimes doesn't work with my iPhone 6S Plus. This problem occurs when I use the EarPods that came with the iPhone, but also when I use other headphones from a British company called Raw Audio.

What happens is this: I try to do a phone call with the headphones, but I can not hear the sound from the call going through. This problem also happens when I try to listen to podcasts or music. Sometimes, the sound just doesn't come out of the headphones. When I remove them, the sound comes through the iPhone speaker.

The problem can be solved by a reset of the iPhone - but I don't see that as acceptable.

I never had this problem before updating to iOS 10.