Music plays after call completed on BT Headset

I have had this problem over multiple iPhone models when using Plantronics Bluetooth headsets.

I am not listening to music at the time, I answer or place a call. When I hang up the call, music starts playing automatically. Have not seen anything in settings that would control this behavior.