Headphone jacks have a ground terminal that is normally closed, when a plug isn't inserted. When you insert the headphone's plug, its tip pushes that terminal aside and opens that ground connection. This silences the other audio output jack, while sending the audio signal to the headphones. When you remove the plug, the ground terminal moves over and closes the circuit, restoring sound. If your speakers aren't silenced when a plug is inserted in the headphone jack, that ground shunt terminal isn't opening properly. It could be metal fatigue that has caused the terminal to become bent or cracked, affecting its movement. If a small piece of metal has broken off and is positioned so that the circuit is permanently closed, the connected speakers will always be ON. The opposite can also occur, when the ground shunt breaks and there is no sound being conveyed to the speaker. In either case, the practical solution is to replace the jack. It's a nuisance repair, but worth the effort — unless you want to have to turn OFF the other speakers manually.