If you deselect Sync Music under the Music tab for your iPhone sync preferences, all iTunes music on your iPhone will be erased. The same applies to Movies and TV Shows under the Video tab for your iPhone sync preferences, and for photos under the Photos tab for your iPhone sync preferences. This is by design.
If you are syncing an iTunes playlist or multiple playlists, unless you add additional music to an iTunes playlist that is selected to be transferred to your iPhone, or remove music from the selected iTunes playlist with iTunes, music is not included with the sync process.
If you have sync all music and playlists selected under the Music tab for your iPhone sync preferences, I suggest choosing selected playlists instead under the Music tab for your iPhone sync preferences. This way if you purchase new music from the iTunes store with iTunes on your computer, or import music into your iTunes library from another source, the new music added to your iTunes library will not be transferred to your iPhone when syncing unless you add the new music to an existing playlist selected to be transferred to your iPhone.