iTunes Keeps on Syncing Every Song In my Library Besides the one I Want

I manually manage music, so I drag music over to the "iPhone" on the sidebar. When I drop it, it starts syncing buy it syncs stuff that I already deleted and ends up not syncing any of the music I intended to sync. It's been going on for weeks and is really frustrating