Songs not removable from my iPhone?

I purchased an album off of iTunes and it double-loaded the songs on my iPhone. This is annoying enough, but the doubles are faulty, with no artwork, cutting out randomly, and even crashing iTunes on my phone. I removed the songs from my library (thinking I would just re-sync and reload them after) but the faulty doubles stayed on my phone. How do I get rid of them? They're not even in my library, and they don't show on my phone when I check it in iTunes, but they're still on the **** phone.