Deleting songs from iPhone isn't working?

I've followed the instructions to delete songs from an iPhone but it isn't working! No matter how many times I swipe the song or what direction it just won't come up with the delete button. It worked once and now it won't! I'm really annoyed at this. Any ideas for what to do?