There are two duplicates of one song I have deleted but now they show up and say I can "download from server". There is no option to delete and even when I tried to look at the info for both everything is greyed out.
The two items with the download link are not really duplicates in your library unless you download them. Those are versions in iCloud. If you do not want to see them you can hide them from the "View" menu in iTunes.