How does it show in the Music app on your phone ? If it has the cloud icon against it then it is only in the cloud - you can turn off all cloud music via Settings > iTunes & App Stores > Music (under 'show all' heading) 'off, or you can hide that album via your computer's iTunes so that it doesn't show in the cloud (hiding and unhiding), or you can use the link in my above reply to remove it from your account.
If you've downloaded it onto your phone (i.e. it doesn't have the cloud icon against it) then swipe/drag across tracks (from right-to-left if the phone is on iOS 7 or 8) in the Music app, or you can delete entire albums in iOS 8 by swiping/dragging from right-to-left across them