How/when are you trying to remove the card ? You won't be able to do so when trying to download something, you will only potentially be able to do so by just logging into the account : Change or remove your Apple ID payment information in the iTunes Store - Apple Support
If that is what you are doing and if you aren't getting the 'none' option : Why can’t I select None when I edit my Apple ID payment information? - Apple Support