Wallet Will Not Delete Apple Credit Card

I have an Apple credit card linked to my wallet but no matter what I do, it will not permanently delete it. There is no balance on the card so that can’t be it. I don’t want to have access to it in my wallet or I over spend. It will always stay in the previous cards section after I delete it so I will pull it out from that section and use it again. The only way I can think to remove it is to cancel the card but that will ruin my credit.