Apple Wallet keeps asking me to add a card that I no longer have

Apple Wallet keeps asking to add cards that I no longer have (accounts are closed), so I have no way to activate them (since I don't have a CVV to activate them with) every time I try to go in to add a new card, which means that I cannot use the normal method of removing a card that I no longer want on Apple Pay. How do I remove these cards so that they don't keep popping up every time? I know I can click 'Add a Different Card', but I would like a proper solution to how to remove them.