Apple Pay and Wallet Settings Freezes When Trying to Remove Card

When I try to delete a credit card that is on file on my Wallet and Apple Pay in the settings app it causes a loading screen to trigger that never ends after stating that a verification has failed for the credit card. I am at this point unable to take any actions whatsoever in the settings app as the whole thing is frozen. I cannot even force quit from the app. If I force shutdown my computer it does close the settings app, but it will simply freeze again next time I try to remove the credit card.