Apple Pay is not working

I have purchased a new phone and have uploaded everything off of my iCloud. However, my Apple Pay is not working. It's saying I need to contact my card issuer. I have tried resetting my phone from new, as well as manually setting my card up but nothing works. Is there a way of resetting the wallet as in deleting everything within that app? Please help

[Re-Titled by Moderator]