Can’t add card error. Contact card issuer or try again later.

So I had a iPhone 7 and had my debit card in the my wallet app, perfectly fine. I recently got a the IPhone XR and I’ve been trying to setup my Apple Pay for a long while now, maybe for about 2 months and every single time I go to add the same card that was on my old phone, the wallet app asks me to verify my card by entering the security code and I’ve entered the correct code countless times and it keeps saying, “Can’t add card. Please contact your card issuer”. I’ve also went to the bank and they’ve reset my online banking settings and even tried doing it through my banking app but still come up with nothing. I need help ASAP. This is annoying because I need my Apple Pay for various reasons. PLEASE, SOMEBODY HELP!