Card won't add to my iPhone for apple pay
I have tried adding a card to my wallet for Apple Pay but it doesn't work, I've tried everything. I even called my bank to ask them and they said I should be able to do it on my phone. Then I tried my card that didn't work on my iPhone XR on another phone not signed into my Apple ID but another Apple ID and it worked first try, Why won't my phone allow my card to add to wallet, I'm on iOS 13.3 with an iPhone XR so it should work. Please help.
iPhone XR, iOS 13