"Card not added" Error when trying to add debit card to apple wallet

When I try to add my bank card to apple wallet, it gives a "card not added" error and tells me to contact my bank for more information. Bank says everything is ok on their end. I had the same card in apple wallet on the same device in the past, it started giving this error after I did a factory reset and wanted to add the card again. I tried reinstalling wallet and doing a factory reset.