Before concerning yourself with removing a card, I suggest you first take care of the "billing problem with a previous purchase" shown in red in your screen shot.
You show four different credit cards available in the screen shot. Point to one that can rectify the "billing problem". Solve that first, then consider removing a card.