How to remove the previous payment method

SOmetimes you'll need to add a payment method in order to use apple's services, even when only using free apps. If you get the message to update your payment method simply removing the old payment method will not help, you'll need to update your payment method I am afraid