Message stating that a problem with purchase. to update payment method, Message stating that a problem with purchase. to update payment method

I am having difficulty with purchasing from the app store. I recieve a message stating, Paypal is not supported on this devise. To manage or change your payment method go to the itunes store on your computer. Then in red colored ink another statement, There's a billing problem with a previous purchase. Please update your payment method. Now my credit card company had issued a new card with a new numbered account. I just changed the account number to paypal and I still can not access the app store. Can you please help