My Apple Music is rejecting my payment

Any error messages given when you try to set up your payment method?

If you have ongoing subscriptions and you want to remove your payment info, to set up a new one, you will have to add the new one first, before you can remove the old payment method.

You can also use Apple Gift Cards to pay for Apple Music Subscription:

What you can buy with your Apple Gift Card or Apple Account balance - Apple Support