I can’t remove the payment method

I don’t find any remove button to remove payment method.

See -> Remove a payment method from your Apple ID

Remove a payment method from your Apple ID - Apple Support

⤵️

If you can't remove a payment method

If you have subscriptions like iCloud+, have an unpaid balance, or you use purchase sharing, you must keep at least one payment method on file.

• Do you have a subscription? You can cancel iCloud+ and cancel other subscriptions from Apple. When your subscription period is over, remove your payment method.
• If you're in a Family Sharing group and you use purchase sharing, the family organizer must have a payment method on file. If you're the family organizer, turn off purchase sharing, then remove the payment method.
• If you have an unpaid balance, you might not be able to remove a payment method. Instead, change your payment method.
• 👉 👉 If you still can't remove a payment method, contact Apple Support.

You generally DO need to have a payment method on-file.

So add the new method before attempting to delete the old.

Also see if this helps:

If you need to change or update your Apple ID payment method - Apple Support