A billing problems is normally remedied by checking your payment method: This document explains how to 'Change, add, [review,] or remove Apple ID payment methods' on a Mac or Apple mobile devices; click here --> https://support.apple.com/HT201266
The illegal character issue is something else. Contact Apple and ask them.
Contact Apple. Click here --> https://support.apple.com/choose-country-region Select your country, then a product. If you don't see one that handles your issue then keep experimenting with selections until you reach one that gets you a chat session or a telephone call and get the representative to redirect you.
or:
Contact Apple for support and service --> "See a list of Apple phone numbers around the world."
Click here --> https://support.apple.com/HT201232